Imaging System and Lipreading Technique for Cockpit Voice Recognition

Award Information
Agency: Department of Defense
Branch: Air Force
Contract: N/A
Agency Tracking Number: 36074
Amount: $749,987.00
Phase: Phase II
Program: SBIR
Awards Year: 1998
Solicitation Year: N/A
Solicitation Topic Code: N/A
Solicitation Number: N/A
Small Business Information
2650 E. Foothill Blvd, Pasadena, CA, 91107
HUBZone Owned: N
Woman Owned: N
Socially and Economically Disadvantaged: N
Principal Investigator
 Mr. Dan Fain
 (818) 792-3000
Business Contact
Phone: () -
Research Institution
Voice command will increase the effectiveness of future military aircraft by providing a fast, intuitive, hands-free user interface. For this technology to gain acceptance, systems must recognize speech quickly and accurately in an adverse environment.Human speech perception is strongly influenced by vision. When visual and auditory cues conflict, listeners' perceptions may be different than with either channel alone (the so-called McGurk effect). Researchers have added lipreading information to audio-based automatic recognizers and reported significant improvements in performance. However, lipreading has not been used in commercial recognizers because of two problems: first, it is difficult to interpret the video signal in real-time; and second, certain applications-such as recognition over telephone lines-preclude the use of video.The oxygen mask of the fighter cockpit simplifies the video-interpretation problem. Both an imager and an illuminator-to precisely control lighting-may be incorporated into the mask. Also, because the mask is head-mounted, alignment will be much less of a problem.In this Phase I effort we will incorporate lipreading into a conventional speech recognizer, and we will design and build an experimental mask-mounted imager. In Phase II, we will collect data with a prototype mask, and add lipreading to our own recognizer.

* Information listed above is at the time of submission. *

Agency Micro-sites

SBA logo
Department of Agriculture logo
Department of Commerce logo
Department of Defense logo
Department of Education logo
Department of Energy logo
Department of Health and Human Services logo
Department of Homeland Security logo
Department of Transportation logo
Environmental Protection Agency logo
National Aeronautics and Space Administration logo
National Science Foundation logo
US Flag An Official Website of the United States Government