Imaging System and Lipreading Technique for Cockpit Voice Recognition

Award Information
Agency:
Department of Defense
Branch
Air Force
Amount:
$749,987.00
Award Year:
1998
Program:
SBIR
Phase:
Phase II
Contract:
n/a
Award Id:
36074
Agency Tracking Number:
36074
Solicitation Year:
n/a
Solicitation Topic Code:
n/a
Solicitation Number:
n/a
Small Business Information
2650 E. Foothill Blvd, Pasadena, CA, 91107
Hubzone Owned:
N
Minority Owned:
N
Woman Owned:
N
Duns:
n/a
Principal Investigator:
Mr. Dan Fain
(818) 792-3000
Business Contact:
() -
Research Institute:
n/a
Abstract
Voice command will increase the effectiveness of future military aircraft by providing a fast, intuitive, hands-free user interface. For this technology to gain acceptance, systems must recognize speech quickly and accurately in an adverse environment.Human speech perception is strongly influenced by vision. When visual and auditory cues conflict, listeners' perceptions may be different than with either channel alone (the so-called McGurk effect). Researchers have added lipreading information to audio-based automatic recognizers and reported significant improvements in performance. However, lipreading has not been used in commercial recognizers because of two problems: first, it is difficult to interpret the video signal in real-time; and second, certain applications-such as recognition over telephone lines-preclude the use of video.The oxygen mask of the fighter cockpit simplifies the video-interpretation problem. Both an imager and an illuminator-to precisely control lighting-may be incorporated into the mask. Also, because the mask is head-mounted, alignment will be much less of a problem.In this Phase I effort we will incorporate lipreading into a conventional speech recognizer, and we will design and build an experimental mask-mounted imager. In Phase II, we will collect data with a prototype mask, and add lipreading to our own recognizer.

* information listed above is at the time of submission.

Agency Micro-sites


SBA logo

Department of Agriculture logo

Department of Commerce logo

Department of Defense logo

Department of Education logo

Department of Energy logo

Department of Health and Human Services logo

Department of Homeland Security logo

Department of Transportation logo

Enviromental Protection Agency logo

National Aeronautics and Space Administration logo

National Science Foundation logo
US Flag An Official Website of the United States Government