USA flag logo/image

An Official Website of the United States Government

Imagaing System and Lipreading Technique for Cockpit Voice Recognition

Award Information

Department of Defense
Air Force
Award ID:
Program Year/Program:
1997 / SBIR
Agency Tracking Number:
Solicitation Year:
Solicitation Topic Code:
Solicitation Number:
Small Business Information
Tanner Research, Inc.
825 S. Myrtle Ave. Monrovia, CA 91016-
View profile »
Woman-Owned: Yes
Minority-Owned: No
HUBZone-Owned: No
Phase 1
Fiscal Year: 1997
Title: Imagaing System and Lipreading Technique for Cockpit Voice Recognition
Agency / Branch: DOD / USAF
Contract: N/A
Award Amount: $99,992.00


Voice command will increase the effectiveness of future military aircraft by providing a fast, intuitive, hands-free user interface. For this technology to gain acceptance, systems must recognize speech quickly and accurately in an adverse environment.Human speech perception is strongly influenced by vision. When visual and auditory cues conflict, listeners' perceptions may be different than with either channel alone (the so-called McGurk effect). Researchers have added lipreading information to audio-based automatic recognizers and reported significant improvements in performance. However, lipreading has not been used in commercial recognizers because of two problems: first, it is difficult to interpret the video signal in real-time; and second, certain applications-such as recognition over telephone lines-preclude the use of video.The oxygen mask of the fighter cockpit simplifies the video-interpretation problem. Both an imager and an illuminator-to precisely control lighting-may be incorporated into the mask. Also, because the mask is head-mounted, alignment will be much less of a problem.In this Phase I effort we will incorporate lipreading into a conventional speech recognizer, and we will design and build an experimental mask-mounted imager. In Phase II, we will collect data with a prototype mask, and add lipreading to our own recognizer.

Principal Investigator:

Mr. Dan Fain

Business Contact:

Small Business Information at Submission:

Tanner Research, Inc.
180 North Vinedo Ave. Pasadena, CA 91107

Number of Employees:
Woman-Owned: No
Minority-Owned: No
HUBZone-Owned: No