USA flag logo/image

An Official Website of the United States Government

Robust and Sequential Recognition of Emotional States Using Hidden Markov…

Award Information

Department of Defense
Defense Advanced Research Projects Agency
Award ID:
Program Year/Program:
2004 / SBIR
Agency Tracking Number:
Solicitation Year:
Solicitation Topic Code:
Solicitation Number:
Small Business Information
Li Creative Technologies
25 B Hanover Road, Suite 140 Florham Park, NJ -
View profile »
Woman-Owned: No
Minority-Owned: No
HUBZone-Owned: No
Phase 1
Fiscal Year: 2004
Title: Robust and Sequential Recognition of Emotional States Using Hidden Markov Models and Integrated Speech, Video, and Thermal Features
Agency / Branch: DOD / DARPA
Contract: W31P4Q-04-C-R150
Award Amount: $98,815.00


This proposal defines unique and promising solutions for robust and sequential emotional and stress state recognition in military operational environments. The solutions are non-invasive, multi-modality approaches, including speech, video, and thermal images. The feature sets are selected automatically based on the operational environments. For example, when the environment is too noisy, the system focuses on image features; when the lighting condition is too bad, it focuses on speech features; when both acoustic and lighting conditions are good, the system uses both speech and image features. This will provide the military with a degree of system versatility and allow broad applications to many operational scenarios. Multi-layer hidden Markov models are defined as the statistical models to characterize the emotional states. The recently developed sequential detection algorithm is proposed to detect the changes from one emotional state to another. Furthermore, a multi-modality database will be collected to study the feasibility of detecting at least the following emotional states in this project: anger, drowsiness, anxiety, fear, confusion, disorientation, and frustration. The new feature extraction and recognition algorithms will be developed and implemented through this project to discriminatively recognize those states. The developed system will be portable and can be operated in military environments automatically and continuously.

Principal Investigator:

Qi (. Li

Business Contact:

Qi (. Li
Small Business Information at Submission:

225 Runnymede Parkway New Providence, NJ 07974

EIN/Tax ID: 383667621
Number of Employees:
Woman-Owned: No
Minority-Owned: No
HUBZone-Owned: No