Non-intrusive Multimodal Emotional State Monitoring

Award Information
Agency: Department of Defense
Branch: Defense Advanced Research Projects Agency
Contract: W31P4Q-04-C-R142
Agency Tracking Number: 03SB2-0257
Amount: $99,000.00
Phase: Phase I
Program: SBIR
Awards Year: 2004
Solicitation Year: 2003
Solicitation Topic Code: SB032-038
Solicitation Number: 2003.2
Small Business Information
403 S. Allen Street, Suite 104, State College, PA, 16801
DUNS: 859526688
HUBZone Owned: N
Woman Owned: N
Socially and Economically Disadvantaged: Y
Principal Investigator
 Rajeev Sharma
 (814) 867-8977
Business Contact
 Pamela Lindsay
Title: VP Corporate Affair
Phone: (814) 867-8977
Research Institution
This SBIR Phase I proposal will conduct an exploratory study to establish the feasibility of a multimodal framework for monitoring the emotion of a person using an non-intrusive sensor suite that includes video, audio, and thermal sensing. This will lead to the development of a portable gauge for robustly monitoring the emotional state of people in operational environments. The following five dynamic features will be considered in the multimodal framework: (a) facial expression, (b) facial temperature distribution, (c) facial perspiration pattern, (c) head movement, (d) hand gesture, and (e) speech prosody. It is expected that the multimodal features will give greater visibility and a more accurate estimate of the emotional state than the observation of any one feature, especially in situations involving suppression of expression. The proposed research will be carried out by a multidisciplinary team from Advanced Interfaces, Inc., Artis, LLC, and the University of Pittsburgh.

* Information listed above is at the time of submission. *

Agency Micro-sites

SBA logo
Department of Agriculture logo
Department of Commerce logo
Department of Defense logo
Department of Education logo
Department of Energy logo
Department of Health and Human Services logo
Department of Homeland Security logo
Department of Transportation logo
Environmental Protection Agency logo
National Aeronautics and Space Administration logo
National Science Foundation logo
US Flag An Official Website of the United States Government