Non-intrusive Multimodal Emotional State Monitoring

Award Information
Agency:
Department of Defense
Branch:
Defense Advanced Research Projects Agency
Amount:
$99,000.00
Award Year:
2004
Program:
SBIR
Phase:
Phase I
Contract:
W31P4Q-04-C-R142
Agency Tracking Number:
03SB2-0257
Solicitation Year:
2003
Solicitation Topic Code:
SB032-038
Solicitation Number:
2003.2
Small Business Information
ADVANCED INTERFACES, INC.
403 S. Allen Street, Suite 104, State College, PA, 16801
Hubzone Owned:
N
Socially and Economically Disadvantaged:
Y
Woman Owned:
N
Duns:
859526688
Principal Investigator
 Rajeev Sharma
 President
 (814) 867-8977
 rsharma@advancedinterfaces.com
Business Contact
 Pamela Lindsay
Title: VP Corporate Affair
Phone: (814) 867-8977
Email: plindsay@advancedinterfaces.com
Research Institution
N/A
Abstract
This SBIR Phase I proposal will conduct an exploratory study to establish the feasibility of a multimodal framework for monitoring the emotion of a person using an non-intrusive sensor suite that includes video, audio, and thermal sensing. This will lead to the development of a portable gauge for robustly monitoring the emotional state of people in operational environments. The following five dynamic features will be considered in the multimodal framework: (a) facial expression, (b) facial temperature distribution, (c) facial perspiration pattern, (c) head movement, (d) hand gesture, and (e) speech prosody. It is expected that the multimodal features will give greater visibility and a more accurate estimate of the emotional state than the observation of any one feature, especially in situations involving suppression of expression. The proposed research will be carried out by a multidisciplinary team from Advanced Interfaces, Inc., Artis, LLC, and the University of Pittsburgh.

* information listed above is at the time of submission.

Agency Micro-sites

US Flag An Official Website of the United States Government