A System to Analyze Facial Features to Enable Operator Condition Tracking (AFFECT)

Award Information
Agency:
Department of Defense
Branch
Army
Amount:
$749,750.00
Award Year:
2011
Program:
STTR
Phase:
Phase II
Contract:
W911NF-11-C-0030
Award Id:
n/a
Agency Tracking Number:
A2-4087
Solicitation Year:
2009
Solicitation Topic Code:
A09A-T006
Solicitation Number:
2009.A
Small Business Information
625 Mount Auburn Street, Cambridge, MA, -
Hubzone Owned:
N
Minority Owned:
N
Woman Owned:
N
Duns:
115243701
Principal Investigator:
Camille Monnier
Senior Scientist
(617) 461-0488
cmonnier@cra.com
Business Contact:
Ninos Hanna
Contract Specialist
(617) 461-0488
nhanna@cra.com
Research Institution:
University at Buffalo, SUNY
Martina Tsai
Sponsored Projects Services
402 Crofts Hall
Buffalo, NY, 14260-7016
(716) 645-4421
Nonprofit college or university
Abstract
Modern military and security scenarios increasingly demand rapid evaluation of human affective states, accurately detecting stress, anxiety, uncertainty, and fatigue (SAUF) to assess warfighter effectiveness or to advance security screening and interrogation objectives. In our Phase I effort, we designed and demonstrated a system to Analyze Facial Features to Enable Operator Condition Tracking (AFFECT) by extracting a broad array of features from visible and thermal spectrum imagery of the human face. We designed an effective stress induction protocol and recorded the resultant elevated stress levels using heart rate variability data. We demonstrated the feasibility of our classification methodology by implementing a prototype of the AFFECT system. For Phase II, we propose to expand on these results by designing new affective induction techniques and ground-truth metrics for anxiety, uncertainty, and fatigue. We will detect these states by applying novel visual and thermal feature extraction algorithms, and by implementing the temporal feature algorithms designed in Phase I. We are confident that the sound principles underlying our Phase I approach will provide a robust foundation for expanded SAUF classification in Phase II.

* information listed above is at the time of submission.

Agency Micro-sites


SBA logo

Department of Agriculture logo

Department of Commerce logo

Department of Defense logo

Department of Education logo

Department of Energy logo

Department of Health and Human Services logo

Department of Homeland Security logo

Department of Transportation logo

Enviromental Protection Agency logo

National Aeronautics and Space Administration logo

National Science Foundation logo
US Flag An Official Website of the United States Government