Real Time Analysis and Fusion of Data from Imagers for Passive Characterization of Stress, Anxiety, Uncertainty and Fatigue

Award Information
Agency:
Department of Defense
Amount:
$99,976.00
Program:
STTR
Contract:
W911NF-09-C-0128
Solitcitation Year:
2009
Solicitation Number:
2009.A
Branch:
Defense Advanced Research Projects Agency
Award Year:
2009
Phase:
Phase I
Agency Tracking Number:
A09A-006-0035
Solicitation Topic Code:
A09A-T006
Small Business Information
Li Creative Technologies
30 A Vreeland Road, Suite 130, Florham Park, NJ, 07932
Hubzone Owned:
N
Woman Owned:
N
Socially and Economically Disadvantaged:
Y
Duns:
125624432
Principal Investigator
 Manli Zhu
 Senior Research Scientist
 (973) 822-0377
 manlizhu@licreativetech.com
Business Contact
 Qi (Peter) Li
Title: President
Phone: (973) 822-0048
Email: li@licreativetech.com
Research Institution
 Rensselaer Polytechnic Institute
 Qiang Ji
 Dept. of ECSE
School of Engineering
Troy, NY, 12180 3590
 (518) 276-6440
 Nonprofit college or university
Abstract
The purpose of this proposal is to present a novel and promising solution for real time detection of stress, anxiety, uncertainty and fatigue using passive features from thermal and visual videos of the face. Our solution consists of five modules: (1) data acquisition – using visual and thermal cameras capturing the face images in visible and thermal waveband. (2) Facial feature localization and tracking – including the eyes, eyebrows, nose, mouth and their spatial arrangement. With our sophisticated techniques, we can detect and track facial features from the face images with different facial expressions under various face orientations in real time. (3) Feature extraction and selection – based on the facial feature location, extracting the features that are related to SAUF, including expiration rate, heart rate, eyelid movement, head movement, etc. Our experience in emotion recognition and fatigue detection enables us to capture those physiological and behavioral features related to the psychological states. (4) Feature fusion and SAUF recognizer – we propose a dynamic statistical model that can monitor the change in each states and quantify its level. (5) Feedback – The computer can respond to an individual’s psychological change by either sending and alarm or offering necessary assistance.

* information listed above is at the time of submission.

Agency Micro-sites

US Flag An Official Website of the United States Government