USA flag logo/image

An Official Website of the United States Government

Real Time Analysis and Fusion of Data from Imagers for Passive Characterization…

Award Information

Department of Defense
Defense Advanced Research Projects Agency
Award ID:
Program Year/Program:
2009 / STTR
Agency Tracking Number:
Solicitation Year:
Solicitation Topic Code:
Solicitation Number:
Small Business Information
Li Creative Technologies
25 B Hanover Road, Suite 140 Florham Park, NJ -
View profile »
Woman-Owned: No
Minority-Owned: No
HUBZone-Owned: No
Phase 1
Fiscal Year: 2009
Title: Real Time Analysis and Fusion of Data from Imagers for Passive Characterization of Stress, Anxiety, Uncertainty and Fatigue
Agency / Branch: DOD / DARPA
Contract: W911NF-09-C-0128
Award Amount: $99,976.00


The purpose of this proposal is to present a novel and promising solution for real time detection of stress, anxiety, uncertainty and fatigue using passive features from thermal and visual videos of the face. Our solution consists of five modules: (1) data acquisition - using visual and thermal cameras capturing the face images in visible and thermal waveband. (2) Facial feature localization and tracking - including the eyes, eyebrows, nose, mouth and their spatial arrangement. With our sophisticated techniques, we can detect and track facial features from the face images with different facial expressions under various face orientations in real time. (3) Feature extraction and selection - based on the facial feature location, extracting the features that are related to SAUF, including expiration rate, heart rate, eyelid movement, head movement, etc. Our experience in emotion recognition and fatigue detection enables us to capture those physiological and behavioral features related to the psychological states. (4) Feature fusion and SAUF recognizer - we propose a dynamic statistical model that can monitor the change in each states and quantify its level. (5) Feedback - The computer can respond to an individual's psychological change by either sending and alarm or offering necessary assistance.

Principal Investigator:

Manli Zhu
Senior Research Scientist

Business Contact:

Qi (Peter) Li
Small Business Information at Submission:

Li Creative Technologies
30 A Vreeland Road, Suite 130 Florham Park, NJ 07932

EIN/Tax ID: 383667621
Number of Employees:
Woman-Owned: No
Minority-Owned: No
HUBZone-Owned: No
Research Institution Information:
Rensselaer Polytechnic Institute
Dept. of ECSE
School of Engineering
Troy, NY 12180 3590
Contact: Qiang Ji
Contact Phone: (518) 276-6440
RI Type: Nonprofit college or university