Automated Analysis and Classification of Anomalous 3-D Human Shapes and Hostile Actions

Award Information
Agency: Department of Defense
Branch: Air Force
Contract: FA8650-10-M-6094
Agency Tracking Number: F093-030-0101
Amount: $99,951.00
Phase: Phase I
Program: SBIR
Awards Year: 2010
Solicitation Year: 2009
Solicitation Topic Code: AF093-030
Solicitation Number: 2009.3
Small Business Information
11600 Sunrise Valley Drive, Suite # 290, Reston, VA, 20191
DUNS: 038732173
HUBZone Owned: N
Woman Owned: N
Socially and Economically Disadvantaged: N
Principal Investigator
 Mun Wai Lee
 Principal Investigator
 (703) 654-9300
Business Contact
 Paul Brewer
Title: VP, New Technology
Phone: (703) 654-9314
Research Institution
This project aims to develop algorithms and software tools for automated inference of human shape and pose, for anomalous shape and hostile actions identification. The problem is challenging owing to large variation in human body shapes, inaccurate 3D data acquisition techniques, non-observability of body parts, self-occlusion and concavities on body surfaces. We propose a robust solution based on fast and efficient data structures that iteratively estimate 3D shape of human targets using multiple input video streams. The 3D representation of human target is obtained as visual hull extracted using space carving. We augment these with medial axis and hierarchical image descriptors as visual cues for robust 3D pose initialization. We have created a statistical shape model using CAESAR dataset that models shape variations among different demographics including gender, age and race. This will be augmented with data of clothing and accessories. The shape model is used to detect anomalous shapes. We adopt learning based approach for action recognition and train temporal graphical models to recognize hostile actions. We will design a modular software architecture with clearly defined software interfaces, user friendly GUI, and open data formats to enhance interoperability and allow for future extensions with new data and actions. BENEFIT: The technology will provide intelligent video analytics to detect suspicious persons and hostile activities for counter-terrorism in military and law enforcement. The technology is also relevant to many areas in the private sectors, including business security, retail, marketing, healthcare, sports, and video games and entertainment. The technology has wide ranging applications: (1) In surveillance: Identify potential suicide bomber in hotels and around commercial landmarks. Identify hostile or abnormal behavior in and around office buildings, embassies, shopping malls, schools, and tourist districts. (2) Improved human computer interaction: The framework will facilitate development of more accurate vision based systems to recognize different gesture and motion in 3D. This has vast potential use in role-playing games where the estimated shape of the user can be used to create avatars and the movements of the user in the physical domain are translated into actions in the virtual environment. (3) Video monitoring in healthcare and fitness center: Detect people who have slipped, fallen, or are in need of other assistance, in health centers or nursing homes. Improved techniques for monitoring body fat and regions of body putting on weight. (4) Intelligent training systems for sporting activities: The analysis of sports-related movements often entails analyzing a variety of highly dynamic movements. Motion analysis provides the tools for the sports medicine and performance professionals to perform accurate functional evaluations/analysis for clinical and research oriented purposes. (5) Provide body shape data for estimating range of sizes and improved design of clothing, footwear and sporting equipment

* Information listed above is at the time of submission. *

Agency Micro-sites

SBA logo
Department of Agriculture logo
Department of Commerce logo
Department of Defense logo
Department of Education logo
Department of Energy logo
Department of Health and Human Services logo
Department of Homeland Security logo
Department of Transportation logo
Environmental Protection Agency logo
National Aeronautics and Space Administration logo
National Science Foundation logo
US Flag An Official Website of the United States Government