USA flag logo/image

An Official Website of the United States Government

Automated Scene Understanding

Award Information

Department of Defense
Office of the Secretary of Defense
Award ID:
Program Year/Program:
2009 / SBIR
Agency Tracking Number:
Solicitation Year:
Solicitation Topic Code:
Solicitation Number:
Small Business Information
11600 Sunrise Valley Drive Suite # 210 Reston, VA 20191-
View profile »
Woman-Owned: No
Minority-Owned: No
HUBZone-Owned: No
Phase 1
Fiscal Year: 2009
Title: Automated Scene Understanding
Agency / Branch: DOD / OSD
Contract: N00014-10-M-0082
Award Amount: $99,918.00


Automatic visual content extraction and scene understanding is an enabling technology for video surveillance, situational awareness, and force protection applications. High-level scene comprehension requires a deep understanding of objects, scene elements and their inter-relations. Current systems lack a general visual knowledge framework and efficient computational algorithms for detecting large number of object categories. We propose to develop video inference algorithms and a modular architecture for scene understanding based on the computational framework of And-Or graph. Various image inference modules can be easily integrated to the framework through an API for scene understanding. The architecture should also support the input of user-provided context to improve inference. Leveraging earlier work on semantic annotation, we will develop algorithms to infer complex relationships between scene entities. Plain text reports of the scene will be automatically generated to describe these relationships, contextual information, as well as events of interest. To achieve high compression rate for bandwidth-constraint applications, the text description are used to synthesize image and video to provide a representative rendering of the scene and events. In addition, we propose a method for indexing hierarchical data as well as a scalable framework for searching large imagery dataset.

Principal Investigator:

Mun Wai Lee
Principal Investigator

Business Contact:

Paul C. Brewer
VP, New Technology
Small Business Information at Submission:

11600 Sunrise Valley Drive Suite # 290 Reston, VA 20191

EIN/Tax ID: 541969286
Number of Employees:
Woman-Owned: No
Minority-Owned: No
HUBZone-Owned: No