An Event-driven Approach to Efficient Summarization, Visualization, and Browsing of Massive Combat Video Database

Award Information
Agency:
Department of Defense
Amount:
$99,000.00
Program:
SBIR
Contract:
W31P4Q-09-C-0229
Solitcitation Year:
2008
Solicitation Number:
2008.2
Branch:
Defense Advanced Research Projects Agency
Award Year:
2009
Phase:
Phase I
Agency Tracking Number:
08SB2-0415
Solicitation Topic Code:
SB082-022
Small Business Information
Signal Processing, Inc.
13619 Valley Oak Circle, Rockville, MD, 20850
Hubzone Owned:
N
Woman Owned:
Y
Socially and Economically Disadvantaged:
Y
Duns:
620282256
Principal Investigator
 Chiman Kwan
 Chief Technology Officer
 (240) 505-2641
 chiman.kwan@signalpro.net
Business Contact
 Chihwa Yung
Title: President
Phone: (301) 315-2322
Email: chihwa.yung@signalpro.net
Research Institution
N/A
Abstract
We propose a systematic solution to the problem of efficient summarization, visualization, and browsing of large combat video archives. Our approach is event-driven: spatio-temporal saliency is used to define significant visual events, which is in turn used in an event-based video model to partition the video into interleaved salient and less significant segments. Each of the two types of segments will then be summarized properly, with the salient segments been kept at higher spatio-temporal resolution while less significant segments being highly condensed. Such an approach naturally leads to a visualization and browsing scheme that can facilitate the consumption of the large amount of video data based on the relative importance of the raw video feeds, thus helping human analysts achieve efficient examination of the video without the drawbacks of conventional techniques that would discard some of the input data by thresholding or filtering. The innovation of the proposed approach include: 1) a unique method to define the significant segments (“events”) of a video based on saliency detection that can deal with low resolution videos; 2) high performance summarization schemes for different portions of the video based on their relative importance; 3) a novel visualization scheme to support event-driven non-linear browsing of the video feeds.

* information listed above is at the time of submission.

Agency Micro-sites

US Flag An Official Website of the United States Government