Vision with a Purpose: Inferring the Function of Objects in Video

Award Information
Agency:
Department of Defense
Branch
Defense Advanced Research Projects Agency
Amount:
$98,527.00
Award Year:
2009
Program:
SBIR
Phase:
Phase I
Contract:
W31P4Q-09-C-0256
Agency Tracking Number:
08SB2-0398
Solicitation Year:
n/a
Solicitation Topic Code:
n/a
Solicitation Number:
n/a
Small Business Information
KITWARE
28 Corporate Drive, Clifton Park, NY, 12065
Hubzone Owned:
N
Minority Owned:
N
Woman Owned:
N
Duns:
n/a
Principal Investigator:
Anthony Hoogs
Director of Computer Vision
(518) 371-3971
anthony.hoogs@kitware.com
Business Contact:
Anthony Hoogs
Director of Computer Vision
(518) 371-3971
anthony.hoogs@kitware.com
Research Institution:
n/a
Abstract
Video provides the opportunity to classify vehicles, people, buildings and other structures by their behavior and the activity surrounding them. Object classes that are visually indistinguishable can be differentiated using activity, even in low-resolution video where traditional recognition from static imagery is not viable. Conversely, objects within the same class that have the same behavior but different appearance can be recognized. Our approach is based on learning probabilistic models of object function using a canonical set of low-level relations and actions computed from object tracks and scene context. We will combine traditional generative model learning, which learns models in isolation from each other, with discriminative learning that identifies how the classes are different from each other. Our recognition method will handle situations where objects are tracked for intervals shorter than their characteristic behavior duration, and longer too. In Phase 1, we will develop initial functional recognition methods for moving objects such as people and vehicles. A set of promising functional types will be identified, and we will use them to study the effects of tracking accuracy and levels of scene context on functional recognition accuracy.

* information listed above is at the time of submission.

Agency Micro-sites


SBA logo

Department of Agriculture logo

Department of Commerce logo

Department of Defense logo

Department of Education logo

Department of Energy logo

Department of Health and Human Services logo

Department of Homeland Security logo

Department of Transportation logo

Enviromental Protection Agency logo

National Aeronautics and Space Administration logo

National Science Foundation logo
US Flag An Official Website of the United States Government