Super 3D from Video

Award Information
Agency:
Department of Defense
Branch
Defense Advanced Research Projects Agency
Amount:
$749,930.00
Award Year:
2010
Program:
SBIR
Phase:
Phase II
Contract:
W31P4Q-11-C-0086
Agency Tracking Number:
08SB2-0531
Solicitation Year:
2008
Solicitation Topic Code:
SB082-028
Solicitation Number:
2008.2
Small Business Information
Kitware
28 Corporate Drive, Clifton Park, NY, 12065
Hubzone Owned:
N
Socially and Economically Disadvantaged:
N
Woman Owned:
N
Duns:
n/a
Principal Investigator:
Amitha Perera
Research Scientist
(518) 881-4940
amitha.perera@kitware.com
Business Contact:
Yvette Fitzgerald
Contracts Administrator
(518) 371-3971
y.fitzgerald@kitware.com
Research Institution:
n/a
Abstract
We propose to develop a novel approach to extracting 3D structure from wide-area video with sub-pixel accuracy. Multiple redundant video frames from very similar viewpoints enable super-resolution, while multiple frames from separated viewpoints enable 3D structure estimation. In our approach we will combine elements of the two processes through a variant of space carving, while avoiding the challenge of sub-pixel registration required for super-resolution. Our approach is based on voxel removal, where 3D volumetric elements are removed or “carved” out of an initial cube when their appearance is not consistent with multiple images. We will enhance space carving with edge-based analysis. Edges provide sub-pixel localization in each image, and by combining highly localized edges on occluding contours from different viewpoints we can achieve sub-pixel localization in 3D. Our approach can model and leverage the characteristics of the sensor, such as rolling shutters.

* information listed above is at the time of submission.

Agency Micro-sites

US Flag An Official Website of the United States Government