USA flag logo/image

An Official Website of the United States Government

Super 3D from Video

Award Information

Department of Defense
Defense Advanced Research Projects Agency
Award ID:
Program Year/Program:
2009 / SBIR
Agency Tracking Number:
Solicitation Year:
Solicitation Topic Code:
Solicitation Number:
Small Business Information
28 Corporate Drive Clifton Park, NY 12065-8688
View profile »
Woman-Owned: No
Minority-Owned: No
HUBZone-Owned: No
Phase 1
Fiscal Year: 2009
Title: Super 3D from Video
Agency / Branch: DOD / DARPA
Contract: W31P4Q-09-C-0183
Award Amount: $98,950.00


We propose to develop a novel approach to extracting 3D structure from wide-area video with sub-pixel accuracy. Multiple redundant video frames from very similar viewpoints enable super-resolution, while multiple frames from separated viewpoints enable 3D structure estimation. In our approach we will combine elements of the two processes through a variant of space carving, while avoiding the challenge of sub-pixel registration required for super-resolution. Our approach is based on voxel removal, where 3D volumetric elements are removed or "carved" out of an initial cube when their appearance is not consistent with multiple images. We will enhance space carving with edge-based analysis. Edges provide sub-pixel localization in each image, and by combining highly localized edges on occluding contours from different viewpoints we can achieve sub-pixel localization in 3D. In Phase 1, we will develop an initial end-to-end algorithm by enhancing our current techniques for space carving to include edge information. We will develop a method for regularization of the surfaces between edges, which are otherwise unconstrained and can drift away from the true geometry. The algorithm will be compared to reconstruction using super-resolved images, and we will examine the performance impact of various sensor effects such as rolling shutters and motion blur.

Principal Investigator:

Amitha Perera
Research Scientist

Business Contact:

Amitha Perera
Research Scientist
Small Business Information at Submission:

28 Corporate Drive Clifton Park, NY 12065

EIN/Tax ID: 141802694
Number of Employees:
Woman-Owned: No
Minority-Owned: No
HUBZone-Owned: No