Spatial Registration of Multi-Sensor Data Using 3D Reconstruction

Award Information
Agency: Department of Defense
Branch: Army
Contract: W909MY-07-C-0003
Agency Tracking Number: A062-117-3088
Amount: $70,000.00
Phase: Phase I
Program: SBIR
Awards Year: 2006
Solicitation Year: 2006
Solicitation Topic Code: A06-117
Solicitation Number: 2006.2
Small Business Information
6800 Cortona Drive, Goleta, CA, 93117
DUNS: 054672662
HUBZone Owned: N
Woman Owned: N
Socially and Economically Disadvantaged: N
Principal Investigator
 Andrew Brown
 (805) 968-6787
Business Contact
 Marcella Lindbery
Title: Director of Finance and Contracts
Phone: (805) 968-6787
Research Institution
In current and future military applications, multiple sensing technologies are being employed to provide accurate situational awareness, resulting in successful and safely-deployed missions. Many threats, including mines and improvised explosive devices (IEDs), are intelligently hidden from human sight, but can be successfully detected using a combination of ground penetrating radar (GPR) and various IR and visible imaging sensors. Toyon, in collaboration with Prof. Joseph Mundy of Brown University, proposes to design and develop a system capable of autonomously performing multi-image spatial registration across a number of sensor modalities. Our approach will accurately co-register all sensors during a single mission, and if desired, across missions, using un-surveyed incidental 3D control points that occur naturally in the environment and which are automatically detected and tracked by the registration software. Information obtained from detecting and tracking the control points and from estimates of the vehicle’s relative motion between scans will be used to perform high-fidelity joint automatic sensor calibration and 3D reconstruction for each sensor in a common vehicle coordinate frame, thereby registering the data. The data registration will then be optimized jointly across sensor modes by maximizing a mutual information metric, with the goal of achieving sub-pixel registration accuracy. The registered data can be presented to the system user or for further processing in the form of registered 3D image cubes, or 2D images registered in one of the sensor image planes or from a novel viewpoint. In either case, a multi-sensor multi-dimensional registered data set is provided for exploitation, e.g., for mine or IED detection. In Phase I we will demonstrate the feasibility of the proposed technical approach, evaluate the multi-sensor spatial registration accuracy obtained with real-world data collections in complex scenes, document the results, and provide recommendations for further research and development in Phase II and for commercialization of the developed technology.

* Information listed above is at the time of submission. *

Agency Micro-sites

SBA logo
Department of Agriculture logo
Department of Commerce logo
Department of Defense logo
Department of Education logo
Department of Energy logo
Department of Health and Human Services logo
Department of Homeland Security logo
Department of Transportation logo
Environmental Protection Agency logo
National Aeronautics and Space Administration logo
National Science Foundation logo
US Flag An Official Website of the United States Government