You are here

TeleSculptor Multiplex: Fusing Multiple FMV Feeds in 3D

Award Information
Agency: Department of Defense
Branch: Special Operations Command
Contract: H9240520P0008
Agency Tracking Number: S201-003-0007
Amount: $149,998.26
Phase: Phase I
Program: SBIR
Solicitation Topic Code: SOCOM20.1-003
Solicitation Number: 20.1
Solicitation Year: 2020
Award Year: 2020
Award Start Date (Proposal Award Date): 2020-04-29
Award End Date (Contract End Date): 2020-10-29
Small Business Information
1712 Route 9 Suite 300
Clifton Park, NY 12065-3104
United States
DUNS: 010926207
HUBZone Owned: No
Woman Owned: No
Socially and Economically Disadvantaged: No
Principal Investigator
 Matthew Leotta
 (518) 836-2998
Business Contact
 Charles Weatherford
Phone: (518) 881-4925
Research Institution

Multiple concurrent FMV feeds can provide useful context during special forces missions but the flood of data from disconnected viewpoints can dramatically increase cognitive load on SOF operators. Substantial network bandwidth is also consumed by streaming multiple concurrent video feeds with highly redundant content. Kitware proposes TeleSculptor Multiplex, an approach to combine multiple FMV feeds into a coherent 3D video for web-based display using OGC standards. Our approach builds on our prior work in 3D shape estimation from FMV. We will recover 3D shape from the multiple FMV feeds at multiple scales, align this data, and build a unified scene model. We will extract static texture and dynamic texture (e.g. movers) into separate layers that we will update at different rates for more efficient storage and transmission. We will stream this 3D video display to 3D geospatial contexts on mobile and web clients (e.g. ATAK and Cesium) using existing standards such as CDB and 3D Tiles. All our work is provided with unlimited rights to the government and will be made open source, if allowed, to maximize adoption of the technology.

* Information listed above is at the time of submission. *

US Flag An Official Website of the United States Government