Augmented reality and data fusion for CBRN threats

One of the hallmarks of our modern world is the increasing ubiquity of sensors and platforms deployed in complex environments. On the battlefield, there are a wide variety of sensors integrated with platforms ranging from large vehicles, such as the NBCRV, to drones, ground robots, light tactical off road vehicles, and on the Warfighters themselves. Collecting, correlating, analyzing, and communicating the different types of data produced by these sensors, including CBRNE, location/tracking, and situational awareness, is a time consuming and burdensome process for the Warfighter and Commanders, and manually correlating these separate pieces of data is also prone to human error. New situational awareness tools, such as augmented and virtual reality interfaces, provide intuitive ways to visualize critical data for mission planning and operations. Gamma Reality Inc. (GRI) proposes to build an integrated Augmented Reality (AR) visualization capability combined with CBRN sensor data fusion, focusing on radiation and chemical data, that will help solve this problem, enabling Warfighters to make faster and safer decisions on the battlefield. The work will leverage GRI’s commercially available 3D radiation mapping, data fusion, and visualization technologies which already enable the real-time data fusion of situational awareness and radiation data on-the-move and provide different visualization optimizations, including highlighting radioactive sources in augmented reality view via the visual camera feed.