Battlespace Target Presentation in the Live Training Environment

Cybernet Proposes to create a pre-production prototype of a live training augmented reality play (LARP) training system. Augmented reality, or the superposition of correctly orientated 3D models into the field of view using a head mounted display, could provide a way of bringing the realistic tactical behaviors seen in video games and military simulations to infantry training. A major hurdle in deploying this technology is the accurate determination of the soldier’s position and head orientation in the environment. To overcome this problem Cybernet proposes the use of a hybrid sensor approach that determines the user’s pose by fusing video data from an HMD mounted camera and a variety of other sensor modalities (MEMS accelerometers and gyroscopes, ground plane homography, GPS, and potentially LIDAR). To enhance the realism of the augmented reality simulation the system will provide a novel user interface that uses, position, voice, gait and stance detection, and gesture recognition, to interact with non-player characters in the simulation. The LARP system will support the rapid creation of AR simulations and provide an after action review capability that can be used to review infantry performance.