Trainable 3-D Audio Rendering for Enhanced Immersion in Virtual Training

The quality of the training experience provided by virtual reality (VR) systems is directly related to the degree to which the range of human sensory modalities is stimulated. Audio cues are an essential for immersion in virtual environments, and also vital for situation awareness for soldiers. Therefore, realistic auditory cues should be part of a virtual training system. Our company IC Tech has been engaged in developing biologically inspired technologies and solutions for audio and speech processing since 1997. We are proposing, to combine our audio signal processing technology and know-how with the expertise of our collaborators to develop dependable 3-D audio rendering for soldiers. Our goal is realism to preserve both the spatial and temporal qualities of the `real' cues and to create, to the extent possible, a state of mind consistent with the real experience. Our Phase I investigation will involve selecting the best sound delivery front end, as well as the optimum algorithms for creating 3-D auditory cues. Then, we will study the calibration needed to accommodate individual variations and follow that by the integration of position sensors for an interactive experience and synchronization with visual scenes. Finally, we will formulate a training efficacy assessment plan to establish that the lessons learned in the virtual environment transfer to the real one.