Advanced Equipment Maintenance Using Revolutionary Augmented Reality Technology

The Terrestrial Augmented Reality Maintenance Assistance (TARMA) will leverage Cybernet Systems existing Shipboard Wireless Maintenance System (SWMA), head mounted display systems, and gesture recognition software to create a portable computing platform for augmented-reality based vehicle maintenance. This system will use small, magnet-mounted, light emitting diodes (LEDs) beacons as reference points for the projection of schematics into the viewing region of the head mounted display. In addition to schematics and Interactive Electronic Technical Manuals (IETMs) and condition-based maintenance systems the head mounted display will present data from a suite of peripheral devices including digital multi-meters, bar code scanners, and RFID readers. Cybernet will also apply our gesture recognition system to the system’s forward looking camera to provide a maintainer aptitude evaluation. This aptitude evaluation could potentially be used in level IV and V by IETMs to provide tailored maintenance specifications. Using the SWMA’s existing collaboration suite our system will be able to provide remote support from subject matter experts to in-field maintainers.