A Robotic Avatar Interactive Console Enhancing AVESS User Interface Capacity

The current AVESS has targeted to creating fundamental virtual world using tools of Second Life and its user interface is limited to 2D input devices. A wide spectrum of interaction will be needed to enhance this AVESS system to further improve the user"s virtual presence with non-verbal interface such as haptic, visual, kinematic and emotional interaction. Hstar proposes a robotic avatar interactive console (RAIC) system for enhancing AVESS user interface capacity. The proposed RAIC will be archived by integrating robotic haptic interaction devices, visual capture and 3D head-mount display in virtual environment, and kinematic motion and posture capture via wearable sensing devices. This system will: 1) provides 3D amputee-avatar haptic interface, 2) supports 3D immersive visual capture and display in AVESS environment, 3) provides remote patient monitoring and physical accessibility to therapist, 4) provides a remote platform for necessary at-home therapy procedures, and 5) supports kinematic capture of patient motion and body postures and representing on avatar model. Our primary innovation is a 3D robotic avatar interactive interface console for the AVESS that provides safe haptic, visual, and therapeutic interaction via the creative virtual world for the combat injured amputee patients.