Predictive Displays and Latency Protections for High Latency Teleoperation

Award Information
Agency: Department of Defense
Branch: Army
Contract: W56HZV-10-C-0222
Agency Tracking Number: A093-188-0476
Amount: $69,872.00
Phase: Phase I
Program: SBIR
Awards Year: 2010
Solicitation Year: 2009
Solicitation Topic Code: A09-188
Solicitation Number: 2009.3
Small Business Information
P.O. Box 346, Calumet, MI, 49913
DUNS: 803724301
HUBZone Owned: N
Woman Owned: N
Socially and Economically Disadvantaged: N
Principal Investigator
 Gary Witus
 Vice President of R&D
 (734) 665-4818
Business Contact
 Tracy Maki
Title: Business Manager
Phone: (906) 337-3360
Research Institution
We will develop and demonstrate robust and reliable methods for high-latency teleoperation with Predictive Display (PD), Latency Protection (LP) and Supervisory Control (SC). PD conveys the effects of latent commands not yet reflected in the display. Augmented Reality PD (ARPD) overlays an icon indicating the predicted position and orientation using nominal terrain and motion models. Virtual Reality PD (VRPD) warps the image to the predicted perspective using a “2½ D” model constructed via video feature tracking. LP limits translation and rotation rates, and shapes acceleration response, as functions of observed latency and operator behavior. In extreme situations, LP brakes to prevent operator overreaction. LP is inspired by AntiLock Braking: it has no observable effect within safety margins. Phase I will implement ARPD and LP on a Packbot, and begin VRPD. The Option will test Visual Servoing SC (VSSC) and open-loop Displacement Command SC (DCSC) for high-latency teleoperation, and implement VRPD. VSSC developed under a prior separate effort. ARPD, LP and DCSC are software-only solutions that can be implemented on existing UGVs without additional hardware. We will conduct developmental testing to optimize and compare the methods based on task performance, stress-related biosignals and subjective workload assessment.

* Information listed above is at the time of submission. *

Agency Micro-sites

SBA logo
Department of Agriculture logo
Department of Commerce logo
Department of Defense logo
Department of Education logo
Department of Energy logo
Department of Health and Human Services logo
Department of Homeland Security logo
Department of Transportation logo
Environmental Protection Agency logo
National Aeronautics and Space Administration logo
National Science Foundation logo
US Flag An Official Website of the United States Government