Human-Robot Instruction for Perceptual Teamwork

Award Information
Agency: Department of Defense
Branch: Defense Advanced Research Projects Agency
Contract: W31P4Q-09-C-0265
Agency Tracking Number: 08SB2-0598
Amount: $98,856.00
Phase: Phase I
Program: SBIR
Awards Year: 2009
Solicitation Year: 2008
Solicitation Topic Code: SB082-031
Solicitation Number: 2008.2
Small Business Information
28 Corporate Drive, Clifton Park, NY, 12065
HUBZone Owned: N
Woman Owned: N
Socially and Economically Disadvantaged: N
Principal Investigator
 Anthony Hoogs
 Director of Computer Vision
 (518) 371-3971
Business Contact
 Anthony Hoogs
Title: Director of Computer Vision
Phone: (518) 371-3971
Research Institution
The utility of mobile robots would be greatly enhanced if they could be taught how to be competent, helpful members of military teams in the field. We propose a method for human instruction of robots, where the instructor teaches the robot how to recognize common situations and activities surrounding it, and how it should behave as part of those activities. Our approach is based on combining probabilistic models of group activities, prior domain and general knowledge, and human instruction. The instructor can guide the robot learning process by providing initial activity specifications, and corrections of the robot’s interpretation of its environment through noisy observations (tracks of nearby objects). In Phase 1, we will develop initial methods for activity model specification and learning with human instruction. We will use the system to investigate the tradeoff between prior knowledge, video training examples and human instruction. Greater levels of instruction can compensate for less training data, but would require more effort from the instructor.

* Information listed above is at the time of submission. *

Agency Micro-sites

SBA logo
Department of Agriculture logo
Department of Commerce logo
Department of Defense logo
Department of Education logo
Department of Energy logo
Department of Health and Human Services logo
Department of Homeland Security logo
Department of Transportation logo
Environmental Protection Agency logo
National Aeronautics and Space Administration logo
National Science Foundation logo
US Flag An Official Website of the United States Government