DEC-POMDP Stochastic Game Approach for Uncertain MultiAgent Systems

Award Information
Agency: Department of Defense
Branch: Army
Contract: W15P7T-05-C-W003
Agency Tracking Number: A043-096-1833
Amount: $120,000.00
Phase: Phase I
Program: SBIR
Awards Year: 2005
Solicitation Year: 2004
Solicitation Topic Code: A04-096
Solicitation Number: 2004.3
Small Business Information
15400 Calhoun Drive, Suite 400, Rockville, MD, 20855
DUNS: 161911532
HUBZone Owned: N
Woman Owned: Y
Socially and Economically Disadvantaged: N
Principal Investigator
 Goutam Satapathy
 Sr. Research Scintst & Mgr Prod Dev
 (301) 294-5249
Business Contact
 Mark James
Title: Contract Manager
Phone: (301) 294-5221
Research Institution
The key innovation builds on the decentralized partially observable markov decision processes theory to model unmanned vehicles (UVs) that engage in stochastic game formulations for collaborative teaming and computing joint optimal policies. Prior models consider purely collaborative agents which have identical payoff functions contrary to the human-centric models. We incorporate agent self-interestedness in the payoff functions and maximize expected team reward. Learning components are incorporated in the agents to reduce the search space for optimal actions given a history of world observations. It is our intuition that such a framework would provide computationally tractable performance even though DEC-POMDP are shown to be NEXP-complete with no communication. The framework would have host of generic algorithms that can be easily adapted as per the scenario definition like target tracking, formation flying, planning etc. The proposed approach can be implemented on CybeleTM agent DSSI (Decision support system infrastructure) capability built by IAI to model agent beliefs, actions and rewards with hooks for the environment simulation. Cybele infrastructure has been tested on CDC environment (e.g., wireless PDAs), which allows users to develop agent applications and algorithms, simulate the algorithms and directly deploy the software on wireless networked environment, enabling hardware in the loop simulations.

* Information listed above is at the time of submission. *

Agency Micro-sites

SBA logo
Department of Agriculture logo
Department of Commerce logo
Department of Defense logo
Department of Education logo
Department of Energy logo
Department of Health and Human Services logo
Department of Homeland Security logo
Department of Transportation logo
Environmental Protection Agency logo
National Aeronautics and Space Administration logo
National Science Foundation logo
US Flag An Official Website of the United States Government