DEC-POMDP Stochastic Game Approach for Uncertain MultiAgent Systems

Award Information
Agency:
Department of Defense
Branch
Army
Amount:
$120,000.00
Award Year:
2005
Program:
SBIR
Phase:
Phase I
Contract:
W15P7T-05-C-W003
Agency Tracking Number:
A043-096-1833
Solicitation Year:
2004
Solicitation Topic Code:
A04-096
Solicitation Number:
2004.3
Small Business Information
INTELLIGENT AUTOMATION, INC.
15400 Calhoun Drive, Suite 400, Rockville, MD, 20855
Hubzone Owned:
N
Socially and Economically Disadvantaged:
N
Woman Owned:
Y
Duns:
161911532
Principal Investigator:
Goutam Satapathy
Sr. Research Scintst & Mgr Prod Dev
(301) 294-5249
goutam@i-a-i.com
Business Contact:
Mark James
Contract Manager
(301) 294-5221
mjames@i-a-i.com
Research Institution:
n/a
Abstract
The key innovation builds on the decentralized partially observable markov decision processes theory to model unmanned vehicles (UVs) that engage in stochastic game formulations for collaborative teaming and computing joint optimal policies. Prior models consider purely collaborative agents which have identical payoff functions contrary to the human-centric models. We incorporate agent self-interestedness in the payoff functions and maximize expected team reward. Learning components are incorporated in the agents to reduce the search space for optimal actions given a history of world observations. It is our intuition that such a framework would provide computationally tractable performance even though DEC-POMDP are shown to be NEXP-complete with no communication. The framework would have host of generic algorithms that can be easily adapted as per the scenario definition like target tracking, formation flying, planning etc. The proposed approach can be implemented on CybeleTM agent DSSI (Decision support system infrastructure) capability built by IAI to model agent beliefs, actions and rewards with hooks for the environment simulation. Cybele infrastructure has been tested on CDC environment (e.g., wireless PDAs), which allows users to develop agent applications and algorithms, simulate the algorithms and directly deploy the software on wireless networked environment, enabling hardware in the loop simulations.

* information listed above is at the time of submission.

Agency Micro-sites

US Flag An Official Website of the United States Government