USA flag logo/image

An Official Website of the United States Government

DEC-POMDP Stochastic Game Approach for Uncertain MultiAgent Systems

Award Information

Agency:
Department of Defense
Branch:
Army
Award ID:
73585
Program Year/Program:
2005 / SBIR
Agency Tracking Number:
A043-096-1833
Solicitation Year:
N/A
Solicitation Topic Code:
N/A
Solicitation Number:
N/A
Small Business Information
Intelligent Automation, Inc.
15400 Calhoun Drive Suite 400 Rockville, MD 20855-2737
View profile »
Woman-Owned: Yes
Minority-Owned: No
HUBZone-Owned: No
 
Phase 1
Fiscal Year: 2005
Title: DEC-POMDP Stochastic Game Approach for Uncertain MultiAgent Systems
Agency / Branch: DOD / ARMY
Contract: W15P7T-05-C-W003
Award Amount: $120,000.00
 

Abstract:

The key innovation builds on the decentralized partially observable markov decision processes theory to model unmanned vehicles (UVs) that engage in stochastic game formulations for collaborative teaming and computing joint optimal policies. Prior models consider purely collaborative agents which have identical payoff functions contrary to the human-centric models. We incorporate agent self-interestedness in the payoff functions and maximize expected team reward. Learning components are incorporated in the agents to reduce the search space for optimal actions given a history of world observations. It is our intuition that such a framework would provide computationally tractable performance even though DEC-POMDP are shown to be NEXP-complete with no communication. The framework would have host of generic algorithms that can be easily adapted as per the scenario definition like target tracking, formation flying, planning etc. The proposed approach can be implemented on CybeleTM agent DSSI (Decision support system infrastructure) capability built by IAI to model agent beliefs, actions and rewards with hooks for the environment simulation. Cybele infrastructure has been tested on CDC environment (e.g., wireless PDAs), which allows users to develop agent applications and algorithms, simulate the algorithms and directly deploy the software on wireless networked environment, enabling hardware in the loop simulations.

Principal Investigator:

Goutam Satapathy
Sr. Research Scintst & Mgr Prod Dev
3012945249
goutam@i-a-i.com

Business Contact:

Mark James
Contract Manager
3012945221
mjames@i-a-i.com
Small Business Information at Submission:

INTELLIGENT AUTOMATION, INC.
15400 Calhoun Drive, Suite 400 Rockville, MD 20855

EIN/Tax ID: 521497192
DUNS: N/A
Number of Employees:
Woman-Owned: No
Minority-Owned: No
HUBZone-Owned: No