Speech Interface Architectures for Human Interaction with Computer-Generated Forces

Award Information
Agency:
Department of Defense
Branch
Navy
Amount:
$69,899.00
Award Year:
2002
Program:
STTR
Phase:
Phase I
Contract:
N00014-02-M-0231
Agency Tracking Number:
N023-0136
Solicitation Year:
n/a
Solicitation Topic Code:
n/a
Solicitation Number:
n/a
Small Business Information
Soar Technology, Inc.
3600 Green Court, Suite 600, Ann Arbor, MI, 48105
Hubzone Owned:
N
Socially and Economically Disadvantaged:
N
Woman Owned:
N
Duns:
009485124
Principal Investigator:
Paul Nielsen
Senior Scientist
(734) 327-8000
nielsen@soartech.com
Business Contact:
James Rosbe
President
(734) 327-8000
rosbe@soartech.com
Research Institution:
University of Michigan
Dragomir Radev
School of Information, 3080 West Hall 550 East U.
Ann Arbor, MI, 48109
(734) 615-5225
Nonprofit college or university
Abstract
"Combat superiority requires training superiority. Current training state-of-the-art combines virtual reality, gaming techniques and intelligent forces. A key element missing from this equation is realistic speech interaction, with intelligent agentsrepresenting opposing forces, friendly forces and non-combatants. This effort will combine current research in speech interaction and understanding with proven technology for communicating with intelligent agents, to produce a more realistic trainingenvironment for warfighters.Communication between agents, humans and agents, and intelligent agents and other constructive forces, must be robust and sufficiently natural for human interaction, account for the inherent ambiguity of spoken language, and allow for processing timedelays and multi-person communications with interruptions.To more readily enable interchange of roles between humans and intelligent agents, this research will model mechanisms used in the real world rather than create simulation-specific versions. For example, radio messages are natural language representationsof the same, doctrinally correct, English utterances spoken by Marine and Navy warfighters and commanders.We will survey speech interaction research (both human/human and human-agent), explore relevant issues related to realism for virtual training, evaluate speech interaction networking architectures, and propose a plan for transferring the next generation inspeech research into a key component of effective military training. Expected benefits will be greater realism and believability (for example, via emotion-enhanced speech patterns, inflection and intonation), improved management of multi-person/agent communications (including cross-talk and interruptions, processing timedelays, and multiple language support), better speaker recognition and flexibility in deviating from strictly specified grammar, and intelligent agents that are more adept at communications (knowing how and when to answer, when to repeat themselves orrephrase, gain understanding despite interrupti

* information listed above is at the time of submission.

Agency Micro-sites

US Flag An Official Website of the United States Government