Speech Interface Architectures for Human Interaction with Computer-Generated Forces

Award Information
Agency:
Department of Defense
Amount:
$69,899.00
Program:
STTR
Contract:
N00014-02-M-0231
Solitcitation Year:
N/A
Solicitation Number:
N/A
Branch:
Navy
Award Year:
2002
Phase:
Phase I
Agency Tracking Number:
N023-0136
Solicitation Topic Code:
N/A
Small Business Information
Soar Technology, Inc.
3600 Green Court, Suite 600, Ann Arbor, MI, 48105
Hubzone Owned:
N
Woman Owned:
N
Socially and Economically Disadvantaged:
N
Duns:
009485124
Principal Investigator
 Paul Nielsen
 Senior Scientist
 (734) 327-8000
 nielsen@soartech.com
Business Contact
 James Rosbe
Title: President
Phone: (734) 327-8000
Email: rosbe@soartech.com
Research Institution
 University of Michigan
 Dragomir Radev
 School of Information, 3080 West Hall 550 East U.
Ann Arbor, MI, 48109
 (734) 615-5225
 Nonprofit college or university
Abstract
"Combat superiority requires training superiority. Current training state-of-the-art combines virtual reality, gaming techniques and intelligent forces. A key element missing from this equation is realistic speech interaction, with intelligent agentsrepresenting opposing forces, friendly forces and non-combatants. This effort will combine current research in speech interaction and understanding with proven technology for communicating with intelligent agents, to produce a more realistic trainingenvironment for warfighters.Communication between agents, humans and agents, and intelligent agents and other constructive forces, must be robust and sufficiently natural for human interaction, account for the inherent ambiguity of spoken language, and allow for processing timedelays and multi-person communications with interruptions.To more readily enable interchange of roles between humans and intelligent agents, this research will model mechanisms used in the real world rather than create simulation-specific versions. For example, radio messages are natural language representationsof the same, doctrinally correct, English utterances spoken by Marine and Navy warfighters and commanders.We will survey speech interaction research (both human/human and human-agent), explore relevant issues related to realism for virtual training, evaluate speech interaction networking architectures, and propose a plan for transferring the next generation inspeech research into a key component of effective military training. Expected benefits will be greater realism and believability (for example, via emotion-enhanced speech patterns, inflection and intonation), improved management of multi-person/agent communications (including cross-talk and interruptions, processing timedelays, and multiple language support), better speaker recognition and flexibility in deviating from strictly specified grammar, and intelligent agents that are more adept at communications (knowing how and when to answer, when to repeat themselves orrephrase, gain understanding despite interrupti

* information listed above is at the time of submission.

Agency Micro-sites

US Flag An Official Website of the United States Government