USA flag logo/image

An Official Website of the United States Government

AS THE DOD IS MOVING TOWARDS THE LARGE-SCALE USE OF ARTIFICIAL INTELLIGENCE…

Award Information

Agency:
Department of Defense
Branch:
Defense Advanced Research Projects Agency
Award ID:
3597
Program Year/Program:
1986 / SBIR
Agency Tracking Number:
3597
Solicitation Year:
N/A
Solicitation Topic Code:
N/A
Solicitation Number:
N/A
Small Business Information
Advanced Decision Systems
1500 Plymouth St Mountain View, CA 94043
View profile »
Woman-Owned: No
Minority-Owned: No
HUBZone-Owned: No
 
Phase 1
Fiscal Year: 1986
Title: AS THE DOD IS MOVING TOWARDS THE LARGE-SCALE USE OF ARTIFICIAL INTELLIGENCE SYSTEMS FOR SUPPORTING DECISION-MAKING AND INFORMATION ANALYSIS, IT BECOMES INCREASINGLY IMPORTANT THAT WE DEVELOP MECHANISMS FOR ASSESSING THE PERFORMANCE OF THESE SYSTEMS.
Agency / Branch: DOD / DARPA
Contract: N/A
Award Amount: $49,992.00
 

Abstract:

AS THE DOD IS MOVING TOWARDS THE LARGE-SCALE USE OF ARTIFICIAL INTELLIGENCE SYSTEMS FOR SUPPORTING DECISION-MAKING AND INFORMATION ANALYSIS, IT BECOMES INCREASINGLY IMPORTANT THAT WE DEVELOP MECHANISMS FOR ASSESSING THE PERFORMANCE OF THESE SYSTEMS. WE BELIEVE THAT ASKING "HOW INTELLIGENT IS THE SYSTEM?" IS NOT THE CORRECT PERFORMANCE QUESTION AND THAT MORE APPROPRIATE ARE "DOES THE SYSTEM HELP THE USER?" "IN WHAT WAY?" AND "HOW CAN THIS BE MEASURED?" OUR APPROACH IS BASED ON THE PREMISE THAT THE USERS, DEVELOPERS, MANAGERS AND FUNDERS OF THESE SYSTEMS HAVE "EXPERT" KNOWLEDGE ABOUT PERFORMANCE AND EVALUATION THAT NEEDS TO BE CAPTURED IF A COMPREHENSIVE EVALUATION IS TO BE PERFORMED. THE METHODOLOGY WE PROPOSE STRUCTURES THIS KNOWLEDGE BY USING A HIERARCHY OF EVALUATION CONTEXTS, USES A RULE-BASED LANGUAGE FOR EXPRESSING THE KNOWLEDGE, AND EMPLOYS THE MATHEMATICS OF FUZZY SET THEORY TO MODEL THE INHERENT VAGUENESS IN THE KNOWLEDGE. THE PROPOSAL CONTAINS AN OVERVIEW OF OUR EVALUATION METHODOLOGY AND ILLUSTRATES IT WITH A SIMPLE EXAMPLE. WE ALSO DISCUSS THE NEED TO DESIGN A SET OF TOOLS TO HELP OPERATIONALIZE THE METHODOLOGY, AND CONSIDER SOME PILOT EXPERIMENTS THAT SHOULD BE PERFORMED TO VALIDATE THE IDEAS.

Principal Investigator:

Dr r m tong
4159413912

Business Contact:

Small Business Information at Submission:

Advanced Decision Systems
201 San Antonio Circle - Ste 2 Mountain View, CA 94040

EIN/Tax ID:
DUNS: N/A
Number of Employees:
Woman-Owned: No
Minority-Owned: No
HUBZone-Owned: No