USA flag logo/image

An Official Website of the United States Government

Extracting Valid Inferences from Data, Evidence, and Novel Tests (EVIDENT)

Award Information

Agency:
Department of Defense
Branch:
Air Force
Award ID:
Program Year/Program:
2013 / STTR
Agency Tracking Number:
F12B-T01-0057
Solicitation Year:
2012
Solicitation Topic Code:
AF12-BT01
Solicitation Number:
2012.B
Small Business Information
Charles River Analytics Inc.
625 Mount Auburn Street Cambridge, MA 02138-
View profile »
Woman-Owned: No
Minority-Owned: No
HUBZone-Owned: No
 
Phase 1
Fiscal Year: 2013
Title: Extracting Valid Inferences from Data, Evidence, and Novel Tests (EVIDENT)
Agency / Branch: DOD / USAF
Contract: FA9550-13-C-0028
Award Amount: $149,949.00
 

Abstract:

ABSTRACT: A recent study by the National Research Council found that sophisticated statistical techniques are finding their way into DoD operational test design, but that current DoD practices are still substantially behind the state of the art. The study concluded this has resulted in inefficient test designs, wasted resources, and less effective acquisition decision making. US Air Force test and evaluation (T & E) organizations need a toolkit that gives analysts access to sophisticated statistical techniques. To help T & E analysts design more efficient tests and draw statistically defensible inferences from test data that cannot be analyzed using basic statistical techniques, we propose to design a toolkit for Extracting Valid Inferences from Data, Evidence, and Novel Tests (EVIDENT). EVIDENT will help Air Force T & E personnel: (1) assess the feasibility and technical risk of comparing test data sets; (2) compare test results that are known to reflect bias; (3) analyze the results of tests conducted over time or in a sequence; and (4) design tests when it is impractical to randomly select test subjects or generate large samples to support the usual confidence levels. BENEFIT: We will pursue a two-part plan that transitions the technologies in the EVIDENT toolkit to Government and military customers, and that extends our existing AgentWorks commercial product to increase its appeal to a number of new markets and customers. The technology in the EVIDENT toolkit will be of value to any analyst who must design efficient tests or draw statistically defensible conclusions from data that cannot be analyzed using basic statistical techniques. Therefore, we expect the full-scope EVIDENT toolkit to offer immediate and tangible benefits for any DoD organization involved in T & E planning or analyzing test data. Our main approach to commercializing the technologies developed under this program is to incorporate them into our AgentWorks product, which will increase its appeal as a commercial product and enable us to use the tool to provide consulting services based on AgentWorks to customers in DoD, other Federal agencies, and commercial markets.

Principal Investigator:

Wayne Thornton
Senior Scientist
(617) 491-3474
wthornton@cra.com

Business Contact:

Mark S. Felix
Contracts Manager
(617) 491-3474
mfelix@cra.com
Small Business Information at Submission:

Charles River Analytics Inc.
625 Mount Auburn Street Cambridge, MA -

EIN/Tax ID: 042803764
DUNS: N/A
Number of Employees:
Woman-Owned: No
Minority-Owned: No
HUBZone-Owned: No
Research Institution Information:
Harvard University
1737 Cambridge Street
CGIS Knafel Building, Room 350
Cambridge, MA 02138-
Contact: Gary King
Contact Phone: (617) 500-7570