You are here

Scoring, Truth and Registration Toolkit (START)

Award Information
Agency: Department of Defense
Branch: Air Force
Contract: F33615-03-C-1452
Agency Tracking Number: 021SN-0213
Amount: $745,292.00
Phase: Phase II
Program: SBIR
Solicitation Topic Code: N/A
Solicitation Number: N/A
Timeline
Solicitation Year: N/A
Award Year: 2003
Award Start Date (Proposal Award Date): N/A
Award End Date (Contract End Date): N/A
Small Business Information
625 Mount Auburn Street
Cambridge, MA 02138
United States
DUNS: 115243701
HUBZone Owned: No
Woman Owned: No
Socially and Economically Disadvantaged: No
Principal Investigator
 Mark Stevens
 Senior Scientist
 (617) 491-3474
 mstevens@cra.com
Business Contact
 Paul Gonsalves
Title: Vice President
Phone: (617) 491-3474
Email: pgonsalves@cra.com
Research Institution
N/A
Abstract

Evaluation is a crucial part of Automatic Target Recognition (ATR) algorithm development. Without standardized metrics and software implementing those metrics, accurate assessment of an algorithm's performance cannot be made. Comparing different ATRalgorithms on the same dataset is impossible unless the same metrics are computed in exactly the same manner. Our Scoring, Truthing And Registration Toolkit (START) offers a consistent set of post-data collection tools for ATR algorithm performanceevaluation. Our primary design goals are to decrease operator effort when entering registration and truth information, increase accuracy of truth information, and develop standardized scoring metrics for assessing ATR algorithm performance. Using START,all imagery for one scene is registered to a common reference frame (geo-registered if needed) such that target locations, identity, orientation, etc. need only be specified once per scene. This reduces operator error since registration requires less skillthan identifying targets. START then computes a variety of standard scoring metrics suggested by the ATR community (and ATRWG in particular).Our Phase II effort will focus on 3D geo-registration capabilities, automatic placement of registration tie-points, scoring difficult ATR tasks (moving targets, change detection, sensor fusion, multi-look data), sensitivity analysis, and a human factorsanalysis optimizing the usability of START.

* Information listed above is at the time of submission. *

US Flag An Official Website of the United States Government