Description:
OUSD (R&E) CRITICAL TECHNOLOGY AREA(S): Trusted AI and Autonomy
The technology within this topic is restricted under the International Traffic in Arms Regulation (ITAR), 22 CFR Parts 120-130, which controls the export and import of defense-related material and services, including export of sensitive technical data, or the Export Administration Regulation (EAR), 15 CFR Parts 730-774, which controls dual use items. Offerors must disclose any proposed use of foreign nationals (FNs), their country(ies) of origin, the type of visa or work permit possessed, and the statement of work (SOW) tasks intended for accomplishment by the FN(s) in accordance with the Announcement. Offerors are advised foreign nationals proposed to perform on this topic may be restricted due to the technical data under US Export Control Laws.
OBJECTIVE: Develop a robust, fully functional application from airborne electro-optics/infrared (EO/IR) imagery capable of automatically classifying combatant from non-combatant ships. The application should also be capable of target identification at a reduced range and passively compute range to target and Angle Off Bow (AOB) directly from the imagery.
DESCRIPTION: In recent years there have been a widespread embrace of a variety of deep learning techniques for automatic target recognition of ships using airborne EO/IR or radar systems. Generally, the approaches have failed to deliver robust and affordable solutions. Ship recognition requires significant examples to train the classifiers, but obtaining suitable training data is very time consuming, expensive, and impossible in many instances. These systems tend to work impressively when applied to the exact conditions to which they were trained. When faced with other conditions, even those only slightly different from those in the training data, they can react in unexpected ways. The introduction of techniques such as generative adversarial networks do begin to address this deficiency but not sufficiently in practice. A much more robust approach is a hybrid, knowledge-driven one combining an expert system utilizing template-based screeners with deep learning applied in a limited manner to elements of the classification stream where they can effectively and robustly contribute [Ref 1]. Template-based expert system classifiers have been successfully developed previously for inverse synthetic aperture radar images [Ref 2].
From a classification/identification perspective the application must provide a high probability of correct classification (> 90% threshold and > 95% objective) and identification (> 95% threshold and > 98% objective) for combatants of the world. For ships correctly classified, estimated range should be within 3% and AOB with 2°. It is estimated that the three-dimensional template database will need to represent 1,000 to 2,000 vessels. Efficient and accurate rendering of the template database is a critical element to make this approach feasible.
Investigations should consider the performance of the application as a function of pixel counts on target and image quality (i.e., target/background contrast, sensor system modulation transfer function [MTF], and noise). Overall computational resources need to be estimated for a multiple layer screening process. The merging of this expert system with deep learning techniques should be considered and pursued if justified.
Work produced in Phase II may become classified. Note: The prospective contractor(s) must be U.S. owned and operated with no foreign influence as defined by DoD 5220.22-M, National Industrial Security Program Operating Manual, unless acceptable mitigating procedures can and have been implemented and approved by the Defense Counterintelligence and Security Agency (DCSA) formerly Defense Security Service (DSS). The selected contractor must be able to acquire and maintain a secret level facility and Personnel Security Clearances. This will allow contractor personnel to perform on advanced phases of this project as set forth by DCSA and NAVAIR in order to gain access to classified information pertaining to the national defense of the United States and its allies; this will be an inherent requirement. The selected company will be required to safeguard classified material IAW DoD 5220.22-M during the advanced phases of this contract.
PHASE I: Research, evaluate, and develop the overall classifier architecture. Utilizing open-source data set, develop a prototype classifier to be tested on a representative set of combatant vessels. Assess the merits of a hybrid classification approach. The Phase I effort will include prototype plans to be developed under Phase II.
PHASE II: Develop an implementation of the complete classification approach including automated techniques for template preparation. Implementation should also consider system weight and power (SWAP) since the processor will be integrated into an air vehicle. Using data sets provided by the Navy, conduct a comprehensive evaluation of classification, range, and AOB estimation performance.
Work in Phase II may become classified. Please see note in the Description paragraph.
PHASE III DUAL USE APPLICATIONS: Transition the developed technology to candidate platforms/sensors. Potential transition platforms include the MQ-8C Fire Scout, MQ-4C Triton, MQ-25A Stingray, P-8A Poseidon, and Future Vertical Lift. Potential commercial applications include land-based and airborne port surveillance.
REFERENCES:
1. Marcus, G. (2020, February 17). The next decade in AI: Four steps toward robust artificial intelligence. Arxiv. https://arxiv.org/vc/arxiv/papers/2002/2002.06177v2.pdf
2. Telephonics. (n.d.). Marine classification aid (MCA). Telephonics. Retrieved March 7,2022, from https://www.telephonics.com/uploads/standard/46045-TC-Maritime-Classification-Aid-Brochure.pdf
KEYWORDS: electro-optics/infrared; automatic target recognition; vessel classification; maritime surveillance; remote sensing; template matching
