You are here

PARTEL: Periscope video Analysis using Reinforcement and TransfEr Learning

Award Information
Agency: Department of Defense
Branch: Navy
Contract: N68335-20-C-0789
Agency Tracking Number: N20A-T007-0203
Amount: $239,031.00
Phase: Phase I
Program: STTR
Solicitation Topic Code: N20A-T007
Solicitation Number: A
Solicitation Year: 2020
Award Year: 2020
Award Start Date (Proposal Award Date): 2020-08-08
Award End Date (Contract End Date): 2021-12-15
Small Business Information
5266 Hollister Avenue, Suite 229
Santa Barbara, CA 93111-1111
United States
DUNS: 097607852
HUBZone Owned: No
Woman Owned: No
Socially and Economically Disadvantaged: No
Principal Investigator
 Lakshmanan Nataraj
 (805) 967-9828
Business Contact
 Bangalore S. Manjunath
Phone: (805) 448-8227
Research Institution
 University of Central Florida
 Sarah Carter
4000 Central Florida Blvd
Orlando, FL 32816
United States

 (407) 823-1935
 Domestic Nonprofit Research Organization

We propose a suite of video processing algorithms utilizing the machine learning (ML) techniques of artificial intelligence (AI) reinforcement learning, deep learning, and transfer learning to process submarine imagery obtained by means of periscope cameras. Machine learning (ML) can help in addressing the challenge of human failure of assessing the data of periscope imagery. Though pre-tuned black-box ML approaches can be used to train periscope imagery, the data available to train a black box is not robustly representative of the range of imagery expected to be encountered across all operating conditions. We address this problem using a combination of reinforcement learning and transfer learning where sufficient training data is not sufficient to support black box deep learning approaches. In prior work, Mayachitra has successfully applied reinforcement learning and reidentification approaches in maritime vessel detection from cameras in ships which will serve as representative imagery similar to periscope imagery data. Mayachitra has also worked on transfer learning where the last layers of pre-trained black box approaches are analyzed and then transferred to new data. In this STTR project, we will combine these approaches and use simultaneous cross platform reinforcement learning and transfer learning to address the problem of video processing on periscope imagery. Key metrics involve latency of vessel detection, time to identify, latency of vessel reacquisition after loss, rate of false positives, and rate of missed identifications. We will address the feasibility through modeling and analysis of the algorithms using representative imagery data, and include the initial design specifications and capabilities description to build a prototype solution in Phase II.

* Information listed above is at the time of submission. *

US Flag An Official Website of the United States Government