Reinforcement Learning for Avionics Applications

Award Information
Agency: Department of Defense
Branch: Air Force
Contract: N/A
Agency Tracking Number: 36220
Amount: $97,943.00
Phase: Phase I
Program: SBIR
Awards Year: 1997
Solicitation Year: N/A
Solicitation Topic Code: N/A
Solicitation Number: N/A
Small Business Information
3046A Berkmar Drive, Charlottesville, VA, 22901
HUBZone Owned: N
Woman Owned: N
Socially and Economically Disadvantaged: N
Principal Investigator
 David G. Ward/jeffrey F.
 (804) 973-1215
Business Contact
Phone: () -
Research Institution
Simulation-based optimization techniques that enlist reinforcement learning controllers are ideally suited for complex and multi-objective optimization problems that cannot be solved easily using traditional techniques, especially when the stochastic natures or the environment, resources, and external interactive entities are taken into account. Reinforcement learning based on incremental value iteration may be unstable when sequential system updates are close together and when general compact function approximators are required. Residual methods can preclude these problems. The proposed work will investigate and refine residual reinforcement learning techniques suitable for high-dimensional systems with many complex subsystem interactions and characterized by an aggregation of continuous, discrete, logical-element and binary states. The work shall demonstrate, via simulation, residual reinforcement learning solutions for providing optimal detection, classification, and prioritization of multiple targets through uninhabited air vehicle (UAV) intelligent sensor allocation strategies and flight path optimizations. In addition to immediate benefits for the U.S. Air Force and its UAV research, the proposed work will result in reinforcement learning methods that are directly applicable to numerous military and commercial-sector systems, including navigation and trajectory optimization, commercial air-traffic control, and general simulation-based optimization techniques for complex systems.

* Information listed above is at the time of submission. *

Agency Micro-sites

SBA logo
Department of Agriculture logo
Department of Commerce logo
Department of Defense logo
Department of Education logo
Department of Energy logo
Department of Health and Human Services logo
Department of Homeland Security logo
Department of Transportation logo
Environmental Protection Agency logo
National Aeronautics and Space Administration logo
National Science Foundation logo
US Flag An Official Website of the United States Government