You are here

Video Data to DDMS Cards


TECHNOLOGY AREAS: Information Systems

OBJECTIVE:  Design and system that can automatically generate a stream of metadata cards consistent with the DoD Discovery Metadata Specification (DDMS).  Currently the dissemination of video data requires that a human isolates and annotates specific frames.  Metadata cards that are exposed to DoD ISR enterprise contain little more that the coordinates of the area that was imaged and the time markers for the first and last frame.  Semantic searches on large video holdings cannot currently be done.  This topic seeks to support technology maturation as needed to enable real time and forensic semantic searches on video data. 

DESCRIPTION: In combating terrorism the need exists to better exploit video data in real time for force protection and mission execution.  In recent years, major advancements in video analytics have enabled object and selected rule based behavior recognition, but connecting the expressions used in describing these detections semantically to priority and specific intelligence requirements has lagged.  The specific challenges of this topic include: 

1) Authoring a mapping of typical tactical warfightr priority and specific intelligence requirements to the possible output of video analytic engines 2) Development DDMS compliant real time video analytic engines 3)  Expansion of the DDMS specification as needed to better capture the semantics of video understanding and mission intelligence requirements 4)  Focusing and expansion of video analytic capabilities to be more responsive to priority and specific tactical intelligence requirements 5) Development of a user GUI that allows the warfighter to input priority and specific information requirements and map those questions into standing DDMS compliant metadata card searches 6) development of the overall system architecture that enables the workflow described above 7) development of visualization technology that allows the warfighter to quickly understand the significance of returned data to his/her set of information requirements. 

Research in the areas of mathematics, statistics, computational data analysis and visualization, computational sciences and computer science are of interest.  In addition to the application of research methods and approaches, it is important to evaluate the impact of these efforts areas with regards to the way they change how data is collected, analyzed and assessed to meet a prescribed time for operational necessity and efficiency.  It is of value to use open standards to reduce costs. 

The OSD is interested in innovative R&D that involves technical risk.  Proposed work should have technical and scientific merit.  Creative solutions are encouraged. 

PHASE I: Complete a plan and detailed approach for populating an architecture that enables video processors to automatically publish metadata cards that are compliant to the DDMS specification and responsive to tactical priority and specific intelligence requirements.  Identify the critical technology issues that must be overcome to achieve success.  Technical work should focus on the reduction of key risk areas.  For a constrained set of warfighter priority and specific intelligence requirements and a constrained set of entities and behaviors of interest, demonstrate that phase 1 risk reduction work has shown that a full implementation of the approach is technically tractable.    Prepare a revised research plan for Phase 2 that addresses critical issues. 

PHASE II: Produce a prototype system that is capable of translating full motion video into a set of DDMS compliant semantic meta data cards that can be automatically connected to subscribed to priority and specific intelligence requirements.  The prototype system should run at the sensor and fully connect to the DoD ISR enterprise and command and control programs of record.  Produce a prototype distributed processing service that can automatically deliver the right video clip to the right warfighter by simultaneously tagging video and understanding information subscriptions.  The prototype should enable a demonstration of the capability to be conducted using relevant data sources, some of which may be classified.  The prototype should be capable of operating in a real time mode.  The prototype should be relevant to both DoD and commercial use cases. 

PHASE III: Produce a system capable of deployment in an operational setting.  The work should focus on a specific user environment intended for product transition.  Test the system in an operational setting in a stand-alone mode or as a component of shared processing environment.  The work should work towards a transition to program of record, military organization or commercial product.  The system should adhere to open standards and use registered COI vocabulary and ontologies where feasible.

US Flag An Official Website of the United States Government