Framework for Large Streaming Data Analysis

This Small Business Innovation Research Phase I project will design a flexible and scalable system capable of ingesting data from disparate media sources, application of complex workflow and mediation processes, and serving of transcoded media to multiple subscribers. The proposed system will utilize a modular plug-in framework enabling first-party and third-party developers to create custom modules that seamlessly integrate new media formats and workflow algorithms without any changes to the underlying architecture. The key innovations in this effort include: i) the design of a plug-in architecture capable of combining multiple custom modules into a workflow process that also supports conditionals, loops, and differentiated output handling; ii) development of an plug-in interface control document (ICD) to be used by system integrators; iii) creation of an intuitive workflow schema definition enabling operators to create a reusable workflow from a list of available modules, and; iv) identification and design of a suite of tools targeting both system developers and end-users. The Phase I effort will include preliminary research into industry standards and issues common to a system of this nature, design of a system architecture supporting the aforementioned capabilities, and component level prototyping to serve as proof of concept.