Multimodal Knowledge Acquisition and Management

Award Information
Agency:
Department of Defense
Branch
Navy
Amount:
$97,851.00
Award Year:
2010
Program:
STTR
Phase:
Phase I
Contract:
N00014-10-M-0297
Agency Tracking Number:
N10A-019-0357
Solicitation Year:
2010
Solicitation Topic Code:
N10A-T019
Solicitation Number:
2010.A
Small Business Information
The Friedland Group, Inc.
330 SW 43rd St., Suite K #489, Renton, WA, 98057
Hubzone Owned:
N
Socially and Economically Disadvantaged:
N
Woman Owned:
N
Duns:
825903185
Principal Investigator:
Noah Friedland
President
(206) 760-9487
noah@thefriedlandgroup.com
Business Contact:
Noah Friedland
President
(206) 760-9487
noah@thefriedlandgroup.com
Research Institution:
University of Rochester
Brenda Kavanaugh
518 Hylan Building
Box 270140
Rochester, NY, 14627
(585) 275-4031
Nonprofit college or university
Abstract
Related information, particularly in the real word, can come in many forms, like text, images, video, and more. Exploiting that information will require a multimodal approach. The Friedland Group, which led Project Moebius at DARPA, is joined by The University of Rochester and Prof. David Forsyth - respective leaders in knowledge acquisition from text and images, to create a new framework for mutlimodal knowledge acquisition and management (MKAM). MKAM utilizes and expands Episodic Logic (EL), a highly expressive logical representation and reasoning framework that has been successfully applied to model complex events and situations. Capturing multimodal knowledge in EL will make it integrable, inference and unification capable. It will also enable the improvement of knowledge acquisition capabilities in individual modalities by providing more context and reducing ambiguities. Our Phase I work will demonstrate the feasibility of our approach through the development of several concrete examples, utilizing data produced by existing knowledge extraction systems, to show how EL can meld knowledge from different modalities while improving acquisition from individual modalities.

* information listed above is at the time of submission.

Agency Micro-sites

US Flag An Official Website of the United States Government