Multimodal Knowledge Acquisition and Management

Award Information
Agency: Department of Defense
Branch: Navy
Contract: N00014-11-C-0474
Agency Tracking Number: N10A-019-0357
Amount: $666,091.00
Phase: Phase II
Program: STTR
Awards Year: 2011
Solicitation Year: 2010
Solicitation Topic Code: N10A-T019
Solicitation Number: 2010.A
Small Business Information
330 SW 43rd St., Suite K #489, Seattle, WA, -
DUNS: 825903185
HUBZone Owned: N
Woman Owned: N
Socially and Economically Disadvantaged: N
Principal Investigator
 Noah Friedland
 (206) 760-9487
Business Contact
 Noah Friedland
Title: President
Phone: (206) 760-9487
Research Institution
 University of Rochester
 Anne Corriveau
 518 Hylan Building
Box 270140
Rochester, NY, 14627-
 (585) 273-2137
 Nonprofit college or university
Automated techniques for harvesting knowledge from documents will make tasks like intelligence gathering significantly faster and more reliable. Information in documents is often distributed between text and non-textual components, which rely upon each other to create a comprehensive picture of what is being conveyed to the reader. The Friedland Group, working with our partner, The University of Rochester, is developing a multimodal knowledge acquisition and management (MKAM) technology specifically to be able to harvest knowledge that is distributed among different modalities in documents. For example, an image containing people could provide details like the age, race, gender, hair and eye color and relative positions of the individuals in the photo. The addition of a caption, e.g."The Adams Family at their daughter's graduation."provides a deeper context - specifically, who the people are, how they relate to each other and what event are they participating in. Taken individually, text and images each provide only a piece of the puzzle, but adding them together allows us to recover not only the broader context, but important specifics that would otherwise have been missed.

* Information listed above is at the time of submission. *

Agency Micro-sites

SBA logo
Department of Agriculture logo
Department of Commerce logo
Department of Defense logo
Department of Education logo
Department of Energy logo
Department of Health and Human Services logo
Department of Homeland Security logo
Department of Transportation logo
Environmental Protection Agency logo
National Aeronautics and Space Administration logo
National Science Foundation logo
US Flag An Official Website of the United States Government