USA flag logo/image

An Official Website of the United States Government

Designing Large Data Handling Architectures

Award Information

Agency:
Department of Defense
Branch:
N/A
Award ID:
Program Year/Program:
2011 / SBIR
Agency Tracking Number:
O2-1094
Solicitation Year:
2009
Solicitation Topic Code:
OSD09-SP4
Solicitation Number:
2009.2
Small Business Information
Harmonia Holdings Group LLC
2020 Kraft Drive suite 1000 Blacksburg, VA 24060-
View profile »
Woman-Owned: Yes
Minority-Owned: Yes
HUBZone-Owned: Yes
 
Phase 2
Fiscal Year: 2011
Title: Designing Large Data Handling Architectures
Agency: DOD
Contract: N00014-11-C-0523
Award Amount: $1,246,335.00
 

Abstract:

Harmonia proposes to continue development from Phase I of a Large Data Handling Architecture (LDHA). Given sufficient amounts of commodity hardware, its goal is to scale up to ingest a terabyte or more of data per hour from each open source or sensor; store tens of thousands and more of terabyte files; and support operations on databases that use complex structures as table cells, sparse tables, and billions or more rows and a million or more columns. Our implementation uses the Ubuntu server Linux distribution, Hadoop core, HBase database and Chukwa data collector. We implement ingesters as Java Servlets to collect continuously and automatically pass for insertion into Hadoop a variety of open sources including, but not limited to structured and unstructured text, sensor data, images, and streaming video, experimenting with real continuous feeds available on the Internet. We develop end user programming tools that empower analysts to define analysis tasks for distributed execution even though they do not have a programming background in MapReduce. Our architecture is service oriented, high performance, extensible, and permits integration with the DoD Global Information Grid. We support disadvantaged users through services that allow downloading of data. We do extensive performance assessment of bottlenecks.

Principal Investigator:

Marc Abrams
PI
(540) 951-5901
mabrams@harmonia.com

Business Contact:

Pallabi Saboo
CEO
(540) 951-5915
psaboo@harmonia.com
Small Business Information at Submission:

Harmonia, Inc.
2020 Kraft Drive, Suite 1000 Blacksburg, VA -

EIN/Tax ID: 432103421
DUNS: N/A
Number of Employees:
Woman-Owned: Yes
Minority-Owned: Yes
HUBZone-Owned: Yes