USA flag logo/image

An Official Website of the United States Government

Designing Large Data Handling Architectures

Award Information

Department of Defense
Award ID:
Program Year/Program:
2011 / SBIR
Agency Tracking Number:
Solicitation Year:
Solicitation Topic Code:
Solicitation Number:
Small Business Information
Harmonia Holdings Group
2020 Kraft Drive, Suite 1000 Blacksburg, VA 24060-6491
View profile »
Woman-Owned: Yes
Minority-Owned: Yes
HUBZone-Owned: Yes
Phase 2
Fiscal Year: 2011
Title: Designing Large Data Handling Architectures
Agency: DOD
Contract: N00014-11-C-0523
Award Amount: $1,246,335.00


Harmonia proposes to continue development from Phase I of a Large Data Handling Architecture (LDHA). Given sufficient amounts of commodity hardware, its goal is to scale up to ingest a terabyte or more of data per hour from each open source or sensor; store tens of thousands and more of terabyte files; and support operations on databases that use complex structures as table cells, sparse tables, and billions or more rows and a million or more columns. Our implementation uses the Ubuntu server Linux distribution, Hadoop core, HBase database and Chukwa data collector. We implement ingesters as Java Servlets to collect continuously and automatically pass for insertion into Hadoop a variety of open sources including, but not limited to structured and unstructured text, sensor data, images, and streaming video, experimenting with real continuous feeds available on the Internet. We develop end user programming tools that empower analysts to define analysis tasks for distributed execution even though they do not have a programming background in MapReduce. Our architecture is service oriented, high performance, extensible, and permits integration with the DoD Global Information Grid. We support disadvantaged users through services that allow downloading of data. We do extensive performance assessment of bottlenecks.

Principal Investigator:

Marc Abrams
(540) 951-5901

Business Contact:

Pallabi Saboo
(540) 951-5915
Small Business Information at Submission:

Harmonia, Inc.
2020 Kraft Drive, Suite 1000 Blacksburg, VA -

EIN/Tax ID: 432103421
Number of Employees:
Woman-Owned: Yes
Minority-Owned: Yes
HUBZone-Owned: Yes