Semantics-Aware Web Screen-Reading Assistant

Award Information
Agency: Department of Health and Human Services
Branch: N/A
Contract: 90BI0023
Agency Tracking Number: 90BI0023
Amount: $575,500.00
Phase: Phase II
Program: SBIR
Solicitation Topic Code: N/A
Solicitation Number: ED-ACL-GRANTS-052115
Solicitation Year: 2015
Award Year: 2015
Award Start Date (Proposal Award Date): 2015-09-30
Award End Date (Contract End Date): 2017-09-30
Small Business Information
1500 Stony Brook Road, CEWIT SBU R&D Park, Stony Brook, NY, 11794-6040
DUNS: 807799924
HUBZone Owned: N
Woman Owned: N
Socially and Economically Disadvantaged: N
Principal Investigator
 Yevgen Borodin
 (888) 533-7884
Business Contact
 Brian Bard
Phone: (202) 975-7298
Research Institution
This Phase II project builds upon previous research to develop a Semantics-Aware Web Screen-Reading Assistant that empowers people with vision impairments to interact with the Web more naturally and efficiently via a spoken-dialog interface that is aware of high-level semantic entities such as an article section, a date picker widget, etc. The Assistant organizes the web content into a collection of meaningful semantic entities by using the semantic cues in HTML5 and ARIA specifications, as well as automatically identifying such entities with intelligent content analysis algorithms. The ability to interact with semantic entities enables users to say commands such as “Read the article,” “Log in,” “Next result,” as well as interact with common widgets such as the Date-Picker by saying “Next month,” “Which day is March 13th,” etc. The Assistant provides a spoken-dialog interface to interact with users, interprets and disambiguates user utterances, maintains a dialog with the user, and automates browsing actions on behalf of the user. With the Assistant, users utilize fewer shortcuts, spend less time listening through irrelevant content, perform browsing tasks more efficiently, and, very importantly, do so without having to let go of the screen readers they are used to.

* Information listed above is at the time of submission. *

Agency Micro-sites

SBA logo
Department of Agriculture logo
Department of Commerce logo
Department of Defense logo
Department of Education logo
Department of Energy logo
Department of Health and Human Services logo
Department of Homeland Security logo
Department of Transportation logo
Environmental Protection Agency logo
National Aeronautics and Space Administration logo
National Science Foundation logo
US Flag An Official Website of the United States Government