Lead Center: LaRC
Participating Center(s): ARC
Technology Area: TA11 Modeling, Simulation, Information Technology and Processing
NASA is seeking innovative solutions that combine modern digital technologies (e.g., natural language processing, speech recognition, machine vision, machine learning and artificial intelligence, and virtual reality and augmented reality) to create digital assistants. These digital assistants can range in capability from low-level cognitive tasks (e.g., information search, information categorization and mapping, information surveys, semantic comparisons), to expert systems, to autonomous ideation. NASA is interested in digital assistants that reduce the cognitive workload of its engineers and scientists so that they can concentrate their talents on innovation and discovery. Digital assistant solutions can target tasks characterized as research, engineering, operations, data management and analysis (of science data, ground and flight test data, or simulation data), business or administrative. Examples of potential digital assistants include:
- A digital assistant that uses the semantic, numeric, and graphical content of engineering artifacts (e.g., requirements, design, verification) to automate traces among the artifacts and to assess completeness and consistency of traced content. For example, the digital agent can use semantic comparison to determine whether the full scope of a requirement may be verified based on the description(s) of the test case(s) traced from it. Similarly, the digital assistant can identify from design artifacts any functional, performance, or non-functional attributes of the design that do not trace back to requirements. Currently, this work is performed by project system engineers, quality assurance personnel, and major milestone review teams.
- A digital assistant that can identify current or past work related to an idea by providing a list of related government documents, academic publications, and/or popular publications. This is useful in characterizing the state-of-the-art when proposing or reviewing an idea for government funding. Currently, engineers and scientists accomplish this by executing multiple searches using different combinations of keywords from the idea text, each on a variety of search engines and databases; then the engineers read dozens of documents and returns to establish relevance. This example looks for digital assistive technologies to reduce this workload substantially.
- A digital assistant that can highlight lessons learned, suggest reusable assets, highlight past solutions or suggest collaborators based on the content that the engineer or scientist is currently working on. This example encourages digital solutions that can parse textual and/or graphical information from an in-progress work product and search Agency knowledge bases, project repositories, asset repositories, and other in-progress work products to identify relevantly similar information or assets. The digital assistant can then notify the engineer of the relevant information and/or its author (potential collaborator).
- A digital assistant that can recommend an action in real-time to operators of a facility, vehicle, or other physical asset. Such a system could work from a corpus of system information such as design artifacts, operator manuals, maintenance manuals, and operating procedures to correctly identify the current state of a system given sensor data, telemetry, component outputs, or other real-time data. The digital assistant can then use the same information to autonomously recommend a remedial action to the operator when it detects a failure, to warn the operator when their actions will result in a hazard or loss of a mission objective, or to suggest a course of action to the operator that will achieve a new mission objective given by the operator.
- A digital assistant that can create one or more component or system designs from a concept of operations, a set of high-level requirements, or a performance specification. Such an agent may combine reinforcement learning techniques, generative-adversarial networks, and simulations to autonomously ideate solutions.
- An expert system that uses a series of questions to generate an initial system model (e.g. using Systems Modeling Language [SysML]), plans, estimates, and other systems engineering artifacts.
- Question and Answer (Q&A) Bots: A digital agent that can answer commonly asked questions on "how-to" for scientists and engineers (e.g., what resources [grounds facilities, labs, media services, IT] are available; where to get site licenses for software packages; who to contact for assistance on a topic; answers for general business procedures such as procurement, travel, time and attendance, etc.)
CIMON "Crew Interactive Mobile Companion"
NASA TM–2016-219361 Big Data Analytics and Machine Intelligence Capability Development at NASA Langley Research Center: Strategy, Roadmap, and Progress https://ntrs.nasa.gov/archive/nasa/casi.ntrs.nasa.gov/20170000676.pdf
NASA/TM-2016-219358 Machine Learning Technologies and Their Applications for Science and Engineering Domains Workshop – Summary Report https://ntrs.nasa.gov/archive/nasa/casi.ntrs.nasa.gov/20170000679.pdf
Rohaidi, N., "How NASA Uses AI on Mars," GovInsider, https://govinsider.asia/security/tom-soderstrom-jpl-nasa-digital-assistants-curiosity-rover/ , January 31st, 2018.
Soderstrom, T., "A peek at artificial intelligence in action at NASA Jet Propulsion Laboratory," The Enterprisers Project, https://enterprisersproject.com/article/2019/5/artificial-intelligence-jpl-nasa, May 9, 2019.
Expected TRL or TRL range at completion of the project: 3 to 5
Desired Deliverables of Phase II
Prototype, Hardware, Software
Desired Deliverables Description
Phase II would conclude with a demonstration (prototype) or a deployable digital assistant with quantifiable reduction in time or cost of an activity typically performed by NASA scientists, engineers, or operators.
State of the Art and Critical Gaps
Digitally assistive technologies currently permeate the consumer market with products like the Amazon Echo, Apple devices with Siri, Google devices with Google Assistant, and Microsoft devices with Cortana. Though Apple, Google, and Microsoft are also moving their assistive technologies into the enterprise space, these developments are largely focused on reducing information technology costs. Some cities and college campuses have also acted as early adopters of smart city or smart campus technologies that include digital assistants. However, application of these assistive technologies to engineering and science has largely been limited to university research. Moreover, most assistive technologies exercise no more cognition than a Q&A bot or executing simple commands. The emergence of improved natural language processing brings the possibility of digital assistants that can perform low-level cognitive tasks. This subtopic aims not only to bring commercially available assistive technologies to the engineering environment, but elevate their cognitive capabilities so that engineers and scientists can spend more time innovating and less time on low-level cognitive work that is laborious or repetitive.
Relevance / Science Traceability
This subtopic is related to technology investments in the NASA Technology Roadmap, Technical Area 11 Modeling, Simulation, Information Technology, and Processing under sections 184.108.40.206 Cognitive Computer, 220.127.116.11 Onboard Data Capture and Triage Methodologies, and 18.104.22.168 Real-time Data Triage and Data Reduction Methodologies. This subtopic is seeking similar improvements in computer cognition, but more generally applied to the activities performed by engineers and scientists and made more easily accessible through technologies like speech recognition.