Development of the Assessment Toolkit for Leader Adaptability Skills (ATLAS)

We will assess understanding of the implications of the alteration in the situation by determining whether the user properly prioritizes concerns based on the change or anomaly detection when solving complex problems. We model this assessment after the validated Decision Requirements Inventory (DRI) that our team has previously developed. The DRI is administered as part of a paper-based interview that captures the thought processes of individuals who are presented with a realistic, context-specific cases. Because the assessment tool we are developing must be stand-alone, without the use of an interviewer or rater, we will automate the DRI so it is not reliant on natural language processing. We will demonstrate the metrics and measures in practice in a series of tactical use cases , where the user is presented with a list of concerns to consider and to prioritize. Following the method of the DRI, we benchmark expert referant solutions as to the “correct” prioritization schema for each vignette. We will apply a scoring algorithm to provide the measures needed to guide development.