A Framework for Integrating Cognitive Task Analysis into the System Development Process

Author(s):  
Scott S. Potter ◽  
Emilie M. Roth ◽  
David D. Woods ◽  
William C. Elm

This paper describes a process that orchestrates different types of specific CTA techniques to provide design relevant CTA results and integrates CTA results into the software development process. Two fundamental premises underlie the approach. First, CTA is more than the application of any single CTA technique. Instead, developing a meaningful understanding of a field of practice relies on multiple converging techniques in a bootstrapping process. The important issue from a CTA perspective is to evolve a model of the interconnections between the demands of the domain, the strategies and knowledge of practitioners, the cooperative interactions across human and machine agents, and how artifacts shape these strategies and coordinative activities across a series of different specific techniques. Second, since CTA is a means to support the design of computer-based artifacts that enhance human and team performance, CTA must be integrated into the software and system development process. Thus, the vision of CTA as an initial, self-contained technique that is handed-off to system designers is reconceived as an incremental process of uncovering the cognitive demands imposed on the operator(s) by the complexities and constraints of the domain.

Author(s):  
Michael J. DeVries ◽  
Sallie E. Gordon

Because an increasing number of systems are being developed to support complex cognitive functioning, task analysis is commonly being augmented with cognitive task analysis, which identifies cognitive processes, knowledge, and mental models relevant to task performance. Cognitive task analysis tends to be lengthy and time-consuming, so designers frequently ask how they might know if it is actually necessary for a specific project. In this paper, we assume that much of the need for cognitive task analysis depends on the inherent “cognitive complexity” of the task. We present a model of cognitive complexity, and show how it was used to develop a computer-based tool for estimating relative cognitive complexity for a set of tasks. The tool, Cog-C, elicits task and subtask hierarchies, then guides the user in making relatively simple estimates on a number of scales. The tool calculates and displays the relative cognitive complexity scores for each task, along with subscores of cognitive complexity for different types of knowledge. Usability and reliability were evaluated in multiple domains, showing that the tool is relatively easy to use, reliable, and well-accepted.


Author(s):  
Sallie E. Gordon

Cognitive task analysis is accomplished using a wide variety of methodologies, and we have previously argued that different methods will tend to elicit qualitatively different types of knowledge and skills. Because of this, many practitioners use complementary methods for a given project. We have developed such a complementary package of knowledge elicitation techniques, along with a specific representational method, which together are termed conceptual graph analysis. Conceptual graph analysis is domain-independent and can be used to evaluate complex cognitive tasks or subtasks. It relies on the successive use of document analysis, interviews, task observation, and induction based on review of task performance. The information from these elicitation techniques is represented as a set of interrelated conceptual graphs, but can be represented in other formats also. There are several issues relevant to cognitive task analysis that are currently being faced, including when to perform this type of analysis, and what methods to use. One answer is to perform cognitive task analysis when the task has an inherently high degree of cognitive complexity.


1987 ◽  
Vol 16 (1) ◽  
pp. 57-64 ◽  
Author(s):  
Squy G. Wallace ◽  
Paul Sheffield

Application of the Instructional System Development (ISD) model to large scale training development projects has frequently been criticized for failing to develop and deliver training materials in a timely manner. This article discusses the advantage of using a computer-generated graphic portrayal of task analysis data and the use of computer macros to streamline the training development process.


Author(s):  
Michael J. DeVries ◽  
Sallie E. Gordon

Task analysis is a methodology used during many different phases of system development. However, because many tasks involve complex cognitive processing, there is an increasing need for designers to perform cognitive task analysis. It is generally agreed that cognitive task analysis tends to be costly in terms of time and effort, and many designers ask how they would know when cognitive task analysis should be performed. This demonstration features a computer-based decision aid, Cog-C, to help designers answer this question. The software tool is based on the assumption that cognitive complexity is a major factor in determining when cognitive task analysis must be performed. The tool therefore helps the user determine the relative level of cognitive complexity for a set of tasks. It does this by (1) guiding the user in developing a task/subtask hierarchy, (2) guiding the subject matter expert in estimating the “amount” of various categories of knowledge required for subtask performance (e.g., concepts, rules, patterns, and strategies), and then (3) providing output including the number of steps required for task completion, standardized subscores showing the relative amounts of each knowledge category, an overall cognitive complexity score, and a general recommendation as to whether the task is a potential candidate for cognitive task analysis.


2020 ◽  
Vol 65 (4) ◽  
pp. 1-11
Author(s):  
Dev Minotra ◽  
Karen M. Feigh

Rotorcraft pilots face a number of unique challenges in shipboard-landing maneuvers. Even very experienced rotorcraft pilots find such maneuvers to be challenging and delicate, as they require the pilot's undivided attention. To minimize risk, these maneuvers are conducted within well-defined boundaries associated with weather and visibility. To expand the envelope of safety, technological aids that augment decision-making capabilities and reduce pilot workload are being proposed. Our paper reports a cognitive task analysis, which involved interviews with five rotorcraft pilots experienced in shipboard-landing maneuvers. Our results reveal cognitive elements in which expertise plays a critical role. We have articulated our understanding on why pilots are faced with difficulties during these critical points, which led us toward design recommendations and system requirements for technological aids and their displays. We have also identified a number of system limitations and quantities of interest, which may be useful in safety evaluations.


2021 ◽  
Author(s):  
Taylor Kunkes ◽  
Basiel Makled ◽  
Jack Norfleet ◽  
Steven Schwaitzberg ◽  
Lora Cavuoto

BACKGROUND Proper airway management is an essential skill for hospital personnel and rescue services to learn as it is a priority for the care of critically ill patients. It is critical that providers be properly trained and competent in performing endotracheal intubation (ETI), a widely used technique for airway management. Several metrics have been created in order to measure competence in the ETI procedure. However, there is still a need to improve ETI training and evaluation including a focus on collaborative research across medical specialties in order to establish greater competence-based training and assessments. Training and evaluating ETI should also incorporate modern, evidence-based procedural training methodologies. OBJECTIVE Cognitive task analysis (CTA) is a framework developed to identify the cognitive demands and skills needed to proficiently perform a task, elucidate differences between novice and expert performance, and provide an understanding of the workload associated with a task. The CTA framework was applied to ETI in order to capture a broad view of task and training requirements from the perspective of multiple medical specialties. METHODS A CTA interview was developed based on previous research into the tasks and evaluation methods of ETI. Six experts from multiple medical specialties were interviewed in order to capture the cognitive skills required in order to complete this task. Interviews were coded for main themes, sub-themes in each category, and differences among specialties. These findings were compiled into a skills tree in order to identify the training needs and cognitive requirements of each task. RESULTS The CTA revealed that consistency in equipment setup and planning through talk or think-aloud methods are critical to successfully mastering ETI. These factors allow the providers to avoid errors due to patient characteristics and environmental factors. Variation among specialties derived primarily from the environment in which ETI is performed, subsequent treatment plans, and available resources. Anesthesiology typically represented the most ideal cases with a large potential for training, whereas emergency medical personnel faced the greatest number of constraints based on the environment and available equipment. CONCLUSIONS While the skills tree cannot perfectly capture the complexity and detail of all potential cases, it provided insight into the nuanced skills and training techniques used to prepare novices for the variability they may find in practice. Importantly, the CTA identified ways in which challenges faced by novices may be overcome and how this training can be applied to future cases. By making these implicit skills and points of variation explicit, they can be better translated into teachable details. These findings are consistent with previous studies looking at developing improved assessment metrics for ETI and expand upon their work by delving into methods of feedback and strategies to assist novices.


2016 ◽  
Vol 10 (4) ◽  
pp. 391-410 ◽  
Author(s):  
David Johnston ◽  
Ben W. Morrison

Within the sport of rugby league, there exists a perceived shortage of talent in playmaking positions. In Australia, an academy dedicated to the development of playmaking skills has recently been established. Although the precise skills targeted by the academy for development are yet to be determined, decision making is presumed to be integral. The current research used the naturalistic decision-making paradigm to inform training initiatives by investigating the decision processes engaged by rugby league playmakers. The research explored whether players of varying ability could be differentiated in relation to a key decision process, cue use. Rugby league playmakers were interviewed using a novel variation of cognitive task analysis, which used both retrospective (i.e., recalled game) and prospective (i.e., unfamiliar rugby league scenario) means. The sample comprised 10 participants: six professional and four semiprofessional rugby league players. From a content analysis, a concept map, cognitive demands tables, and a critical cue inventory were produced. Results indicated that professional players demonstrated greater cue discrimination, assigned different meaning to the cues, and processed cues in a different manner compared with their semiprofessional counterparts. The results offer insights for future training applications in the domain and raise important questions regarding the utility of critical cue inventories in training.


Author(s):  
GIUSEPPE DELLA PENNA ◽  
ANNA RITA LAURENZI ◽  
SERGIO OREFICE ◽  
BENEDETTO INTRIGILA

In this paper we present SMDP (Scenario Model Development Process), an XML-based methodology for the description and manipulation of scenarios that are used to formalize and reuse software requirements. SMDP is an iterative and incremental process that supports scenario evolution during the requirements engineering process. The formalization of scenarios through the underlying XML-based language of SMDP makes them immediately available to further automatic manipulation (e.g., to automatically generate test cases) without the need for intermediate models, as it is usually done in semi-formal approaches. Thanks to the implementation of a software assistant environment for SMDP, the methodology is currently being experimented on a variety of case studies, in particular web applications.


2021 ◽  
Vol 19 (2) ◽  
pp. 60-69
Author(s):  
Muhamad Fahmi Nugraha ◽  
Indah Mardiyah Lestari

The payroll system is a function of human resource management. Its main role is to reward teachers in the form of salaries in exchange for contributions to schools and their performance.The purpose and purpose of this report is to minimize the risk of duplication and deletion of data, make it easier to present reports so that they can be generated automatically, make it easier for TU staff to calculate the teaching honorarium of teachers at SMA Al Ma'soem.The method used in system design is SDLC (System Development Life Cycle). Where in its application using the waterfall model, namely the Waterfall method is a sequential software development process, where progress is seen as continuing to flow downward (like a waterfall) through the phases of planning, modeling, implementation (construction), and testing. The system modeling uses Flow maps, Data Flow Diagrams, Structure Charts, Data Dictionary and ERD.Thus, the Information System for Teaching Honor Teachers at Al Ma'soem High School is expected to assist in processing data and processing teacher payrolls.


Author(s):  
L C Manikandan ◽  
R K Selvakumar

Software engineering is an engineering division connected with development of software product using well-defined scientific principles, techniques and actions. Two different types of activities like software framework activities and umbrella activities are included in standard software process model. Testing acts important job in software development process, i.e. the specified functionality and requirements are tested. The objective of this paper is to provide the software process framework and testing techniques for young researchers.


Sign in / Sign up

Export Citation Format

Share Document