Validating Methods in Cognitive Engineering: A Comparison of Two Work Domain Models

Author(s):  
Ann M. Bisantz ◽  
Catherine M. Burns ◽  
Emilie Roth

Work domain analysis (WDA) is becoming a popular technique for the analysis of complex systems. WDA is one of the frameworks of Cognitive Work Analysis (CWA; Vicente, 1999) and can be used to gather work domain constraints as part of a user centered design process. In this paper, we discuss issues of inter-modeler reliability with WDA. The authors of this paper performed, over similar time periods, cognitive engineering analyses, including work domain analyses using abstraction hierarchy models, of two similar systems: naval combat vessels. In this paper, we compare these models for similarities and differences. Comparison indicated similarities in model scope and content, which would be an expected result of the application of a reliable modeling technique to two similar systems. Differences between the models included the use of multi-part vs. a single model to represent components of the overall ship-seacontact system, the related decisions to include sensors explicitly in the model, and the descriptions of abstract functions and constraints included in the two models. Exploration of these differences illuminated methodological as well as theoretical considerations in applying work domain modeling techniques that can provide guidance to other modelers.

Author(s):  
Wei Xu

This paper demonstrates that work domain analysis (WDA), a cognitive engineering approach based on Rasmussen's abstraction hierarchy (AH) framework, is a valuable and alternate analytic tool for analyzing human-computer interaction (HCI) in complex work domains through a case study. In the case study, we use WDA to examine automation awareness, an HCI issue in automated flight decks. The case study shows that WDA provides an effective approach to systematically assess collected human factors data in order to identify the gaps in satisfying the work requirements across interrelated factors. It helps assess the adequacy of domain information provided to workers via training in order to build a fairly accurate and effective mental model, adequacy of domain information presented to workers at the interface, and the adequacy of operation procedures designed for workers to copy with unfamiliar situations. Finally, WDA also helps generate needs for enhancements of existing systems from a work domain perspective.


Author(s):  
Neelam Naikar

Cognitive work analysis (CWA) is gaining recognition as a promising approach for the analysis, design, and evaluation of complex, sociotechnical systems. However, the successful and widespread application of work domain analysis (WDA), the first phase of CWA, is limited by the lack of a coherent theoretical approach. This paper addresses a number of theoretical issues relating to WDA, including differences in the approaches of Rasmussen, Pejtersen & Goodstein (1994) and Vicente (1999), and it illustrates these theoretical issues with a work domain of a home — a 'system' that will be highly familiar to everyone. This research will help to: make WDA more accessible to researchers and practitioners who were not involved in the development of WDA or who cannot be apprenticed to experts in WDA; reduce the amount of time and effort it takes to perform WDA even for experts in the area; and facilitate the application of WDA to large-scale, industry projects.


2016 ◽  
Vol 11 (2) ◽  
pp. 136-165 ◽  
Author(s):  
Matthew James Miller ◽  
Kerry M. McGuire ◽  
Karen M. Feigh

The design and adoption of decision support systems within complex work domains is a challenge for cognitive systems engineering (CSE) practitioners, particularly at the onset of project development. This article presents an example of applying CSE techniques to derive design requirements compatible with traditional systems engineering to guide decision support system development. Specifically, it demonstrates the requirements derivation process based on cognitive work analysis for a subset of human spaceflight operations known as extravehicular activity. The results are presented in two phases. First, a work domain analysis revealed a comprehensive set of work functions and constraints that exist in the extravehicular activity work domain. Second, a control task analysis was performed on a subset of the work functions identified by the work domain analysis to articulate the translation of subject matter states of knowledge to high-level decision support system requirements. This work emphasizes an incremental requirements specification process as a critical component of CSE analyses to better situate CSE perspectives within the early phases of traditional systems engineering design.


Author(s):  
Neelam Naikar

Cognitive work analysis (CWA) is gaining recognition as a promising approach for the analysis, design, and evaluation of complex, sociotechnical systems. The successful and widespread application of CWA, however, is limited by the lack of a well-defined methodology. This paper proposes a methodology for performing work domain analysis (WDA), the first phase of CWA, and it illustrates this methodology with a work domain of a home — a 'system' that will be highly familiar to everyone. This research will help to: make WDA more accessible to researchers and practitioners who were not involved in the development of WDA or who cannot be apprenticed to experts in WDA; reduce the amount of time and effort it takes to perform WDA even for experts in the area; and facilitate the application of WDA to large-scale, industry projects.


Author(s):  
Catherine M. Burns ◽  
David Bryant ◽  
Bruce Chalmers

We applied Work Domain Analysis (WDA) to the evaluation of a military decision support system (DSS) developed as part of the Tactical Decision Making Under Stress (TADMUS) project. The purpose of the evaluation was to assess the degree of fit of the TADMUS DSS, designed for a U.S. naval environment, to the command and control of the Canadian Navy's HALIFAX Class frigate, a different environment. Using work domain models developed for the HALIFAX Class ship, we compared the TADMUS DSS against these models using Functional Information Profiles. Results of the analysis are discussed, as well as the appropriateness of using WDA as a tool in the system evaluation process.


Author(s):  
Tab Lamoureux ◽  
Jessica Sartori

Cognitive Work Analysis (CWA; Vicente, 1999) is a five-step process by which to understand complex and dynamic work systems. We have been employing the first two steps of CWA, Work Domain Analysis (WDA) and Control Task Analysis (CTA) to investigate the development and maintenance of system/environment awareness, typically called ‘picture compilation’. There is little procedural guidance on how to carry out the CTA, and even less discussion of alternative interpretations of the analysis process. This paper describes two different methods of performing CTA that we have successfully employed in the course of our work. The relative strengths and weaknesses of each method are discussed and put into the context of procedural reliability and validity.


Sign in / Sign up

Export Citation Format

Share Document