Exploring Measures of Workload, Situation Awareness, and Task Performance in the Main Control Room

ObjectivesThe assessment of situation awareness (SA), team performance and task performance in a simulation training session requires reliable and feasible measurement techniques. The objectives of this study were to test the Airways–Breathing–Circulation–Disability–Exposure (ABCDE) checklist and the Team Emergency Assessment Measure (TEAM) for inter-rater reliability, as well as the application of Situation Awareness Global Assessment Technique (SAGAT) for feasibility and internal consistency.DesignMethodological approach.SettingData collection during team training using full-scale simulation at a university clinical training centre. The video-recorded scenarios were rated independently by four raters.Participants55 medical students aged 22–40 years in their fourth year of medical studies, during the clerkship in anaesthesiology and critical care medicine, formed 23 different teams. All students answered the SAGAT questionnaires, and of these students, 24 answered the follow-up postsimulation questionnaire (PSQ). TEAM and ABCDE were scored by four professionals.MeasuresThe ABCDE and TEAM were tested for inter-rater reliability. The feasibility of SAGAT was tested using PSQ. SAGAT was tested for internal consistency both at an individual level (SAGAT) and a team level (Team Situation Awareness Global Assessment Technique (TSAGAT)).ResultsThe intraclass correlation was 0.54/0.83 (single/average measurements) for TEAM and 0.55/0.83 for ABCDE. According to the PSQ, the items in SAGAT were rated as relevant to the scenario by 96% of the participants. Cronbach’s alpha for SAGAT/TSAGAT for the two scenarios was 0.80/0.83 vs 0.62/0.76, and normed χ² was 1.72 vs 1.62.ConclusionTask performance, team performance and SA could be purposefully measured, and the reliability of the measurements was good.

Download Full-text

Considerations for Training Team Situation Awareness and Task Performance Through PC-Gamer Simulated Multiship Helicopter Operations

International Journal of Aviation Psychology ◽

10.1207/s15327108ijap1402_5 ◽

2004 ◽

Vol 14 (2) ◽

pp. 191-205 ◽

Cited By ~ 18

Author(s):

Michael D. Proctor ◽

Michael Panko ◽

Sharlene J. Donovan

Keyword(s):

Task Performance ◽

Situation Awareness ◽

Team Situation Awareness ◽

Training Team ◽

And Task

Download Full-text

The effect of interactive analytical dashboard features on situation awareness and task performance

Decision Support Systems ◽

10.1016/j.dss.2020.113322 ◽

2020 ◽

Vol 135 ◽

pp. 113322

Author(s):

Mario Nadj ◽

Alexander Maedche ◽

Christian Schieder

Keyword(s):

Task Performance ◽

Situation Awareness ◽

And Task

Download Full-text

Effects of Air Route Alternation and Display Design on an Operator’s Situation Awareness, Task Performance and Mental Workload in Simulated Flight Tasks

Applied Sciences ◽

10.3390/app11125745 ◽

2021 ◽

Vol 11 (12) ◽

pp. 5745

Author(s):

Hao Chen ◽

Liping Pang ◽

Xiaoru Wanyan ◽

Shuang Liu ◽

Yufeng Fang ◽

...

Keyword(s):

Task Performance ◽

Situation Awareness ◽

Mental Workload ◽

Unexpected Events ◽

Display Design ◽

Emergency Situations ◽

Open Window ◽

Information Salience ◽

And Behavior ◽

And Task

Air route alternation caused by unexpected events in abnormal or emergency situations often produces adverse consequences on an operator’s cognition and behavior in flight tasks. Under such a circumstance, it is especially necessary to examine the utility of the interaction displays usually designed based on the routine environment. This study was aimed to investigate the effects of air route alternation and display design on operators’ situation awareness (SA), task performance and mental workload during simulated flight tasks. Twenty-four participants attended an experiment where they were instructed to perform simulated flight tasks with three types of display designs in both air-route-as-planned and air-route-altered conditions. Subjective measures, behavioral measures and eye movement measures were adopted to assess the participants’ SA, task performance and mental workload. The results show that unexpected air route alternation increases mental workload as well as deteriorates the SA and task performance due to the gap between attention resource demand and supply. Reducing the demand of the operator’s attention resource should be the focus when coping with unexpected events in abnormal situations. In addition, reasonable information layout, such as a center-layout design of the critical decision-making information, is more important than information salience for improving the SA and task performance in abnormal situations. Nevertheless, indicators with a high-salience design, such as a more open window design and immersive design, are still worth recommending.

Download Full-text

Do team and task performance improve after training situation awareness? A randomized controlled study of interprofessional intensive care teams

Scandinavian Journal of Trauma Resuscitation and Emergency Medicine ◽

10.1186/s13049-021-00878-2 ◽

2021 ◽

Vol 29 (1) ◽

Author(s):

Karin Jonsson ◽

Christine Brulin ◽

Maria Härgestam ◽

Marie Lindkvist ◽

Magnus Hultin

Keyword(s):

Intensive Care ◽

Task Performance ◽

Team Performance ◽

Situation Awareness ◽

Intervention Group ◽

Team Leadership ◽

Educational Programme ◽

Control Group ◽

Randomized Controlled ◽

And Task

Abstract Background When working in complex environments with critically ill patients, team performance is influenced by situation awareness in teams. Moreover, improved situation awareness in the teams will probably improve team and task performance. The aim of this study is to evaluate an educational programme on situation awareness for interprofessional teams at the intensive care units using team and task performance as outcomes. Method Twenty interprofessional teams from the northern part of Sweden participated in this randomized controlled intervention study conducted in situ in two intensive care units. The study was based on three cases (cases 0, 1 and 2) with patients in a critical situation. The intervention group (n = 11) participated in a two-hour educational programme in situation awareness, including theory, practice, and reflection, while the control group (n = 9) performed the training without education in situation awareness. The outcomes were team performance (TEAM instrument), task performance (ABCDE checklist) and situation awareness (Situation Awareness Global Assessment Technique (SAGAT)). Generalized estimating equation were used to analyse the changes from case 0 to case 2, and from case 1 to case 2. Results Education in situation awareness in the intervention group improved TEAM leadership (p = 0.003), TEAM task management (p = 0.018) and TEAM total (p = 0.030) when comparing cases 1 and 2; these significant improvements were not found in the control group. No significant differences were observed in the SAGAT or the ABCDE checklist. Conclusions This intervention study shows that a 2-h education in situation awareness improved parts of team performance in an acute care situation. Team leadership and task management improved in the intervention group, which may indicate that the one or several of the components in situation awareness (perception, comprehension and projection) were improved. However, in the present study this potential increase in situation awareness was not detected with SAGAT. Further research is needed to evaluate how educational programs can be used to increase situation awareness in interprofessional ICU teams and to establish which components that are essential in these programs. Trial registration This randomized controlled trial was not registered as it does not report the results of health outcomes after a health care intervention on human participants.

Download Full-text