scholarly journals Reliability of instruments that measure situation awareness, team performance and task performance in a simulation setting with medical students

BMJ Open ◽  
2019 ◽  
Vol 9 (9) ◽  
pp. e029412
Author(s):  
Magnus Hultin ◽  
Karin Jonsson ◽  
Maria Härgestam ◽  
Marie Lindkvist ◽  
Christine Brulin
Keyword(s):  
Medical Students ◽  
Task Performance ◽  
Internal Consistency ◽  
Team Performance ◽  
Situation Awareness ◽  
Global Assessment ◽  
Rater Reliability ◽  
Training Centre ◽  
Assessment Technique ◽  
And Task

ObjectivesThe assessment of situation awareness (SA), team performance and task performance in a simulation training session requires reliable and feasible measurement techniques. The objectives of this study were to test the Airways–Breathing–Circulation–Disability–Exposure (ABCDE) checklist and the Team Emergency Assessment Measure (TEAM) for inter-rater reliability, as well as the application of Situation Awareness Global Assessment Technique (SAGAT) for feasibility and internal consistency.DesignMethodological approach.SettingData collection during team training using full-scale simulation at a university clinical training centre. The video-recorded scenarios were rated independently by four raters.Participants55 medical students aged 22–40 years in their fourth year of medical studies, during the clerkship in anaesthesiology and critical care medicine, formed 23 different teams. All students answered the SAGAT questionnaires, and of these students, 24 answered the follow-up postsimulation questionnaire (PSQ). TEAM and ABCDE were scored by four professionals.MeasuresThe ABCDE and TEAM were tested for inter-rater reliability. The feasibility of SAGAT was tested using PSQ. SAGAT was tested for internal consistency both at an individual level (SAGAT) and a team level (Team Situation Awareness Global Assessment Technique (TSAGAT)).ResultsThe intraclass correlation was 0.54/0.83 (single/average measurements) for TEAM and 0.55/0.83 for ABCDE. According to the PSQ, the items in SAGAT were rated as relevant to the scenario by 96% of the participants. Cronbach’s alpha for SAGAT/TSAGAT for the two scenarios was 0.80/0.83 vs 0.62/0.76, and normed χ² was 1.72 vs 1.62.ConclusionTask performance, team performance and SA could be purposefully measured, and the reliability of the measurements was good.

scholarly journals Do team and task performance improve after training situation awareness? A randomized controlled study of interprofessional intensive care teams

2021 ◽  
Vol 29 (1) ◽  
Author(s):  
Karin Jonsson ◽  
Christine Brulin ◽  
Maria Härgestam ◽  
Marie Lindkvist ◽  
Magnus Hultin
Keyword(s):  
Intensive Care ◽  
Task Performance ◽  
Team Performance ◽  
Situation Awareness ◽  
Intervention Group ◽  
Team Leadership ◽  
Educational Programme ◽  
Control Group ◽  
Randomized Controlled ◽  
And Task

Abstract Background When working in complex environments with critically ill patients, team performance is influenced by situation awareness in teams. Moreover, improved situation awareness in the teams will probably improve team and task performance. The aim of this study is to evaluate an educational programme on situation awareness for interprofessional teams at the intensive care units using team and task performance as outcomes. Method Twenty interprofessional teams from the northern part of Sweden participated in this randomized controlled intervention study conducted in situ in two intensive care units. The study was based on three cases (cases 0, 1 and 2) with patients in a critical situation. The intervention group (n = 11) participated in a two-hour educational programme in situation awareness, including theory, practice, and reflection, while the control group (n = 9) performed the training without education in situation awareness. The outcomes were team performance (TEAM instrument), task performance (ABCDE checklist) and situation awareness (Situation Awareness Global Assessment Technique (SAGAT)). Generalized estimating equation were used to analyse the changes from case 0 to case 2, and from case 1 to case 2. Results Education in situation awareness in the intervention group improved TEAM leadership (p = 0.003), TEAM task management (p = 0.018) and TEAM total (p = 0.030) when comparing cases 1 and 2; these significant improvements were not found in the control group. No significant differences were observed in the SAGAT or the ABCDE checklist. Conclusions This intervention study shows that a 2-h education in situation awareness improved parts of team performance in an acute care situation. Team leadership and task management improved in the intervention group, which may indicate that the one or several of the components in situation awareness (perception, comprehension and projection) were improved. However, in the present study this potential increase in situation awareness was not detected with SAGAT. Further research is needed to evaluate how educational programs can be used to increase situation awareness in interprofessional ICU teams and to establish which components that are essential in these programs. Trial registration This randomized controlled trial was not registered as it does not report the results of health outcomes after a health care intervention on human participants.

scholarly journals Measuring Performance in an Electronic Health Record (EHR) based Simulation Using the Situation Awareness Global Assessment Technique

2019 ◽  
Vol 8 (1) ◽  
pp. 92-95
Author(s):  
Irit Rasooly ◽  
Evan Orenstein ◽  
Robert Grundmeier ◽  
Naveen Muthu
Keyword(s):  
Decision Making ◽  
Electronic Health Record ◽  
Situation Awareness ◽  
Global Assessment ◽  
Clinical Decision Making ◽  
Health Record ◽  
Educational Approach ◽  
Training Environment ◽  
Assessment Technique ◽  
Electronic Health

Simulation is an educational approach well suited to development of knowledge and decision-making skills for emergent or infrequent scenarios. Electronic Health Record (EHR) based simulation, in which participants retrieve information from a simulated EHR, provides an authentic training environment with fidelity to the typical clinical decision-making process and has been associated with enduring changes in EHR use patterns. However, we do not know whether these behavior changes reflect better decision-making. We aimed to develop a measure of pediatric resident performance in an EHR based simulation using the Situation Awareness Global Assessment Technique (SAGAT).

Exploring the Central Executive in Situation Awareness

2010 ◽  
Vol 106 (1) ◽  
pp. 105-118 ◽  
Author(s):  
Abdrabo Moghazy Soliman
Keyword(s):  
Working Memory ◽  
Executive Function ◽  
Situation Awareness ◽  
Executive Control ◽  
Global Assessment ◽  
Real Life ◽  
Central Executive ◽  
Driving Simulation ◽  
Assessment Technique

Despite its significance, the central executive is the least explored component of working memory, particularly in complicated contexts. Exp. 1 investigated the role of executive control of working memory in situation awareness in a real-life driving simulation. Exp. 2 examined the extent to which taxing the central executive might affect situation awareness. High, Medium, and Low Situation Awareness groups were formed as assessed using the Situation Awareness Global Assessment Technique. Executive function was measured using several tests. Results from Exp. 1 demonstrated that the Low Situation Awareness group performed significantly worse on all executive function tasks compared to High and Medium Situation Awareness groups. Findings from Exp. 2 suggested that concurrent load on the central executive dramatically affected the Low Situation Awareness group but not the High Situation Awareness group: the former had significantly more driving violations under central executive load.

Development and Implementation of a Situation Awareness Workshop to Advance Safe Practice in Novice Nurses

2018 ◽  
Vol 24 (2) ◽  
pp. 124-132
Author(s):  
Steven J. Kass ◽  
Christopher O. Downing ◽  
Kahla A. Davis ◽  
Stephen J. Vodanovich ◽  
Cynthia Smith-Peters ◽  
...  
Keyword(s):  
Health Care ◽  
Situation Awareness ◽  
Health Care Professionals ◽  
Global Assessment ◽  
Safe Practice ◽  
Assessment Technique ◽  
Novice Nurses ◽  
Before And After ◽  
Full Day ◽  
Future Status

The current study evaluated the effectiveness of a workshop designed to provide nurses (n= 6) with the means to improve their situation awareness. The nurses participated in a full-day workshop in which their situation awareness performance was measured before and after using the Situation Awareness Global Assessment Technique. Following the workshop, nurses demonstrated improvement in their perception of relevant cues, comprehension of what the combination of cues means, and projection of the patient’s future status. The implications of situation awareness education for health-care professionals are discussed.

Sign in / Sign up

Export Citation Format

Share Document