Reliability and validity of a scoring instrument for clinical performance during Pediatric Advanced Life Support simulation scenarios

Resuscitation ◽  
2010 ◽  
Vol 81 (3) ◽  
pp. 331-336 ◽  
Author(s):  
Aaron Donoghue ◽  
Akira Nishisaki ◽  
Robert Sutton ◽  
Roberta Hales ◽  
John Boulet
Resuscitation ◽  
2007 ◽  
Vol 75 (1) ◽  
pp. 153-160 ◽  
Author(s):  
C. Ringsted ◽  
F. Lippert ◽  
R. Hesselfeldt ◽  
M.B. Rasmussen ◽  
S.S Mogensen ◽  
...  

Circulation ◽  
2014 ◽  
Vol 130 (suppl_2) ◽  
Author(s):  
Aaron Donoghue ◽  
Nancy Tofil ◽  
Linda Brown ◽  
Frank Overly ◽  
Adam Cheng

Background: Methods to quantitatively measure performance during resuscitative care are lacking in published literature. Members of our group have previously published psychometric analyses of task-based scoring instruments used in educational research in pediatric resuscitation. These published investigations used instruments that were designed for specific cases in pediatric resuscitation, rather than for a more generalizable application. We hypothesize that a novel scoring instrument will reliably assess clinical performance during simulated cardiac arrest. Methods: This study was conducted at 11 pediatric centers in Canada and the US. Teams of pediatric providers performed a simulated cardiac arrest scenario (asystole for 6 minutes, VF for 6 minutes). A task-based scoring instrument was designed by investigator consensus using a 0, 1, or 2 point scoring system to rate performance during cardiac arrest. The items were chosen according to the essential steps in the pulseless arrest algorithm of the AHA Pediatric Advanced Life Support course and include CPR performance parameters (chest compression rate, depth, release, pauses), defibrillation (dose in J/kg, timing), and epinephrine (dose, timing). Multiple raters reviewed and scored a set of simulations. Overall interrater reliability was measured; a fully-crossed generalizability study with team and rater as facets was performed to determine the variance in scores ascribable to each facet; a decision study was done to determine the effect of additional raters and scenarios on the G coefficient. Results: Three raters scored four videos. Overall scores ranged from 53/90 (59%) to 73/90 (81%) possible points. Intraclass correlation coefficient was 0.77 (F 3,8 = 4.46, p = 0.04). Variance components were 21% for rater, 57% for scenario. G coefficient was 0.80; by D study this increased to 0.91 and 0.93 with 8 and 10 raters, respectively. Conclusions: A novel scoring instrument for quantifying performance during pediatric cardiac arrest showed modest reliability and generalizability. Future studies should examine the effect of a larger number of raters and/or scenarios on generalizability, as well as the utility of the instrument in assessing real clinical performance.


Author(s):  
Lorena Gutiérrez-Puertas ◽  
Verónica V. Márquez-Hernández ◽  
Vanesa Gutiérrez-Puertas ◽  
Mª Carmen Rodríguez-García ◽  
Alba García-Viola ◽  
...  

The objective of this study was to explore the experiences and perceptions of nursing students after applying advanced life support techniques on a hospitalised patient in cardiac arrest in a simulated setting. A qualitative descriptive phenomenological study was conducted. Fifty-four nursing students from the University of Almería (Spain) participated. Three main themes and six subthemes were identified, which illustrate the experiences and perceptions of nursing students about performing advanced life support. The main themes were: (1) Analysing practice as part of the learning process, with the subthemes “working in an unknown environment” and “acquiring knowledge as the key to success”; (2) Facing reality: nursing students’ perceptions of an emergency situation, with the subthemes “facing stressful elements” and “emotional impact in emergency situations”; (3) Experience as a key element to integrating advanced life support into the healthcare setting, with the subthemes “discovering and facing the experience as a team” and “linking and transferring the situation to a real clinical setting”. The nursing students reported that the process of practising for an emergency situation through simulation was a fundamental part of their training, as it allowed them to acquire skills necessary for emergency situations and improve their clinical performance in advanced life support. In addition, they considered the experience a key element in integrating advanced life support into the healthcare setting. The results of this study highlight the need to develop and implement training programs focused on clinical and teamwork skills in nursing programs.


2011 ◽  
Vol 93 (1) ◽  
pp. 1-5
Author(s):  
NJ Baylem ◽  
S Wilkinson ◽  
R Dennick

Modern technology and computing are playing an ever larger role in education in general and in medicine in particular. Computerisation of assessments has been used at a basic level for nearly 50 years, with optical mark readers (still used in many institutions, including on the Advanced Life Support and Advanced Trauma Life Support® courses) first being used in the 1960s. A huge increase in the use of information technology as a teaching aid has been mirrored by an increase in its use in assessment. There are at least four major drivers behind this move towards computer-based assessment (CBA): efficiency, transparency, reliability and validity.


Author(s):  
Andy Bell ◽  
Jennifer Kelly ◽  
Peter Lewis

Abstract:Purpose:Over the past two decades, the discipline of Paramedicine has seen expediential growth as it moved from a work-based training model to that of an autonomous profession grounded in academia.  With limited evidence-based literature examining assessment in paramedicine, this paper aims to describe student and academic views on the preference for OSCE as an assessment modality, the sufficiency of pre-OSCE instruction, and whether or not OSCE performance is a perceived indicator of clinical performance.Design/Methods:A voluntary, anonymous survey was conducted to examine the perception of the reliability and validity of the Objective Structured Clinical Examination (OSCE) as an assessment tool by students sitting the examination and the academics that facilitate the assessment. Findings:The results of this study revealed that the more confident the students are in the reliability and validity of the assessment, the more likely they are to perceive the assessment as an effective measure of their clinical performance.  The perception of reliability and validity differs when acted upon by additional variables, with the level of anxiety associated with the assessment and the adequacy of feedback of performance cited as major influencers. Research Implications:The findings from this study indicate the need for further paramedicine discipline specific research into assessment methodologies to determine best practice models for high quality assessment.Practical Implications:The development of evidence based best practice guidelines for the assessment of student paramedics should be of the upmost importance to a young, developing profession such as paramedicine.Originality/Value: There is very little research in the discipline specific area of assessment for paramedicine and discipline specific education research is essential for professional growth.Limitations:The principal researcher was a faculty member of one of the institutions surveyed.  However, all data was non identifiable at time of data collection.  Key WordsParamedic; paramedicine; objective structured clinical examinations; OSCE; education; assessment.


Circulation ◽  
1995 ◽  
Vol 92 (7) ◽  
pp. 2006-2020 ◽  
Author(s):  
Arno Zaritsky ◽  
Vinay Nadkarni ◽  
Mary Fran Hazinski ◽  
George Foltin ◽  
Linda Quan ◽  
...  

Author(s):  
Catherine M. Groden ◽  
Erwin T. Cabacungan ◽  
Ruby Gupta

Objective The authors aim to compare all code blue events, regardless of the need for chest compressions, in the neonatal intensive care unit (NICU) versus the pediatric intensive care unit (PICU). We hypothesize that code events in the two units differ, reflecting different disease processes. Study Design This is a retrospective analysis of 107 code events using the code narrator, which is an electronic medical record of real-time code documentation, from April 2018 to March 2019. Events were divided into two groups, NICU and PICU. Neonatal resuscitation program algorithm was used for NICU events and a pediatric advanced life-support algorithm was used for PICU events. Events and outcomes were compared using univariate analysis. The Mann–Whitney test and linear regressions were done to compare the total code duration, time from the start of code to airway insertion, and time from airway insertion to end of code event. Results In the PICU, there were almost four times more code blue events per month and more likely to involve patients with seizures and no chronic condition. NICU events more often involved ventilated patients and those under 2 months of age. The median code duration for NICU events was 2.5 times shorter than for PICU events (11.5 vs. 29 minutes), even when adjusted for patient characteristics. Survival to discharge was not different in the two groups. Conclusion Our study suggests that NICU code events as compared with PICU code events are more likely to be driven by airway problems, involve patients <2 months of age, and resolve quickly once airway is taken care of. This supports the use of a ventilation-focused neonatal resuscitation program for patients in the NICU. Key Points


Author(s):  
Jasmeet Soar ◽  
Bernd W. Böttiger ◽  
Pierre Carli ◽  
Keith Couper ◽  
Charles D. Deakin ◽  
...  

Sign in / Sign up

Export Citation Format

Share Document