Assessing Clinical Reasoning in Pediatric Emergency Medicine: Validity Evidence for a Script Concordance Test

2009 ◽  
Vol 53 (5) ◽  
pp. 647-652 ◽  
Author(s):  
Benoit Carrière ◽  
Robert Gagnon ◽  
Bernard Charlin ◽  
Steven Downing ◽  
Georges Bordage
2021 ◽  
Vol 8 ◽  
Author(s):  
Osamu Nomura ◽  
Taichi Itoh ◽  
Takaaki Mori ◽  
Takateru Ihara ◽  
Satoshi Tsuji ◽  
...  

Introduction: Clinical reasoning is a crucial skill in the practice of pediatric emergency medicine and a vital element of the various competencies achieved during the clinical training of resident doctors. Pediatric emergency physicians are often required to stabilize patients and make correct diagnoses with limited clinical information, time and resources. The Pediatric Emergency Medicine Script Concordance Test (PEM-SCT) has been developed specifically for assessing physician's reasoning skills in the context of the uncertainties in pediatric emergency practice. In this study, we developed the Japanese version of the PEM-SCT (Jpem-SCT) and confirmed its validity by collecting relevant evidence.Methods: The Jpem-SCT was developed by translating the PEM-SCT into Japanese using the Translation, Review, Adjudication, Pretest, Documentation team translation model, which follows cross-cultural survey guidelines for proper translation and cross-cultural and linguistic equivalences between the English and Japanese version of the survey. First, 15 experienced pediatricians participated in the pre-test session, serving as a reference panel for modifying the test descriptions, incorporating Japanese context, and establishing the basis for the scoring process. Then, a 1-h test containing 60 questions was administered to 75 trainees from three academic institutions. Following data collection, we calculated the item-total correlations of the scores to optimize selection of the best items in the final version of the Jpem-SCT. The reliability of the finalized Jpem-SCT was calculated using Cronbach's α coefficient for ensuring generalizability of the evidence. We also conducted multiple regression analysis of the test score to collect evidence on validity of the extrapolation.Results: The final version of the test, based on item-total correlation data analysis, contained 45 questions. The participant's specialties were as follows: Transitional interns 12.0%, pediatric residents 56.0%, emergency medicine residents 25.3%, and PEM fellows 6.7%. The mean score of the final version of the Jpem-SCT was 68.6 (SD 9.8). The reliability of the optimized test (Cronbach's α) was 0.70. Multiple regression analysis showed that being a transitional intern was a negative predictor of test scores, indicating that clinical experience relates to performance on the Jpem-SCT.Conclusion: This pediatric emergency medicine Script Concordance Test was reliable and valid for assessing the development of clinical reasoning by trainee doctors during residency training.


2020 ◽  
Vol 21 (4) ◽  
Author(s):  
Eric Steinberg ◽  
Ethan Cowan ◽  
Michelle Lin ◽  
Anthony Sielicki ◽  
Steven Warrington

Author(s):  
Jordan D. Tayce ◽  
Ashley B. Saunders

The development of clinical reasoning skills is a high priority during clinical service, but an unpredictable case load and limited time for formal instruction makes it challenging for faculty to foster and assess students’ individual clinical reasoning skills. We developed an assessment for learning activity that helps students build their clinical reasoning skills based on a modified version of the script concordance test (SCT). To modify the standard SCT, we simplified it by limiting students to a 3-point Likert scale instead of a 5-point scale and added a free-text box for students to provide justification for their answer. Students completed the modified SCT during clinical rounds to prompt a group discussion with the instructor. Student feedback was positive, and the instructor gained valuable insight into the students’ thought process. A modified SCT can be adopted as part of a multimodal approach to teaching on the clinic floor. The purpose of this article is to describe our modifications to the standard SCT and findings from implementation in a clinical rounds setting as a method of formative assessment for learning and developing clinical reasoning skills.


2011 ◽  
Vol 33 (6) ◽  
pp. 472-477 ◽  
Author(s):  
Aloysius J. Humbert ◽  
Mary T. Johnson ◽  
Edward Miech ◽  
Fred Friedberg ◽  
Janice A. Grackin ◽  
...  

2012 ◽  
Vol 203 (4) ◽  
pp. 530-534 ◽  
Author(s):  
Thamer Nouh ◽  
Marylise Boutros ◽  
Robert Gagnon ◽  
Susan Reid ◽  
Kenneth Leslie ◽  
...  

2002 ◽  
Vol 41 (3) ◽  
pp. 227-233 ◽  
Author(s):  
Louis Sibert ◽  
Bernard Charlin ◽  
Jacques Corcos ◽  
Robert Gagnon ◽  
Joel Lechevallier ◽  
...  

Sign in / Sign up

Export Citation Format

Share Document