scholarly journals The Reliability and Validity of a Paediatric Script Concordance Test with Medical Students, Paediatric Residents and Experienced Paediatricians

2010 ◽  
Vol 1 (2) ◽  
pp. e89-e95
Author(s):  
Jean-Francois Lemay ◽  
Tyrone Donnon ◽  
Bernard Charlin
Keyword(s):  
Medical Students ◽  
Clinical Reasoning ◽  
Test Performance ◽  
Reliability And Validity ◽  
Test Format ◽  
Scoring Method ◽  
Internal Reliability ◽  
Script Concordance ◽  
Reasoning Skills ◽  
Clinical Reasoning Skills

Background: The Script Concordance (SC) approach was used as an alternative test format to measure the presence of knowledge organization reflective in one’s clinical reasoning skills (i.e., diagnostic, investigation and treatment knowledge).Methods:  The present study investigated the reliability and validity of a 40-item paediatric version of the SC test with three groups representing 53 medical students (novices), 42 paediatric residents (intermediates) and 11 paediatricians (experts).Results:  A comparison between scoring techniques based on experts’ ratings of the items showed internal reliability coefficients from .74 for the one-best answer up to .78 for alternative scoring techniques.  An ANOVA showed an increase in test performance from medical students through to expert paediatricians (F(2,103) = 84.05, p < .001), but did not differentiate between the postgraduate year 1 to 3 paediatric residents.  A large effect size (Cohen’s d) difference of 1.06 was found between medical students and residents total SC test scores.Conclusions:  These results support other findings indicating the SC test format can be used to differentiate between the clinical reasoning skills of novices, intermediates and experts in paediatrics.  An alternative scoring method that includes one best answer and partial marks was also supported for grading SC test items.

The Use of a Modified Script Concordance Test in Clinical Rounds to Foster and Assess Clinical Reasoning Skills

2021 ◽  
Author(s):  
Jordan D. Tayce ◽  
Ashley B. Saunders
Keyword(s):  
Clinical Reasoning ◽  
Assessment For Learning ◽  
Learning Activity ◽  
Free Text ◽  
Valuable Insight ◽  
Script Concordance Test ◽  
Concordance Test ◽  
Script Concordance ◽  
Reasoning Skills ◽  
Clinical Reasoning Skills

The development of clinical reasoning skills is a high priority during clinical service, but an unpredictable case load and limited time for formal instruction makes it challenging for faculty to foster and assess students’ individual clinical reasoning skills. We developed an assessment for learning activity that helps students build their clinical reasoning skills based on a modified version of the script concordance test (SCT). To modify the standard SCT, we simplified it by limiting students to a 3-point Likert scale instead of a 5-point scale and added a free-text box for students to provide justification for their answer. Students completed the modified SCT during clinical rounds to prompt a group discussion with the instructor. Student feedback was positive, and the instructor gained valuable insight into the students’ thought process. A modified SCT can be adopted as part of a multimodal approach to teaching on the clinic floor. The purpose of this article is to describe our modifications to the standard SCT and findings from implementation in a clinical rounds setting as a method of formative assessment for learning and developing clinical reasoning skills.

Assessing clinical reasoning using a script concordance test with electrocardiogram in an emergency medicine clerkship rotation

2013 ◽  
Vol 31 (4) ◽  
pp. 313-316 ◽  
Author(s):  
Caroline Boulouffe ◽  
Bruno Doucet ◽  
Xavier Muschart ◽  
Bernard Charlin ◽  
Dominique Vanpee
Keyword(s):  
Medical Students ◽  
Clinical Reasoning ◽  
Emergency Physicians ◽  
Internal Reliability ◽  
Medicine Clerkship ◽  
Concordance Test ◽  
Script Concordance ◽  
Post Hoc ◽  
Clerkship Rotation ◽  
Level Of Agreement

ObjectivesScript concordance tests (SCTs) can be used to assess clinical reasoning, especially in situations of uncertainty, by comparing the responses of examinees with those of emergency physicians. The examinee's answers are scored based on the level of agreement with responses provided by a panel of experts. Emergency physicians are frequently uncertain in the interpretation of ECGs. Thus, the aim of this study was to validate an SCT combined with an ECG.MethodsAn SCT-ECG was developed. The test was administered to medical students, residents and emergency physicians. Scoring was based on data from a panel of 12 emergency physicians. The statistical analyses assessed the internal reliability of the SCT (Cronbach's α) and its ability to discriminate between the different groups (ANOVA followed by Tukey's post hoc test).ResultsThe SCT-ECG was administered to 21 medical students, 19 residents and 12 emergency physicians. The internal reliability was satisfactory (Cronbach's α=0.80). Statistically significant differences were found between the groups (F0.271=21.07; p<0.0001). Moreover, significant differences (post hoc test) were detected between students and residents (p<0.001), students and experts (p<0.001), and residents and experts (p=0.017).ConclusionsThis SCT-ECG is a valid tool to assess clinical reasoning in a context of uncertainty due to its high internal reliability and its ability to discriminate between different levels of expertise.

Using the Script Concordance Test to Evaluate Clinical Reasoning Skills in Psychiatry

2016 ◽  
Vol 41 (1) ◽  
pp. 86-90 ◽  
Author(s):  
François Kazour ◽  
Sami Richa ◽  
Marouan Zoghbi ◽  
Wissam El-Hage ◽  
Fady G. Haddad
Keyword(s):  
Clinical Reasoning ◽  
Script Concordance Test ◽  
Concordance Test ◽  
Script Concordance ◽  
Reasoning Skills ◽  
Clinical Reasoning Skills
Sign in / Sign up

Export Citation Format

Share Document