scholarly journals Validity, reliability and feasibility of assessment of cilinical reasoning of medical students by observation versus post encounter assessment in a clinical practice setting.

2020 ◽  
Author(s):  
Catharina Maria Haring ◽  
Claudia Klaarwater ◽  
Geert Bouwmans ◽  
Bernadette Cools ◽  
Petra van Gurp ◽  
...  

Abstract Background The assessment of clinical reasoning by medical students in clinical practice is very difficult. Partly this is because the fundamental mechanisms of clinical reasoning are difficult to uncover and when known, hard to observe and interpret. We developed an observation tool to assess the clinical reasoning ability of medical students during clinical practice. The observation tool consists of an 11-item observation rating form. The validity, reliability and feasibility of this tool were verified among medical students during the internal medicine clerkship and compared to a post-encounter rating tool. Results Six raters assessed each the same 15 student patient encounters. The internal consistency (Cronbach’s alfa) for the observation rating tool (ORT) was 0.87 (0.71-0.84) and the 5-item post encounter rating tool (PERT) was 0.81 (0.71-0.87). The intraclass-correlation coefficient for single measurements was poor for both the ORT; 0.32 (p<0.001) as well as the PERT; 0.36 (p<0.001). The G and D-study showed that 6 raters are required to achieve a G-coefficient of > 0.7 for the ORT and 7 raters for the PERT. The largest sources of variance are the interaction between raters and students. There was a correlation between the ORT and PERT of 0.53 (p=0.04) Conclusions The ORT and PERT are both feasible, valid and reliable instruments to assess students’ clinical reasoning skills in clinical practice.

2020 ◽  
Author(s):  
Catharina Maria Haring ◽  
Claudia Klaarwater ◽  
Geert Bouwmans ◽  
Bernadette Cools ◽  
Petra van Gurp ◽  
...  

Abstract Background The assessment of clinical reasoning by medical students in clinical practice is very difficult. Partly this is because the fundamental mechanisms of clinical reasoning are difficult to uncover and when known, hard to observe and interpret. Methods We developed an observation tool to assess the clinical reasoning ability of medical students during clinical practice. The observation tool consists of an 11-item observation rating form. The validity, reliability and feasibility of this tool were verified among medical students during the internal medicine clerkship and compared to an existing post-encounter rating tool. Results Six raters assessed each, the same 15 student-patient encounters. The internal consistency (Cronbach’s alfa) for the observation rating tool (ORT) was 0.87 (0.71-0.84) and the 5-item post encounter rating tool (PERT) was 0.81 (0.71-0.87). The intraclass-correlation coefficient for single measurements was poor for both the ORT; 0.32 (p<0.001) as well as the PERT; 0.36 (p<0.001). The generalizability study (G-study) and decision study (D-study) showed that 6 raters are required to achieve a G-coefficient of > 0.7 for the ORT and 7 raters for the PERT. The largest sources of variance are the interaction between raters and students. There was a correlation between the ORT and PERT of 0.53 (p=0.04) Conclusions The ORT and PERT are both feasible, valid and reliable instruments to assess students’ clinical reasoning skills in clinical practice.


2020 ◽  
Author(s):  
Catharina Maria Haring ◽  
Claudia Klaarwater ◽  
Geert Bouwmans ◽  
Bernadette Cools ◽  
Petra van Gurp ◽  
...  

Abstract Background Systematic assessment of clinical reasoning skills of medical students in clinical practice is very difficult. This is partly caused by the lack of understanding of the fundamental mechanisms underlying the process of clinical reasoning. Methods We previously developed an observation tool to assess the clinical reasoning skills of medical students during clinical practice. This observation tool consists of an 11-item observation rating form (ORT). In the present study we verified the validity, reliability and feasibility of this tool and of an already existing post-encounter rating tool (PERT) in clinical practice among medical students during the internal medicine clerkshipResults Six raters each assessed the same 15 student-patient encounters. The internal consistency (Cronbach’s alfa) for the (ORT) was 0.87 (0.71-0.84) and the 5-item (PERT) was 0.81 (0.71-0.87). The intraclass-correlation coefficient for single measurements was poor for both the ORT; 0.32 (p<0.001) as well as the PERT; 0.36 (p<0.001). The Generalizability study (G-study) and decision study (D-study) showed that 6 raters are required to achieve a G-coefficient of > 0.7 for the ORT and 7 raters for the PERT. The largest sources of variance are the interaction between raters and students. There was a consistent correlation between the ORT and PERT of 0.53 (p=0.04)Conclusions The ORT and PERT are both feasible, valid and reliable instruments to assess students’ clinical reasoning skills in clinical practice.


2020 ◽  
Author(s):  
Catharina Maria Haring ◽  
Claudia Klaarwater ◽  
Geert Bouwmans ◽  
Bernadette Cools ◽  
Petra van Gurp ◽  
...  

Abstract Background Systematic assessment of clinical reasoning skills of medical students in clinical practice is very difficult. This is partly caused by the lack of understanding of the fundamental mechanisms underlying the process of clinical reasoning. Methods We previously developed an observation tool to assess the clinical reasoning skills of medical students during clinical practice. This observation tool consists of an 11-item observation rating form (ORT). In the present study we verified the validity, reliability and feasibility of this tool and of an already existing post-encounter rating tool (PERT) in clinical practice among medical students during the internal medicine clerkshipResults Six raters each assessed the same 15 student-patient encounters. The internal consistency (Cronbach’s alfa) for the (ORT) was 0.87 (0.71-0.84) and the 5-item (PERT) was 0.81 (0.71-0.87). The intraclass-correlation coefficient for single measurements was poor for both the ORT; 0.32 (p<0.001) as well as the PERT; 0.36 (p<0.001). The Generalizability study (G-study) and decision study (D-study) showed that 6 raters are required to achieve a G-coefficient of > 0.7 for the ORT and 7 raters for the PERT. The largest sources of variance are the interaction between raters and students. There was a consistent correlation between the ORT and PERT of 0.53 (p=0.04)Conclusions The ORT and PERT are both feasible, valid and reliable instruments to assess students’ clinical reasoning skills in clinical practice.


2020 ◽  
pp. postgradmedj-2020-138683
Author(s):  
Yagazie Zina Udeaja ◽  
Rynda Nitiahpapand

The initial period adjusting to the roles and responsibilities of a new foundation doctor can be a challenging and anxious time for graduating medical students and new trainees. Over recent years, many educational initiatives such as shadowing placements, assistantships and compulsory induction programmes have been implemented to improve medical student preparedness for clinical practice. Despite this, many graduates still report a lack of confidence and preparedness when starting their clinical placements, specifically within the context of on-call shifts. Bleep Roulette simulation sessions are progressively being used to further bridge the gap from student to trainee and ensure trainees develop prioritisation, organisational and clinical reasoning skills, improving trainee efficiency during an on-call shift. In this article, we provide 10 tips for medical educators, detailing how to design an efficacious Bleep Roulette session for final year medical students and new foundation trainees.


2021 ◽  
Vol 10 (1) ◽  
pp. 36
Author(s):  
Simin Huang ◽  
Jing Yang ◽  
Feifei Wang ◽  
Jun Guo ◽  
Shengming Liu

Clinical reasoning ability is an important competence for a clinician to have. Undergraduate study is a crucial period to strengthen medical students' clinical reasoning skills. The aim of this study was to explore an effective method for guiding students to improve clinical reasoning skills via a step-by-step presentation of case information. The study was conducted among grade 2015 clinical medicine major students who were studying internal medicine. On the basis of the theoretical study and practical training, a method for the step-by-step presentation of case information was designed and implemented to strengthen students’ clinical reasoning skills. Each case was divided into four modules. Module one focused on inquiry, module two focused on physical examination, module three focused on laboratory tests and module four focused on diagnosis and treatment. Four modules were sent to students in turn as homework. The teacher corrected their answers and feedback was individually given. A questionnaire was conducted at the end of semester to assess the effect. The questionnaire revealed that students were satisfied with this training mode. They thought the mode was helpful for improving clinical reasoning ability and consolidating the basic skills such as history taking and physical examination. In conclusion, this effective method provides a training pattern for developing clinical reasoning skills of medical students. Through the process of analysing clinical cases, students are guided to become familiar with the procedures of solving clinical problems from gathering medical information to establishing diagnosis and treatment plans. It helps students to establish a scientific clinical reasoning mode.


Diagnosis ◽  
2019 ◽  
Vol 6 (2) ◽  
pp. 165-172 ◽  
Author(s):  
Eliana Bonifacino ◽  
William P. Follansbee ◽  
Amy H. Farkas ◽  
Kwonho Jeong ◽  
Melissa A. McNeil ◽  
...  

Abstract Background The National Academies of Sciences report Improving Diagnosis in Healthcare highlighted the need for better training in medical decision-making, but most medical schools lack formal education in clinical reasoning. Methods We conducted a pseudo-randomized and controlled study to evaluate the impact of a clinical reasoning curriculum in an internal medicine clerkship. Students in the intervention group completed six interactive online modules focused on reasoning concepts and a skills-based workshop. We assessed the impact of the curriculum on clinical reasoning knowledge and skills and perception of education by evaluating: (1) performance on a clinical reasoning concept quiz, (2) demonstration of reasoning in hospital admission notes, and (3) awareness of attending physician utilization of clinical reasoning concepts. Results Students in the intervention group demonstrated superior performance on the clinical reasoning knowledge quiz (67% vs. 54%, p < 0.001). Students in the intervention group demonstrated superior written reasoning skills in the data synthesis (2.3 vs. 2.0, p = 0.02) and diagnostic reasoning (2.2 vs. 1.9, p = 0.02) portions of their admission notes, and reported more discussion of clinical reasoning by their attending physicians. Conclusions Exposure to a clinical reasoning curriculum was associated with superior reasoning knowledge and superior written demonstration of clinical reasoning skills by third-year medical students on an internal medicine clerkship.


2016 ◽  
Vol 30 (2) ◽  
pp. 99-103
Author(s):  
Kevin A. Rose ◽  
Jesika Babajanian

Objective: The objective structured practical examination (OSPE) is a case-based assessment that can be used to assess the clinical reasoning ability of students. The reliability of using an OSPE for this purpose has not been reported in the literature. The objective of this study was to determine the interrater reliability of the OSPE in measuring the clinical reasoning ability of chiropractic students. Methods: Two examiners tested each student simultaneously when enough were available as a check for interrater reliability. The scores for students over 4 exam administrations were compiled, and we calculated an intraclass correlation coefficient (ICC) using 1-way random single measures. Results: Paired scores were available for 133 students. The ICC was .685, showing a fair-to-good level of agreement for faculty in assessing the clinical reasoning ability of chiropractic students using an OSPE. Conclusion: The OSPE can be a valuable tool for testing clinical reasoning abilities because it can simulate the decision-making process that needs to be implemented in clinical practice. Faculty members at our chiropractic college were able to achieve an acceptable level of reliability in measuring the clinical reasoning abilities of students using an OSPE. Other health professional programs may consider using this tool for assessing the clinical reasoning skills of their students.


2015 ◽  
Vol 27 (1) ◽  
pp. 37-50 ◽  
Author(s):  
Jennifer R. Kogan ◽  
Jennifer Lapin ◽  
Eva Aagaard ◽  
Christy Boscardin ◽  
Meenakshy K. Aiyer ◽  
...  

2016 ◽  
Vol 34 (1) ◽  
pp. 79-84 ◽  
Author(s):  
Larry D. Cripe ◽  
David G. Hedrick ◽  
Kevin L. Rand ◽  
Debra Burns ◽  
Daniella Banno ◽  
...  

Purpose: More physicians need to acquire the skills of primary palliative care. Medical students’ clerkship experiences with death, dying, and palliative care (DDPC), however, may create barriers to learning such skills during residency. Whether professional development is differentially affected by DDPC is unknown. This knowledge gap potentially hinders the development of educational strategies to optimize students’ preparedness for primary palliative care. Method: Third-year students submitted professionalism narratives (N = 4062) during their internal medicine clerkship between 2004 and 2011. We identified DDPC-related narratives and then randomly selected control narratives. Narratives were compared by valence (positive or negative) and professionalism-related themes. Results and Conclusion: Less than 10% of the narratives were related to DDPC, but the majority was positive. There was a significant overlap in professionalism themes between DDPC and control narratives. The results suggest student preparedness for primary palliative care may be improved by addressing the common professionalism challenges of clinical clerkships.


Sign in / Sign up

Export Citation Format

Share Document