Comparison of Resident Self-Evaluation to Standardized Patient Evaluators in a Multi-Institutional Objective Structured Clinical Examination

Background The objective structured clinical examination (OSCE) is a test used throughout Spain to evaluate the clinical competencies, decision making, problem solving, and other skills of sixth-year medical students. Objective The main goal of this study is to explore the possible applications and utility of portable eye-tracking systems in the setting of the OSCE, particularly questions associated with attention and engagement. Methods We used a portable Tobii Glasses 2 eye tracker, which allows real-time monitoring of where the students were looking and records the voice and ambient sounds. We then performed a qualitative and a quantitative analysis of the fields of vision and gaze points attracting attention as well as the visual itinerary. Results Eye-tracking technology was used in the OSCE with no major issues. This portable system was of the greatest value in the patient simulators and mannequin stations, where interaction with the simulated patient or areas of interest in the mannequin can be quantified. This technology proved useful to better identify the areas of interest in the medical images provided. Conclusions Portable eye trackers offer the opportunity to improve the objective evaluation of candidates and the self-evaluation of the stations used as well as medical simulations by examiners. We suggest that this technology has enough resolution to identify where a student is looking at and could be useful for developing new approaches for evaluating specific aspects of clinical competencies.

Download Full-text

Use of Eye-Tracking Technology by Medical Students Taking the Objective Structured Clinical Examination: Descriptive Study (Preprint)

10.2196/preprints.17719 ◽

2020 ◽

Author(s):

M D Grima-Murcia ◽

Francisco Sanchez-Ferrer ◽

Jose Manuel Ramos-Rincón ◽

Eduardo Fernández

Keyword(s):

Medical Students ◽

Eye Tracking ◽

Clinical Examination ◽

Objective Evaluation ◽

Objective Structured Clinical Examination ◽

Eye Tracker ◽

Clinical Competencies ◽

Self Evaluation ◽

Areas Of Interest ◽

Tracking Technology

BACKGROUND The objective structured clinical examination (OSCE) is a test used throughout Spain to evaluate the clinical competencies, decision making, problem solving, and other skills of sixth-year medical students. OBJECTIVE The main goal of this study is to explore the possible applications and utility of portable eye-tracking systems in the setting of the OSCE, particularly questions associated with attention and engagement. METHODS We used a portable Tobii Glasses 2 eye tracker, which allows real-time monitoring of where the students were looking and records the voice and ambient sounds. We then performed a qualitative and a quantitative analysis of the fields of vision and gaze points attracting attention as well as the visual itinerary. RESULTS Eye-tracking technology was used in the OSCE with no major issues. This portable system was of the greatest value in the patient simulators and mannequin stations, where interaction with the simulated patient or areas of interest in the mannequin can be quantified. This technology proved useful to better identify the areas of interest in the medical images provided. CONCLUSIONS Portable eye trackers offer the opportunity to improve the objective evaluation of candidates and the self-evaluation of the stations used as well as medical simulations by examiners. We suggest that this technology has enough resolution to identify where a student is looking at and could be useful for developing new approaches for evaluating specific aspects of clinical competencies.

Download Full-text

The Integration of Child Psychiatry into a Psychiatry Clerkship OSCE

The Canadian Journal of Psychiatry ◽

10.1177/070674379804300610 ◽

1998 ◽

Vol 43 (6) ◽

pp. 614-618 ◽

Cited By ~ 11

Author(s):

Mark Hanson ◽

Brian Hodges ◽

Nancy McNaughton ◽

Glenn Regehr

Keyword(s):

Clinical Examination ◽

Child Psychiatry ◽

Psychiatry Clerkship ◽

Objective Structured Clinical Examination ◽

Standardized Patient ◽

Educational Benefits ◽

Child Psychiatrists

Objective: To integrate child psychiatry into a psychiatry clerkship Objective Structured Clinical Examination (OSCE). Method: Child psychiatry OSCE stations were designed to evaluate clerks' skills in the identification of 4 common conditions. Child psychiatrists wrote case scenarios and checklists and supported standardized patient (SP) training for these stations. A bank of 4 child psychiatry OSCE stations is now available for use in the psychiatry OSCE. Child psychiatry faculty have been trained as examiners for ongoing administration of this OSCE. Results: This bank of child psychiatry OSCE stations has examined 402 clerks. Mean student scores for content were 68% to 86% and for process were 69% to 76%. Station reliability and examiner feedback were acceptable. Conclusions: Child psychiatry has been successfully integrated into a psychiatry clerkship OSCE. Although the commitment in terms of monetary and faculty costs has been considerable, the accompanying educational benefits of such integration warranted this expense.

Download Full-text

Clinical performance of medical students in a whole-task emergency station for the objective structured clinical examination with the standardized patient who complains of palpitation in Korea

Journal of Educational Evaluation for Health Professions ◽

10.3352/jeehp.2020.17.42 ◽

2020 ◽

Vol 17 ◽

pp. 42

Author(s):

Song Yi Park ◽

Hyun-Hee Kong ◽

Min-Jeong Kim ◽

Yoo Sang Yoon ◽

Sang-Hwa Lee ◽

...

Keyword(s):

Medical Students ◽

Clinical Examination ◽

Diagnostic Tests ◽

Clinical Performance ◽

Clinical Skill ◽

Educational Programs ◽

Objective Structured Clinical Examination ◽

Study Patient ◽

Standardized Patient ◽

History Taking

This study assessed the clinical performance of 150 third-year medical students in a whole-task emergency objective structured clinical examination station that simulates a patient with palpitation visiting the emergency department from November 25 to 27, 2019. The clinical performance was as assessed by the frequency and percentage of students who performed history taking (HT), physical examination (PE), electrocardiography (ECG) study, patient education (Ed), and clinical reasoning (CR), which were items on the checklist. There were 18.0% of students checked the patient’s pulse, 51.3% completed an ECG study, and 57.9% explained the results to the patient. There were 38.0% of students who did not even attempt an ECG study. In a whole-task emergency station, students were good at r HT and CR but unsatisfactory to the PE, ECG study, and Ed. Clinical skill educational programs should focus on PE, timely diagnostic tests, and sufficient Ed.

Download Full-text