OSCE 3D: a virtual clinical skills assessment tool for coronavirus pandemic times

Introduction: In pandemic times, in which the “lockdown strategy” has been adopted, the use of innovations using technological resources such as the creation of instruments that can replace traditional teaching-learning methods in the training of health professionals is essential. Objective: the aim of this study was to develop and evaluate the usability of a realistic interactive simulation computer system using three-dimensional imaging technology and virtual reality with free-access computational tools available on the web. Methods: the development of a prototype (OSCE 3D) was based on the steps used for the construction of a “Serious Game” simulation software. The free-access version of the Unity Editor 3D platform (Unity Technologies, version 2018), used for developing educational games, the software GNU Image Manipulation Program (GIMP, version 2.10.12), Blender (version 2.79) and MakeHuman (version 1.1.1) were utilized for creating textures and building models of the 3D environments. An experimental phase was carried out to assess usability, through a questionnaire based on the System Usability Scale. The study was approved by the Research Ethics Committee of the institution and all participants signed the Informed Consent Form. Results: a total of 39 undergraduate medical students attending the 6th semester of a private university center of northeastern Brazil voluntarily participated in the evaluation of the OSCE 3D. The usability evaluation resulted in a mean score of 75.4 with a margin of error of 3.2, which is considered a good usability score according to the literature. Conclusions: this study allowed the development of a low-cost prototype, using a three-dimension realistic simulation system for clinical skills assessment. This product, even in the prototype phase, showed good usability.

Clinical skills assessment and feedback in pediatric residency

Introduction: A medical residency is the specialization par excellence in medical training and the program is responsible for ensuring that the recently graduated doctor reaches the established level of competence. A well-prepared assessment system with feedback is an effective tool to enhance the performance of future specialists and guarantee their qualification. Objective: To analyze the assessment system for pediatric residents at a university hospital, aiming to promote teaching training in assessment methods. Methodology: educational action research (research-teaching), conducted with teachers and preceptors in the pediatric residency of a university hospital. The stages consisted of: a) the application of a questionnaire on participant profile and assessment methods used to evaluate the medical residents; b) intervention (workshop) on the assessment of clinical skills and feedback; c) immediate assessment after the workshop, by applying another questionnaire based on level 1 of the Kirkpatrick model. Simple statistical analysis was used for the objective data and the content analysis, according to recommendations by Malheiros (2011) and Bardin (2013), for the qualitative part. Result: Ten (48%) of the 21 participants declared not being formally trained in assessment and that they applied the more traditional methods learned from personal experience. Regarding the assessment methods, 81% (17/21) of the participants used more than one, aiming to obtain a more encompassing and reliable assessment. However, none of the teachers/preceptors used a systematized assessment of the clinical skills or provided feedback to the medical residents. After the workshop, with a focus on assessing performance in a simulated ‘Objective Structured Clinical Examination’ (OSCE) environment, all the participants were favorable to apply the OSCE in their teaching-learning practice with residents and undergraduate students, reaching Kirkpatrick level 3. Conclusion: The action research helped identify limitations in the assessment and feedback system of the pediatric resident physician. The methodology used revealed an aggregating effect and contributed to the development of the collaborative and integrative sense in the group. However, it was not enough to positively interfere with the pediatric medical residency assessment in the short term.

Teaching Medical Students How to Ask Older Adults What Matters Using Simulated Patients

It is vital the workforce is prepared to meet the medical needs of our aging population. Asking older adults What Matters is an important aspect of excellence in clinical care. During a small group session in a two-year communication skills course, second year medical students (N=149) at Rush were taught how to ask What Matters as part of the 4Ms. Students then completed a video recorded Communication Skills Lab with a simulated older adult patient as they practiced how to discuss What Matters. Students then met with their instructors in individual feedback sessions to review the video and discuss strengths and areas for improvement in communicating with older adults. Students then completed a Clinical Skills Assessment for formal testing of their communication skills with older adults. Outcomes of the summative assessment will be presented and recommendations for integrating 4Ms into existing medical school and allied health curriculum will be discussed.

OSCE 3D: a virtual clinical skills assessment tool for coronavirus pandemic times

Background : In pandemic times where the “lockdown strategy” has been adopted, the use of innovations using technological resources such as the creation of instruments that can replace traditional teaching-learning methods in the training of health professionals is essential. The aim of this study was to develop and evaluate the usability of a realistic interactive simulation computer system using three-dimensional imaging technology and virtual reality with free-access computational tools available on the web. Methods : the development of a prototype (OSCE 3D) was based on the steps used for the construction of simulation software of a "Serious Game". An experimental phase was carried out to assess usability, through a questionnaire based on the System Usability Scale. The study was approved by the Research Ethics Committee of the institution and all patients signed the Informed Consent Form. Results : a total of 39 undergraduate medical students from the 6th semester of a private university center of northeast do Brazil voluntarily participated in the evaluation of the OSCE 3D. The usability evaluation presented a mean score of 75.4 with a margin of error of 3.2, considered a good usability according to the literature. Conclusions : this work allowed the development of a low-cost prototype, using a three-dimension realistic simulation system for OSCE assessment stations. This product, even in the prototype phase, showed good usability.