scholarly journals Resident Evaluations: The Use of Daily Evaluation Forms in Rheumatology Ambulatory Care

2009 ◽  
Vol 36 (6) ◽  
pp. 1298-1303 ◽  
Author(s):  
SUSAN HUMPHREY-MURTO ◽  
NADER KHALIDI ◽  
C. DOUGLAS SMITH ◽  
ELZBIETA KAMINSKA ◽  
CLAIRE TOUCHIE ◽  
...  
Keyword(s):  
Internal Medicine ◽  
Clinical Competence ◽  
Clinical Skills ◽  
Faculty Members ◽  
Objective Structured Clinical Examination ◽  
Validity And Reliability ◽  
Point Scale ◽  
Good Reliability ◽  
Evaluation Report ◽  
Internal Medicine Residents

Objective.The in-training evaluation report (ITER) is widely used to assess clinical skills, but has limited validity and reliability. The purpose of our study was to assess the feasibility, validity, reliability, and effect on feedback of using daily evaluation forms to evaluate residents in ambulatory rheumatology clinics.Methods.An evaluation form was developed based on the Royal College of Physicians and Surgeons of Canada CanMEDS roles. There were 12 evaluation items including overall clinical competence. They were rated on a 5-point scale from unsatisfactory to outstanding. All internal medicine residents rotating on rheumatology were strongly encouraged to provide the form to their preceptor at the end of each clinic. A questionnaire was administered to residents and faculty.Results.Seventy-three internal medicine residents completed a 1-month rotation at University of Ottawa (n = 26) and McMaster University (n = 47). Faculty members completed a total of 637 evaluation forms. The number of evaluation forms ranged from 2 to 16 (mean 8.73) per resident. At an average of 8.73 forms per resident the reliability was 0.71 for the composite score. Fourteen forms would be required for a reliability of 0.8. The correlation between the objective structured clinical examination scores and the forms was 0.48 (p = not significant). Faculty and residents reported increased feedback following implementation of the forms.Conclusion.The use of daily evaluation forms is feasible and provides very good reliability. Use of the evaluation forms increases feedback to residents on their performance. The forms were well received by faculty and residents.

scholarly journals Improving Residents' Safe Opioid Prescribing for Chronic Pain Using an Objective Structured Clinical Examination

2016 ◽  
Vol 8 (3) ◽  
pp. 390-397 ◽  
Author(s):  
Daniel P. Alford ◽  
Brittany L. Carney ◽  
Belle Brett ◽  
Sharon J. Parish ◽  
Angela H. Jackson
Keyword(s):  
Internal Medicine ◽  
Chronic Pain ◽  
Clinical Examination ◽  
Academic Medical Center ◽  
Objective Structured Clinical Examination ◽  
Opioid Prescribing ◽  
Internal Medicine Residents ◽  
Number Of Patients ◽  
Safe Opioid Prescribing ◽  
And Control

ABSTRACT  Internal medicine residents care for a sizable number of patients with chronic pain. Programs need educational strategies to promote safe opioid prescribing.Background  To describe a safe opioid prescribing education program utilizing an objective structured clinical examination (OSCE) and report the resulting impact on residents' knowledge, confidence, and self-reported practices.Objective  Using a quasi-experimental design, 39 internal medicine residents from an urban academic medical center were assigned to 1 of 4 groups: 1-hour lecture only, lecture followed by immediate OSCE, lecture followed by 4-month delayed OSCE, and control. Safe opioid prescribing knowledge, confidence, and self-reported practices were assessed at baseline and at 8 months.Methods  At 8 months, knowledge, confidence, and self-reported practices improved in the control and in all 3 intervention groups. The immediate OSCE group had the greatest improvements in combined confidence scores within group (0.74, P = .01) compared to controls (0.52, P = .05), using a 5-point scale. This group also had the greatest improvement in self-reported practice changes (1.04, P = .04), while other groups showed nonsignificant improvements—delayed OSCE (0.43, P = .44), lecture only (0.66, P = .24), and control (0.43, P = .19).Results  Safe opioid prescribing education that includes a lecture immediately followed by an OSCE had an impact on residents' confidence and self-reported practices greater than those for delayed OSCE or lecture only groups. There was no difference in knowledge improvement among the groups. Lecture followed by an OSCE was highly regarded by residents, but required additional resources.Conclusions

scholarly journals The MRCPsych OSCE workshop: a new game to play?

2004 ◽  
Vol 28 (2) ◽  
pp. 62-65 ◽  
Author(s):  
Asim Naeem ◽  
Joan Rutherford ◽  
Chris Kenn
Keyword(s):  
Clinical Examination ◽  
Royal College ◽  
Clinical Competence ◽  
Reliability And Validity ◽  
Objective Structured Clinical Examination ◽  
Current Evidence ◽  
Consecutive Series ◽  
Patient Assessment ◽  
Good Reliability ◽  
The Individual

In line with the Royal College of Psychiatrists' commitment to improve its professional examinations based on the best current evidence, Spring 2003 has seen the introduction of the objective structured clinical examination (OSCE). This has replaced the individual patient assessment (IPA) in the MRCPsych Part I clinical examination. An OSCE consists of a series of time-limited clinical tasks that candidates have to perform in a consecutive series of ‘stations' or booths. They have the advantage of being able to test clinical competence using a number of different scenarios via a standardised format (Katona et al, 2000). Their use has become widespread over recent years, particularly in undergraduate psychiatry exams (Brewin & Cantwell, 1997), as they have good reliability and validity (Hodges et al, 1998). This was confirmed by the College's initial pilot OSCE, which had a κ score of around 0.8 for the examination as a whole (Oyebode, 2002).

Teaching Clinical Skills During Pandemic Times

2022 ◽  
pp. 249-273
Author(s):  
Maria Fernanda Chaparro ◽  
José Alberto Herrera ◽  
Miriam Lizzeth Turrubiates ◽  
Silvia Lizett Olivares Olivares
Keyword(s):  
Medical Students ◽  
Clinical Competence ◽  
Clinical Skills ◽  
Teaching Strategy ◽  
Faculty Members ◽  
Online Resources ◽  
Clinical Simulation ◽  
Healthcare Simulation ◽  
Controlled Environments ◽  
Facilitated Learning

Clinical simulation is a teaching strategy that replicates medical situations in controlled environments. The COVID-19 pandemic created disruptions for healthcare simulation centers. As a response, the Universidad Anáhuac designed online clinical simulation practices and assessments. The pre-intervention survey showed skeptical medical students (59.15%) to continue this learning format. The intervention included neurology, cardiology, and gynecology topics supported by five faculty members and staff. Instruments were examination checklists to evaluate the clinical competence based on a 100 score and the Debriefing Assessment for Simulation in Healthcare (DASH) with a 1 (extremely ineffective) to 7 (extremely effective) score. Students received individual training by Zoom, including simulation practices, debriefing, and assessment. Even though it seemed impossible to address clinical skills by distance, simulation practices continued with online resources. Collaborative participation between faculty, students, and staff facilitated learning during the COVID-19 conditions.

scholarly journals An Audit of the Medical Students’ Perceptions regarding Objective Structured Clinical Examination

2016 ◽  
Vol 2016 ◽  
pp. 1-4 ◽  
Author(s):  
Abidullah Khan ◽  
Maimoona Ayub ◽  
Zakir Shah
Keyword(s):  
Clinical Examination ◽  
Clinical Competence ◽  
Objective Structured Clinical Examination ◽  
Study Group ◽  
Validity And Reliability ◽  
Content Quality ◽  
Medical College ◽  
Similar Survey ◽  
Examination Methods

Objective. To record the perceptions of the final year MBBS students of Khyber Medical College (KMC) Peshawar regarding Objective Structured Clinical Examination (OSCE) conducted in the year 2016.Materials and Methods. This study was conducted in April 2016 which is in fact a reaudit of our similar survey done back in 2015. A total of 250 final year MBBS students participated by filling in a validated and pretested questionnaire already used by Russel et al. and Khan et al. in similar but separate studies including questions regarding exam content, quality of performance, OSCE validity and reliability, and so forth. The data was analyzed using SPSS version 20.Results. The study group comprised 160 (64%) males and 90 (36%) females. 220 (88%) stated that exam was fair and comprehensive; 94% believed OSCE was more stressful and mentally tougher. 96% of the students considered OSCE as valid and reliable and 87% were happy with its use in clinical competence assessment.Conclusion. Majority of students declared their final year OSCE as fair, comprehensive, standardized, less biased, and reliable format of examination but believed it was more stressful and mentally tougher than traditional examination methods.

scholarly journals Performance of Residents Serving as Clinical Teachers: A Student-Based Assessment

2014 ◽  
Vol 6 (1) ◽  
pp. 123-126 ◽  
Author(s):  
Mayowa O. Owolabi ◽  
Adefemi O. Afolabi ◽  
Akinyinka O. Omigbodun
Keyword(s):  
Internal Medicine ◽  
Medical Students ◽  
Clinical Teaching ◽  
Development Program ◽  
Teaching Skills ◽  
Validity And Reliability ◽  
Faculty Development Program ◽  
Clinical Teachers ◽  
Internal Medicine Residents ◽  
Tertiary Teaching

Abstract Background Little is known about the competences of residents as clinical teachers in African health care institutions. Objective We evaluated the clinical teaching skills of internal medicine residents from the perspective of medical students in a tertiary teaching institution in Africa. Methods We used the augmented Stanford Faculty Development Program Questionnaire, which has evidence of validity and reliability. To avoid a Hawthorne effect, students completed the questionnaire anonymously and confidentially after clinical teaching sessions by residents. A minimum score of 4 on a scale of 1 to 5 was defined a priori as possession of good clinical teaching skills. Results Sixty-four medical students assessed all 20 internal medicine residents in the Department of Medicine, University of Ibadan. Mean performance scores for the domains ranged from 3.07 to 3.66. Residents performed best in creating a good learning climate and worst in the promotion of understanding and retention. Sex of the resident, duration of residency, and rank had no significant impact (.09 < P < .94) on their teaching skills. Conclusions Consistent with other observations in the literature, residents' clinical teaching skills were suboptimal, particularly in their ability to promote understanding and retention. To enhance these skills, we recommend the integration of appropriately tailored programs to teach pedagogic skills programs in residency training.

scholarly journals Clinical skills assessment: limitations to the introduction of an "OSCE" (Objective Structured Clinical Examination) in a traditional Brazilian medical school

2004 ◽  
Vol 122 (1) ◽  
pp. 12-17 ◽  
Author(s):  
Luiz Ernesto de Almeida Troncon
Keyword(s):  
Medical School ◽  
Student Perceptions ◽  
Clinical Examination ◽  
Time Management ◽  
Clinical Skills ◽  
Faculty Members ◽  
Objective Structured Clinical Examination ◽  
School Type ◽  
Stress Control ◽  
Structured Questionnaire

CONTEXT: Assessment of clinical skills has a central role in medical education and the selection of suitable methods is highly relevant. The OSCE (Objective Structured Clinical Examination) is now established as one of the most valid, reliable and effective tests for the assessment of clinical skills. OBJECTIVE: To describe student and faculty perceptions of an OSCE introduced in a traditional Brazilian medical school. TYPE OF STUDY: Descriptive, semi-quantitative study. SETTING: Faculdade de Medicina de Ribeirão Preto, Universidade de São Paulo. PARTICIPANTS: 258 junior medical students finishing an introductory course on basic clinical skills and six faculty members deeply involved with the OSCE administration. PROCEDURES: Over a period of three consecutive years, student perceptions on the examination were evaluated using a structured questionnaire containing several five-point scales; faculty members' opinions were collected using a structured questionnaire plus a personal interview. MAIN MEASUREMENTS: Student satisfaction or dissatisfaction with aspects of OSCE administration and positive or negative opinions from faculty members. RESULTS: Students were comfortable with cases and tasks, but nearly half (48%) of them criticized organizational aspects of the OSCE. Substantial proportions of students reported difficulties with both time management (70%) and stress control (70%). Improvement of several aspects of exams reduced criticism of organization to a minority (5%) of students, but the proportions of students reporting difficulties with time management (40%) and stress control (75%) during the exam remained virtually unchanged. Faculty members acknowledged the accuracy of the OSCE, but criticized its limitations for assessing the integrated approach to patients and complained that the examination was remarkably time and effort-consuming. The educational impact of the OSCE was felt to be limited, since other faculty members did not respond to the communication of exam results. CONCLUSIONS: In addition to shortage of resources and organizational difficulties, local cultural aspects and the absence of a more favorable educational climate may hinder lasting improvements in assessment methods in traditional medical schools.

scholarly journals Examining validity and reliability of Objective Structured Clinical Examination for evaluation of clinical skills of midwifery undergraduate students: a descriptive study

2019 ◽  
Author(s):  
Mitra Kolivand ◽  
Marzieh Esfandyari ◽  
Sousan Heydarpour
Keyword(s):  
Undergraduate Students ◽  
Clinical Examination ◽  
Clinical Evaluation ◽  
Clinical Course ◽  
Clinical Skills ◽  
Normal Pregnancy ◽  
Objective Structured Clinical Examination ◽  
Practical Skills ◽  
Validity And Reliability ◽  
The Mean

Abstract BACKGROUND: Clinical evaluation is one of the main pillars of medical education. The Objective Structured Clinical Examination is one of the commonly adopted practical tools to evaluate clinical and practical skills of medical students. Validity and reliability of the tool to evaluate clinical skills of midwifery undergraduate students in Kermanshah Midwifery Nursing School were examined. METHODS: Seven clinical skills were evaluated in this descriptive correlative study using a performance checklist. Thirty-two midwifery students performed the skills at seven stations each monitored by an observer using an evaluation checklist. Criterion-related validity was obtained through determining the correlation between the clinical courses point and the Objective Structured Clinical Evaluation score. The collected data was analyzed in SPSS (v.20) and logistic regression test. RESULTS: The correlation score of Objective Structured Clinical Examination was significantly related to the mean score of clinical course “Normal Pregnancy I” (0.319, p=0.075), the mean score of clinical course “Normal and Abnormal delivery I” (0.399, p=0.024), the mean score of clinical course “gynaecology “ (0.419, p=0.017) and total average scores(0.23, p=0.200). The correlation between the total score and mean score of students at the stations showed that out of the seven stations, the correlations of the stations three (communication and collecting medical history) and four (childbirth) were not significant. CONCLUSION: Although it appeared that Objective Structured Clinical Examination was one of the effective and efficient ways to evaluate clinical competencies and practical skills of students, the tool could not evaluate all the aspects.

Sign in / Sign up

Export Citation Format

Share Document