scholarly journals Faculty Versus Resident Self-Assessment Using Pathology Milestones: How Aligned Are We?

2021 ◽  
Vol 8 ◽  
pp. 237428952110605
Author(s):  
Sienna Athy ◽  
Geoffrey Talmon ◽  
Kaeli Samson ◽  
Kimberly Martin ◽  
Kari Nelson
Keyword(s):  
Communication Skills ◽  
Medical Knowledge ◽  
Knowledge Systems ◽  
Self Assessment ◽  
Self Evaluation ◽  
Evaluation Scores ◽  
Significant Difference ◽  
Discrepancy Scores ◽  
Question Category ◽  
Clinical Competency Committee

Competent physicians must be able to self-assess skill level; however, previous studies suggest that medical trainees may not accurately self-assess. We utilized Pathology Milestones (PM) data to determine whether there were discrepancies in self- versus Clinical Competency Committee (CCC) ratings by sex, program year (PGY), time of evaluation, and question category (Patient Care, Medical Knowledge, Systems-Based Practice [SBP], Practice-Based Learning and Improvement [PBL], Professionalism [PRO], and Interpersonal and Communication Skills) and Residency In-Service Examination (RISE) score. We completed retrospective analyses of PM evaluation scores from 2016 to 2019 (n = 23 residents) 2 times per year. Discrepancies in evaluation scores were calculated by subtracting CCC scores from resident self-evaluation scores. There was no significant difference in discrepancy scores between male versus female residents (P = .94). Discrepancy scores among all PGYs were significantly different (P < .0001), with PGY1 tending to overrate the most, followed by PGY2. PGY3 and PGY4 underrated themselves on average compared to CCC ratings, with PGY4 having significantly lower self-ratings than CCC compared to any other PGY. In January, residents underscored themselves and in July residents overscored themselves compared to CCC (P < .0001 for both). Question types resulted in variable discrepancy scores, with SBP significantly lower than and PRO significantly higher than all other categories (P < .05 for both). Increases in RISE score correlated to increases in self- and CCC-scoring. These discrepancies can help trainees improve self-assessment. Discrepancies indicate potential areas for amelioration, such as curriculum adjustments or Milestone’s verbiage.

scholarly journals Student Potential for Self-assessment in a Clinical Dentistry Practical Training Course on Communication Skills

2020 ◽  
Vol 30 (4) ◽  
pp. 1503-1513
Author(s):  
Asami Iguchi ◽  
Yuh Hasegawa ◽  
Kazuyuki Fujii
Keyword(s):  
Communication Skills ◽  
Faculty Evaluation ◽  
Dental Students ◽  
Practical Training ◽  
Self Assessment ◽  
Actual Performance ◽  
Training Course ◽  
Self Evaluation ◽  
Faculty Expectations ◽  
Evaluation Scores

AbstractThis study aimed to investigate student potential for self-assessment in a clinical dentistry practical training course focused on communication skills. Participants were 124 fourth-year students (70 males, 54 females; all Japanese) in 2017 and 2018 at the Nippon Dental University, School of Life Dentistry at Niigata. Participating students belonged to different cohorts in 2017 and 2018. Participants were asked to complete a self-evaluation sheet at the end of each unit of the course. Their self-evaluation scores and the faculty evaluation scores for each student for Units 1-1, 1-2, and 1-3 were statistically analyzed. The results showed that females tended to rate themselves significantly higher than males. Furthermore, there were significant differences in evaluation scores between students and faculty for nine of 11 evaluation items for male students and 10 of 11 items for female students in Unit 1-3. Faculty expectations increased from Unit 1-1 to Unit 1-3, although students were satisfied with their performance and had a sense of achievement. However, students’ actual performance was below faculty expectations, suggesting faculty evaluations were stricter than students’ self-evaluation. Self-assessment may enhance students’ ability for self-directed learning and may also inform how faculty can effectively educate dental students. Dental educators should support students to increase their levels of self-efficacy, which will enhance their self-evaluation skills.

Flight Performance and Mental Stress of Pilots by Verbal Reports and Spatial Disorientation

2020 ◽  
Vol 64 (1) ◽  
pp. 134-138
Author(s):  
Yohan Kang ◽  
Myung Hwan Yun ◽  
Sungho Kim
Keyword(s):  
Mental Stress ◽  
Flight Performance ◽  
Verbal Reports ◽  
Subjective Stress ◽  
Self Evaluation ◽  
Spatial Disorientation ◽  
Instructor Evaluation ◽  
Evaluation Scores ◽  
Significant Difference ◽  
Stress Levels

Spatial disorientation (SD) can adversely affect a pilot’s flight mission and cause critical flight accidents. To ensure a pilot’s flight safety, it is important to understand the impact of SD on a pilot’s flight performance and mental stress levels, and it is necessary to verify the effectiveness of using verbal reports (VR) for pilots to overcome SD without the aid of aeronautical systems. Therefore, the purpose of this study is to analyze the difference in pilot performance and mental stress levels by VR executions and SD types. In this study, simulated flight experiments were performed on thirty Air Force fighter pilots (fifteen VR and fifteen non-VR) using a SD simulator with an Electrocardiography (ECG) measurement sensor attached. The experimental data was analyzed with using two flight performance scales (instructor evaluation scores and self-evaluation scores) and two mental stress scales (heart rate variability (HRV) measures and subjective stress scores) by two VR executions (VR and non-VR) and six SD types (Somatogravic Illusion, Coriolis, Leans, False Horizon, Graveyard Spin, and Black Hole Illusion). The result of the experiment, in terms of flight performance, showed a significant difference in instructor evaluation scores for VR execution, and in both instructor evaluation scores and self-evaluation scores for SD types. On the other hand, in terms of mental stress, there was a significant difference in both high frequency (HF) of HRV measures and subjective stress scores for VR execution, and in subjective stress scores for SD types. The results of this study can help pilots understand SD situations and overcome SD by executing VR.

scholarly journals Effect of Clinician Feedback Versus Video Self-Assessment in 5th-Year Chiropractic Students on an End-of-Year Communication Skills Examination

2010 ◽  
Vol 24 (2) ◽  
pp. 165-174 ◽  
Author(s):  
Mark D. Hecimovich ◽  
Jo-Anne Maire ◽  
Barrett Losco
Keyword(s):  
Communication Skills ◽  
Analysis Of Variance ◽  
Learning Opportunities ◽  
T Test ◽  
History Taking ◽  
Immediate Feedback ◽  
Self Assessment ◽  
Significant Difference ◽  
Self Assessments ◽  
Chiropractic Students

Purpose: To compare the effect of two learning opportunities, clinician feedback and video self-assessment, on 5th-year chiropractic students' patient communication skills, specifically those required for history taking. Methods: A cohort of 51 final-year students was divided into two groups. The first group received immediate feedback from a clinical supervisor following a history-taking encounter with a patient. The second group performed self-assessments of their videotaped history-taking encounter. An end-of-year Viva Voce examination was used to measure the effectiveness of the students' history-taking skills, using two subscores, one for behavior and another for content, as well as an overall total score. An unpaired t-test was performed to determine whether any significant difference occurred between the two groups of students. Each group was then subdivided into two subgroups based on gender, and a two-way analysis of variance was performed to determine whether the type of feedback or the students' gender had any significant effect on the outcome of the Viva Voce. Results: There were no significant differences between the two groups of students in terms of their final scores in the Viva Voce. After dividing each group into their gender subgroups and further analysis of the results, neither the mode of feedback nor the students' gender had any significant effect on the outcome of the Viva Voce. Conclusion: This study suggests that, for a mixed cohort, video self-assessment and clinician feedback are equivalent in their ability to enhance students' communication skills relating to history taking.

scholarly journals Autoevaluación y desarrollo de habilidades comunicativas en profesores universitarios mediante e-rúbricas y grabaciones.

2015 ◽  
Vol 13 (1) ◽  
pp. 257
Author(s):  
Julián De la Fuente ◽  
Eva Asensio Castañeda ◽  
Illene Smalec ◽  
Ascensión Blanco
Keyword(s):  
Communication Skills ◽  
Professional Training ◽  
English Language ◽  
Assessment Tools ◽  
Self Directed Learning ◽  
Action Research Project ◽  
Self Assessment ◽  
University Teachers ◽  
Academic Progression ◽  
Self Evaluation

<p>Este artículo recoge los resultados de un proyecto de Investigación-Acción centrado en el desarrollo de la competencia de habilidades de comunicación oral (verbal y no verbal) en docentes universitarios de diferentes áreas académicas, que pretenden mejorar estas habilidades en el idioma inglés, como complemento a su formación profesional y como herramienta de mejora en el aula. Nuestra propuesta ha consistido en utilizar una misma metodología de trabajo y herramientas de evaluación, a través de e-rúbricas y grabaciones audiovisuales.<br />Los resultados demuestran que los participantes toman conciencia de sus objetivos de aprendizaje y progresión académica a través del uso de e-rúbricas y grabaciones audiovisuales. Este método tiene un gran potencial para la auto-evaluación. De la misma manera, el uso de rúbricas para la evaluación cooperativa es frecuente, no así la auto-evaluación que fomenta el aprendizaje autónomo en profesores.</p><p><strong>ABSTRACT</strong></p><p><strong>Self-assessment and development of communication skills in university teachers through the use of e-rubrics and recordings.</strong></p><p>This article presents the results of an action research project focused on the development of competence in verbal and non-verbal communication skills in university teachers from different academic areas, which aim to improve these skills in the English language, as a complement to professional training and as a tool for improvement in the classroom. Our approach has been to use the same methodology and assessment tools, through the use of e-rubrics and audiovisual recordings.<br />The results demonstrate that participants become aware of their learning objectives and academic progression through the use of e-rubrics and audiovisual recordings. This method has great potential for self-evaluation. Similarly, the use of rubrics for cooperative evaluation is used frequently, but not self-assessment in teachers, which promotes self-directed learning.</p>

scholarly journals “I Drive Well, the Problem is the Other Driver”: A Study About the Self-Assessment of the Ability to Drive

2021 ◽  
Vol 30 (2) ◽  
Author(s):  
Eduarda Lehmann Bannach ◽  
Alessandra Sant´Anna Bianchi
Keyword(s):  
The Self ◽  
The Other ◽  
Self Assessment ◽  
Driving Experience ◽  
Self Evaluation ◽  
Demographic Questionnaire ◽  
Significant Difference ◽  
Self Assessments ◽  
Ability To Drive ◽  
Better Than

This study aims to verify the self-evaluation that people make about their ability to drive and investigate whether there is a difference between self-evaluation and evaluation about their friends’ abilities. To this end, 151 people answered three different questionnaires, one questionnaire about driving abilities (self-evaluation and evaluation of friends), the Driver’s Behavior Questionnaire and a socio-demographic questionnaire The sample consisted of 50.3% of males with a mean age of 25.32 years (sd = 1.66). As a result, self-evaluation was positively correlated with age, evaluation of friend, weekly driving hours, Common Violations, and Aggressive Violations. In addition, there was significant difference between evaluation by sex: males carry out self-assessments in a more positive way. It was also found that people evaluate themselves better than they evaluate their friends. From this research, it is possible to think the target audience that would most benefit from an intervention to reduce self-evaluation, that is, men, people over 24 years old, and people who have more driving experience.

Student Self-Assessment and Self-Evaluation

1996 ◽  
Vol 89 (7) ◽  
pp. 548-554 ◽  
Author(s):  
Virginia Stallings ◽  
Carol Tascione
Keyword(s):  
High School ◽  
Communication Skills ◽  
Alternative Assessment ◽  
Evaluation Process ◽  
School Mathematics ◽  
College Mathematics ◽  
Self Assessment ◽  
Self Evaluation ◽  
Mathematics Vocabulary ◽  
Assessment Standards

Current recommendations for alternative assessment call for more student involvement in the evaluation process. Although very little research on student self-evaluation has been carried out beyond determining how well students' perceptions of their achievement align with their teacher's perceptions, the Assessment Standards for School Mathematics (NCTM 1995) supports activities that involve students in evaluating their own progress. According to the Assessment Standards, student self-assessment can be used to improve students' confidence in their ability to do mathematics and allow them to become more independent in their learning of mathematics. We have employed student self-assessment and self-evaluation in our high school and college mathematics classes and have found that the processes engage students in evaluating their progress, aid in developing their communication skills, and increase their mathematics vocabulary. Most important, students reflect on their understanding of mathematics and on their ability to learn mathematics. Although our procedures differ somewhat, as we describe subsequently, our goal of involving students in the evaluation process is the same.

scholarly journals Guiding Residency Program Educational Goals Using Institutional Keyword Reports from the Ophthalmic Knowledge Assessment Program Examination

2020 ◽  
Vol 12 (02) ◽  
pp. e234-e238
Author(s):  
Isdin Oke ◽  
Steven D. Ness ◽  
Jean E. Ramsey ◽  
Nicole H. Siegel ◽  
Crandall E. Peeler
Keyword(s):  
Residency Program ◽  
High Variability ◽  
Knowledge Assessment ◽  
Data Driven ◽  
Educational Goals ◽  
Residency Programs ◽  
Percent Correct ◽  
Self Evaluation ◽  
Assessment Program ◽  
Significant Difference

Abstract Introduction Residency programs receive an institutional keyword report following the annual Ophthalmic Knowledge Assessment Program (OKAP) examination containing the raw number of incorrectly answered questions. Programs would benefit from a method to compare relative performance between subspecialty sections. We propose a technique of normalizing the keyword report to determine relative subspecialty strengths and weaknesses in trainee performance. Methods We retrospectively reviewed our institutional keyword reports from 2017 to 2019. We normalized the percentage of correctly answered questions for each postgraduate year (PGY) level by dividing the percent of correctly answered questions for each subspecialty by the percent correct across all subsections for that PGY level. We repeated this calculation for each PGY level in each subsection for each calendar year of analysis. Results There was a statistically significant difference in mean performance between the subspecialty sections (p = 0.038). We found above average performance in the Uveitis and Ocular Inflammation section (95% confidence interval [CI]: 1.02–1.18) and high variability of performance in the Clinical Optics section (95% CI: 0.76–1.34). Discussion The OKAP institutional keyword reports are extremely valuable for residency program self-evaluation. Performance normalized for PGY level and test year can reveal insightful trends into the relative strengths and weaknesses of trainee knowledge and guide data-driven curriculum improvement.

617 Who Benefits the Most from Burn Camps?

2021 ◽  
Vol 42 (Supplement_1) ◽  
pp. S162-S163
Author(s):  
Jennifer B Radics-Johnson ◽  
Daniel W Chacon ◽  
Li Zhang
Keyword(s):  
Retrospective Review ◽  
Burn Injury ◽  
Statistical Significance ◽  
Categorical Variables ◽  
P Value ◽  
Continuous Variables ◽  
Self Evaluation ◽  
Significant Difference ◽  
Return Home ◽  
The Impact

Abstract Introduction Burn camps provide a unique environment and activities for children that have experienced a burn-injury. Positive outcomes from attending burn camp include increased self-esteem, decreased feelings of isolation and a greater sense of self-confidence. In a 3-year retrospective review of camper evaluations from one of the largest and longest running week-long burn camps in the nation for ages 5–17, we aimed to assess if a child’s gender, age, TBSA or ethnicity affected the impact that burn camp had on a child. Methods A 3-year retrospective review of a Burn Camp’s camper evaluation forms was conducted for campers that attended burn camp between 2017–2019. Camp rosters were reviewed to determine the camper gender, age, TBSA and ethnicity. Camper self-evaluation forms completed at the end of each camp session were reviewed to record camper responses to questions regarding their opinions on the impact camp had on them as well as how camp will impact their lives once they return home. Categorical variables were summarized as frequency and percentage, and continuous variables were described as median and range. To check the relationship between two categorical variables, Chi-square test was used. To compare the continuous variable among groups, Kruskal-Wallis ANOVA was used. Statistical significance was declared based on a p value&lt; 0.5. Results Within 2017–2019, there were 413 camper records. Participants’ demographic characteristics are summarized in Table 1. There were 208 males (50.3%) and 205 females (49.6%). The median age of campers were 11.86, 12.44 and 12.45 for 2017–2019, with the range from 5.16 years to 17.96 years. The median TBSA were 20, 20 and 18 for 2017–2019, with the range from 0.08 to 90. Collectively there were 47.7% Hispanic (n= 197); 24.2% Whites (n=100); 13.1% Black (n= 54); 4.6% Asian (n=19) and 7.7% Other (n=32). There were 395 camper self-evaluation forms submitted. Results of three questions there we were interested in are summarized collectively in Table 2. 57% of campers responded, “Yes, Definitely” to the question “After going to this event, will you feel more comfortable being around your classmates or friends?” 54% responded, “ Yes, Definitely” to the question “Do you feel more confidents in sharing your burn story with others when returning home?” and 51% responded “Yes, Definitely” to “Did you learn anything that will help you when you return home?” Conclusions In analyzing the camper responses, there was no statistically significant difference in responses comparing gender, age, TBSA or ethnicity.

scholarly journals Efficacy of Self-Directed Learning in the Supracondylar Fracture Performance Improvement Module at an Academic Pediatric Orthopedic Institution

2018 ◽  
Vol 2018 ◽  
pp. 1-6 ◽  
Author(s):  
Eric W. Edmonds ◽  
John W. Kemppainen ◽  
Joanna H. Roocroft ◽  
John Munch ◽  
Tracey P. Bastrom
Keyword(s):  
Patient Outcomes ◽  
Supracondylar Fracture ◽  
The Self ◽  
Medical Society ◽  
Self Assessment ◽  
Life Long Learning ◽  
Junior Staff ◽  
Supracondylar Humerus Fractures ◽  
Significant Difference ◽  
Pediatric Orthopedic

Maintenance of certification (MOC) within a medical society requires continuing medical education that demonstrates life-long learning, cognitive expertise, and practice-based self-assessment. This prospective study sought to evaluate whether a self-directed Practice Improvement Module (PIM) would improve pediatric orthopedic patient outcomes, thus demonstrating evidence of life-long learning (Part II MOC credit) in treating supracondylar humerus fractures. Six surgeons and 113 patients were included. There was no significant difference in actual fracture outcome before or after PIM at any level of surgeon experience regarding radiographic appearance or need for reoperation (p>0.10). Junior staff demonstrated a statistically significant improvement in the percentage of time that marking the operative site was documented in the chart by the surgeon before (38%) and after (65%) PIM (p=0.02). The self-directed education portion of the supracondylar fracture PIM led to modest improvement in documentation habits among junior staff, without impact on overall patient outcomes. Therefore, the PIM appears to be less useful in providing evidence for life-long learning as it relates to surgical outcomes (Part II MOC/CME), yet, it may directly benefit practice-based self-assessment (Part IV MOC), and the self-assessment and Personal Improvement Plan may be the most important portion of the PIM to improve outcomes.

Sign in / Sign up

Export Citation Format

Share Document