scholarly journals Guiding Residency Program Educational Goals Using Institutional Keyword Reports from the Ophthalmic Knowledge Assessment Program Examination

2020 ◽  
Vol 12 (02) ◽  
pp. e234-e238
Author(s):  
Isdin Oke ◽  
Steven D. Ness ◽  
Jean E. Ramsey ◽  
Nicole H. Siegel ◽  
Crandall E. Peeler

Abstract Introduction Residency programs receive an institutional keyword report following the annual Ophthalmic Knowledge Assessment Program (OKAP) examination containing the raw number of incorrectly answered questions. Programs would benefit from a method to compare relative performance between subspecialty sections. We propose a technique of normalizing the keyword report to determine relative subspecialty strengths and weaknesses in trainee performance. Methods We retrospectively reviewed our institutional keyword reports from 2017 to 2019. We normalized the percentage of correctly answered questions for each postgraduate year (PGY) level by dividing the percent of correctly answered questions for each subspecialty by the percent correct across all subsections for that PGY level. We repeated this calculation for each PGY level in each subsection for each calendar year of analysis. Results There was a statistically significant difference in mean performance between the subspecialty sections (p = 0.038). We found above average performance in the Uveitis and Ocular Inflammation section (95% confidence interval [CI]: 1.02–1.18) and high variability of performance in the Clinical Optics section (95% CI: 0.76–1.34). Discussion The OKAP institutional keyword reports are extremely valuable for residency program self-evaluation. Performance normalized for PGY level and test year can reveal insightful trends into the relative strengths and weaknesses of trainee knowledge and guide data-driven curriculum improvement.

2021 ◽  
Vol 13 (02) ◽  
pp. e242-e246
Author(s):  
Chandruganesh Rasendran ◽  
Sarah Rahman ◽  
Uthman Younis ◽  
Raoul Wadhwa ◽  
Manasvee Kapadia ◽  
...  

Abstract Background Instead of the traditional in-person interviews, the 2020 to 2021 ophthalmology application cycle was conducted with virtual interviews due to coronavirus disease 2019 (COVID-2019). Little is known about differences between the results of this application cycle with previous years. Objectives The aim of this study was to determine the effect of virtual interviews on the geographic distribution of matched ophthalmology residency applicants. Methods Information was collected on the medical school location and matched residency program location for 2020 to 2021 applicants as well as applicants during the 2016 to 2017, 2017 to 2018, and 2018 to 2019 cycles from publicly available Web sites. Pearson chi-squared tests were conducted to determine whether there was a significant difference in the proportion of applicants matching in the same region, state, and institution as their medical schools in the 2020 to 2021 interview cycle when compared with past cycles. Results Three-hundred seventy-five applicants from 2020 to 2021 and 1,190 applicants from 2016 to 2019 application cycles were analyzed. There was no difference in the type of medical school attended (allopathic vs. osteopathic vs. international medical graduate) (p = 0.069), the likelihood of attending a residency program in the same region as the home medical school (54% for 2020–2021 vs. 57% for 2016–2019 applicants, p = 0.3), and the likelihood of attending a residency program in the same state as the home medical school (31 vs. 28%, p = 0.2). There was a higher likelihood of applicants during the 2020 to 2021 cycle matching at a residency program affiliated with their home medical school than previous cycles (23 vs. 18%, p = 0.03). Conclusions Virtual interviews did not increase the likelihood of medical students staying in the same region or state as their medical school, while there was a higher likelihood of applicants matching at residency programs at institutions affiliated with their medical schools. A hybrid approach to maintain geographic diversity of applicants' final residency programs involving virtual interviews with the addition of in-person away rotations is suggested.


2020 ◽  
Vol 12 (02) ◽  
pp. e267-e272
Author(s):  
Todd W. Altenbernd

Abstract Background The Accreditation Council for Graduate Medical Education's ophthalmology-specific program requirements indicate that a resident must participate in 360 hours of educational activities over the course of residency. The requirements allow a variety of options by which this educational process may occur. Furthermore, the current generation of learners has used a large array of learning tools in their careers: digital media, online resources, question banks, flipped classrooms, problem-based learning, and asynchronous lectures in addition to the traditional face-to-face didactic lectures. Objectives This article determines if the traditional face-to-face didactic lectures play a significant role in the education of ophthalmology residents, attempts to quantitate this role, and estimates the relative importance of this method. Methods Lecture hours beginning immediately after an Ophthalmic Knowledge Assessment Program (OKAP) examination and up to the subsequent exam was tabulated for 40 residents over 8 years. From 2012 through 2019 each of the residents took the OKAP exam one to three times. The average overall OKAP score for each resident was then regressed against his or her logged hours of didactics that year. This rate of average OKAP score to lecture hours was then evaluated for significant differences on the basis of postgraduate year (PGY). “STATA 13.1 IC,” was used for all statistical analysis. Conclusion Traditional synchronous didactic lectures play a statistically significant role in the education of ophthalmology residents. For each 3.5 hours of lectures per year there is a 1% increase in the average OKAP score, p = 0.0064. However, the amount of variability explained by this single factor is low, R 2 = 0.067, and other factors are presumed to play a large part in learning. PGY subgroup analysis showed significant difference in the OKAP performance to lecture hour relationship, the number of lecture hours attended, and the OKAP performance.


2021 ◽  
Vol 13 (01) ◽  
pp. e88-e94
Author(s):  
Alyssa M. Kretz ◽  
Jennifer E. deSante-Bertkau ◽  
Michael V. Boland ◽  
Xinxing Guo ◽  
Megan E. Collins

Abstract Background While ethics and professionalism are important components of graduate medical education, there is limited data about how ethics and professionalism curricula are taught or assessed in ophthalmology residency programs. Objective This study aimed to determine how U.S. ophthalmology residency programs teach and assess ethics and professionalism and explore trainee preparedness in these areas. Methods Directors from accredited U.S. ophthalmology residency programs completed an online survey about components of programs' ethics and professionalism teaching curricula, strategies for assessing competence, and trainee preparedness in these areas. Results Directors from 55 of 116 programs (46%) responded. The most common ethics and professionalism topics taught were informed consent (38/49, 78%) and risk management and litigation (38/49, 78%), respectively; most programs assessed trainee competence via 360-degree global evaluation (36/48, 75%). While most (46/48, 95%) respondents reported that their trainees were well or very well prepared at the time of graduation, 15 of 48 (31%) had prohibited a trainee from graduating or required remediation prior to graduation due to unethical or unprofessional conduct. Nearly every program (37/48, 98%) thought that it was very important to dedicate curricular time to teaching ethics and professionalism. Overall, 16 of 48 respondents (33%) felt that the time spent teaching these topics was too little. Conclusion Ophthalmology residency program directors recognized the importance of an ethics and professionalism curriculum. However, there was marked variation in teaching and assessment methods. Additional work is necessary to identify optimal strategies for teaching and assessing competence in these areas. In addition, a substantial number of trainees were prohibited from graduating or required remediation due to ethics and professionalism issues, suggesting an impact of unethical and unprofessional behavior on resident attrition.


2010 ◽  
Vol 2 (2) ◽  
pp. 278-282 ◽  
Author(s):  
Colleen Y. Colbert ◽  
Curtis Mirkes ◽  
Paul E. Ogden ◽  
Mary Elizabeth Herring ◽  
Christian Cable ◽  
...  

Abstract Background Education about advance directives typically is incorporated into medical school curricula and is not commonly offered in residency. Residents' experiences with advance directives are generally random, nonstandardized, and difficult to assess. In 2008, an advance directive curriculum was developed by the Scott & White/Texas A&M University System Health Science Center College of Medicine (S&W/Texas A&M) internal medicine residency program and the hospital's legal department. A pilot study examining residents' attitudes and experiences regarding advance directives was carried out at 2 medical schools. Methods In 2009, 59 internal medicine and family medicine residents (postgraduate year 2–3 [PGY-2, 3]) completed questionnaires at S&W/Texas A&M (n  =  32) and The University of Texas Medical School at Houston (n  =  27) during a validation study of knowledge about advance directives. The questionnaire contained Likert-response items assessing attitudes and practices surrounding advance directives. Our analysis included descriptive statistics and analysis of variance (ANOVA) to compare responses across categories. Results While 53% of residents agreed/strongly agreed they had “sufficient knowledge of advance directives, given my years of training,” 47% disagreed/strongly disagreed with that statement. Most (93%) agreed/strongly agreed that “didactic sessions on advance directives should be offered by my hospital, residency program, or medical school.” A test of responses across residency years with ANOVA showed a significant difference between ratings by PGY-2 and PGY-3 residents on 3 items: “Advance directives should only be discussed with patients over 60,” “I have sufficient knowledge of advance directives, given my years of training,” and “I believe my experience with advance directives is adequate for the situations I routinely encounter.” Conclusion Our study highlighted the continuing need for advance directive resident curricula. Medical school curricula alone do not appear to be sufficient for residents' needs in this area.


2019 ◽  
Vol 10 (1) ◽  
Author(s):  
Facundo N. Diaz ◽  
Marina Ulla

Abstract Background Diagnostic radiology residency programs pursuits as main objectives of the development of diagnostic capabilities and written communication skills to answer clinicians’ questions of referring clinicians. There has been also an increasing focus on competencies, rather than just education inputs. Then, to show ongoing professional development is necessary for a system to assess and document resident’s competence in these areas. Therefore, we propose the implementation of an informatics tool to objectively assess resident’s progress in developing diagnostics and reporting skills. We expect to found decreased preliminary report-final report variability within the course of each year of the residency program. Results We analyzed 12,162 evaluations from 32 residents (8 residents per year in a 4-year residency program) in a 7-month period. 73.96% of these evaluations belong to 2nd-year residents. We chose two indicators to study the evolution of evaluations: the total of discrepancies over the total of preliminary reports (excluding score 0) and the total of likely to be clinically significant discrepancies (scores 2b, 3b, and 4b) over the total of preliminary reports (excluding score 0). With the analysis of these two indicators over the evaluations of 2nd-year residents, we found a slight decrease in the value of the first indicator and relative stable behavior of the second one. Conclusions This tool is useful for objective assessment of reporting skill of radiology residents. It can provide an opportunity for continuing medical education with case-based learning from those cases with clinically significant discrepancies between the preliminary and the final report.


2021 ◽  
Vol 42 (Supplement_1) ◽  
pp. S162-S163
Author(s):  
Jennifer B Radics-Johnson ◽  
Daniel W Chacon ◽  
Li Zhang

Abstract Introduction Burn camps provide a unique environment and activities for children that have experienced a burn-injury. Positive outcomes from attending burn camp include increased self-esteem, decreased feelings of isolation and a greater sense of self-confidence. In a 3-year retrospective review of camper evaluations from one of the largest and longest running week-long burn camps in the nation for ages 5–17, we aimed to assess if a child’s gender, age, TBSA or ethnicity affected the impact that burn camp had on a child. Methods A 3-year retrospective review of a Burn Camp’s camper evaluation forms was conducted for campers that attended burn camp between 2017–2019. Camp rosters were reviewed to determine the camper gender, age, TBSA and ethnicity. Camper self-evaluation forms completed at the end of each camp session were reviewed to record camper responses to questions regarding their opinions on the impact camp had on them as well as how camp will impact their lives once they return home. Categorical variables were summarized as frequency and percentage, and continuous variables were described as median and range. To check the relationship between two categorical variables, Chi-square test was used. To compare the continuous variable among groups, Kruskal-Wallis ANOVA was used. Statistical significance was declared based on a p value< 0.5. Results Within 2017–2019, there were 413 camper records. Participants’ demographic characteristics are summarized in Table 1. There were 208 males (50.3%) and 205 females (49.6%). The median age of campers were 11.86, 12.44 and 12.45 for 2017–2019, with the range from 5.16 years to 17.96 years. The median TBSA were 20, 20 and 18 for 2017–2019, with the range from 0.08 to 90. Collectively there were 47.7% Hispanic (n= 197); 24.2% Whites (n=100); 13.1% Black (n= 54); 4.6% Asian (n=19) and 7.7% Other (n=32). There were 395 camper self-evaluation forms submitted. Results of three questions there we were interested in are summarized collectively in Table 2. 57% of campers responded, “Yes, Definitely” to the question “After going to this event, will you feel more comfortable being around your classmates or friends?” 54% responded, “ Yes, Definitely” to the question “Do you feel more confidents in sharing your burn story with others when returning home?” and 51% responded “Yes, Definitely” to “Did you learn anything that will help you when you return home?” Conclusions In analyzing the camper responses, there was no statistically significant difference in responses comparing gender, age, TBSA or ethnicity.


2011 ◽  
Vol 3 (3) ◽  
pp. 414-416 ◽  
Author(s):  
Nathan H Boyd ◽  
Raul M Cruz

Abstract Background The objective of this study was to determine the extent of interest in international electives among prospective otolaryngology residents and to determine whether the availability of international electives affected students' interest in ranking a particular residency program. Methods A 3-part survey was given to all medical students enrolled in the 2008 otolaryngology match via the Electronic Residency Application Service. Part 1 elicited demographic information. Part 2 explored general interest in international rotations. Part 3 involved ranking several factors affecting students' choice of residency programs. This survey was developed at our institution, with no formal validation. Participation was anonymous and voluntary. Results A total of 307 students entered the otolaryngology match, and 55 surveys (18%) were completed. Twenty-five of 55 students (55%) had completed an international elective during or prior to medical school, and 51 of 55 respondents (93%) had a “strong” or “very strong” desire to participate in an international elective during residency; 48 of 55 students (87%) had a “strong” or “very strong” desire to participate in international surgical missions after residency. Future practice goals had no correlation with interest in international rotations, either during or after residency training. Respondents ranked 8 factors that had an impact on residency program selection in the following order of importance: operative experience, location, lifestyle, research opportunities, didactics, international electives, prestige of program, and salary. Conclusion Interest in international medicine among prospective otolaryngologists was high in this subset of respondents but did not appear to affect residency program selection.


1996 ◽  
Vol 78 (3) ◽  
pp. 888-890 ◽  
Author(s):  
Shirley Moore ◽  
Barry Katz

For self-reports by 21 psychiatric residents on measures of Machiavellianism and Uncertainty no significant difference was noted by year in residency program, education, age, or gender.


Author(s):  
Ryan Mortman ◽  
Harold A. Frazier ◽  
Yolanda C. Haywood

ABSTRACT Background Increasing diversity in medicine is receiving more attention yet underrepresented in medicine (UiM) surgeons remain a small fraction of all surgeons. Whether surgical training programs attempt to attract UiM applicants to their programs, and therefore their specialties, through program website information is unclear. Objective To analyze the scope of diversity and inclusion (D&I) related information on US allopathic and osteopathic general surgery, integrated thoracic surgery, and integrated vascular surgery residency program websites. Methods Residency programs were identified through the Electronic Residency Application Service (ERAS) in July 2020. We searched surgical program websites and collected data on the presence or absence of variables labeled “diversity & inclusion” or “underrepresented in medicine.” Variables found on program websites as well as sites linked to the program website were included. We excluded programs identified in ERAS as fellowship training programs. Programs without webpages were also excluded. Results We identified 425 residency programs and excluded 22 from data analysis. Only 75 of the 403 included programs (18.6%) contained D&I-related information. The presence of individual variables was also low, ranging from 4.5% for opportunities related to early exposure to the specialty to 11.1% for a written or video statement of commitment to D&I. Conclusions In 2020, as recruitment and interviews moved entirely online, few US allopathic and osteopathic general surgery, integrated thoracic surgery, and integrated vascular surgery residency programs provided D&I-related information for residency applicants on their program websites.


2020 ◽  
Vol 52 (3) ◽  
pp. 198-201
Author(s):  
Joshua St. Louis ◽  
Emma Worringer ◽  
Wendy B. Barr

Background and Objectives: As the opioid crisis worsens across the United States, the factors that impact physician training in management of substance use disorders become more relevant. A thorough understanding of these factors is necessary for family medicine residency programs to inform their own residency curricula. The objective of our study was to identify factors that correlate with increased residency training in addiction medicine across a broad sample of family medicine residencies. Methods: We performed secondary analysis of a national family medicine residency program director survey conducted in 2015-2016 (CERA Survey PD-8). We obtained data from the Council of Academic Family Medicine Educational Research Alliance (CERA) Data Clearinghouse. We analyzed residency clinic site designation as a patient-centered medical home (PCMH), federally-qualified health center (FQHC), or both, for their correlation with faculty member possession of DEA-X buprenorphine waiver license, as well as required residency curriculum in addiction medicine. Results: Residency programs situated in an FQHC were more likely to have faculty members who possessed DEA-X buprenorphine waiver licenses (P=.025). Residency clinics that were both a PCMH as well as an FQHC also correlated strongly (P=.001). Furthermore, residencies with faculty who possessed a DEA-X license were significantly more likely to have a required curriculum in addiction medicine (P=.002). Conclusions: Our quantitative secondary analysis of CERA survey data of family medicine residency program directors revealed that resident training in addiction medicine is strongly correlated with both residency clinic setting (FQHC or FQHC/PCMH) as well as residency faculty possession of DEA-X licenses.


Sign in / Sign up

Export Citation Format

Share Document