Retrospective study on the effect of the timing of exposure on confidence level in applying to PM&R residency programs

Abstract Purpose The disparity between the number of applicants for postgraduate year 1 (PGY1) pharmacy residency positions and the number of available residency positions increases the need to optimize how applicants are evaluated. The purpose of the study described here was to evaluate the correlation of ratings of residency candidate characteristics by academic and professional references listed on residency applications with overall application score, applicant ranking, and the likelihood of candidates receiving an invitation to interview. Methods A multicenter, retrospective study was conducted to evaluate the correlation of reference writers’ ratings of 13 candidate characteristics and their overall recommendations with program-determined outcomes (eg, final application score, applicant ranking, and invitation to interview) through analysis of PGY1 applications submitted through the Pharmacy Online Residency Centralized Application System (PhORCAS) from 2015 through 2018. Keywords and themes within the open-ended section of letters of reference were also analyzed for correlation with overall application score. Results A total of 5,923 references listed on 1,867 applications to 4 PGY1 pharmacy residency programs processed by PhORCAS were included in the analysis. For the majority of applicant characteristic ratings (ie, 74% of 56,872 ratings overall), reference writers rated candidates as exceeding expectations, and applicants were “highly recommended” by these evaluators in 91% of cases. References’ average characteristic ratings and overall recommendations were poorly correlated with final application score (R2 = 0.12 [P < 0.0001] and R2 = 0.08 [P < 0.0001], respectively), final ranking (R2 = 0.02 [P < 0.0001] and R2 = 0.03 [P < 0.0001], respectively), and invitation to interview (R2 = 0.07 [P < 0.0001] and R2 = 0.04 [P < 0.0001], respectively). For the themes evaluated, references’ use of teaching words best correlated with normalized final application score, although the correlation was poor (R2 = 0.007, P = 0.0001). Conclusion Reference writers’ ratings of PGY1 residency candidate characteristics in PhORCAS are poorly correlated with application score, applicant ranking, and invitation to interview. The results of this study suggest that the existing PhORCAS standardized form for submitting references is of limited utility in its current state.

Download Full-text

Increasing lengths of rank order lists of applicants and programs of US medical residencies

The American Surgeon ◽

10.1177/00031348211050831 ◽

2021 ◽

pp. 000313482110508

Author(s):

Kevin Newsome ◽

Brendon Sen-Crowe ◽

Dino Fanfan ◽

Mark McKenny ◽

Adel Elkbuli

Keyword(s):

Retrospective Study ◽

Training Programs ◽

Rank Order ◽

Temporal Trends ◽

Residency Programs ◽

The Past ◽

Current State ◽

Medical Programs ◽

Over Time ◽

Residency Match

Background To match medical students into residency training programs, both the program and student create rank order lists (ROLs). We aim to investigate temporal trends in ROL lengths across 7 match cycles between 2014 and 2021 for both matched and unmatched residency applicants and programs. Methods retrospective study of ROLs of 7 match cycles, 2014-2021. Residency match and ROL data were extracted from the NRMP database to assess the number of programs filled and unfilled, length of ROLs, position matched, and average ranks per position for osteopathic (DO) and allopathic (MD) medical programs. Results For filled residency programs, the average ROL length consistently increased from 70.72 in 2015 to 88.73 in 2021 ( P = .003), with ROL lengths consistently longer for filled vs unfilled residency programs ( P < .001). The average ROL length for matched applicants increased consistently from 10.41 in 2015 to 12.35 in 2021 ( P = .002), with matched applicants having consistently longer ROLs than unmatched applicants ( P < .001). From 2015 to 2021, in both MD and DO applicants, progressively lower proportions of applicants matched their first and second choices. Conclusion Trends across the past 7 residency match cycles suggest that ROL lengths for both programs and applicants have been increasing with matched programs and applicants submitting significantly longer ROLs than unmatched applicants. Additionally, fewer applicants are matching at their preferred programs over time. Our findings support the mounting evidence that the Match has become increasingly congested and we discuss the possible factors that may be contributing to the current state of the Match as well as potential solutions.

Download Full-text