scholarly journals Predictive validity of A-level grades and teacher-predicted grades in UK medical school applicants: a retrospective analysis of administrative data in a time of COVID-19

BMJ Open ◽  
2021 ◽  
Vol 11 (12) ◽  
pp. e047354
Author(s):  
I C McManus ◽  
Katherine Woolf ◽  
David Harrison ◽  
Paul A Tiffin ◽  
Lewis W Paton ◽  
...  

ObjectivesTo compare in UK medical students the predictive validity of attained A-level grades and teacher-predicted A levels for undergraduate and postgraduate outcomes. Teacher-predicted A-level grades are a plausible proxy for the teacher-estimated grades that replaced UK examinations in 2020 as a result of the COVID-19 pandemic. The study also models the likely future consequences for UK medical schools of replacing public A-level examination grades with teacher-predicted grades.DesignLongitudinal observational study using UK Medical Education Database data.SettingUK medical education and training.ParticipantsDataset 1: 81 202 medical school applicants in 2010–2018 with predicted and attained A-level grades. Dataset 2: 22 150 18-year-old medical school applicants in 2010–2014 with predicted and attained A-level grades, of whom 12 600 had medical school assessment outcomes and 1340 had postgraduate outcomes available.Outcome measuresUndergraduate and postgraduate medical examination results in relation to attained and teacher-predicted A-level results.ResultsDataset 1: teacher-predicted grades were accurate for 48.8% of A levels, overpredicted in 44.7% of cases and underpredicted in 6.5% of cases. Dataset 2: undergraduate and postgraduate outcomes correlated significantly better with attained than with teacher-predicted A-level grades. Modelling suggests that using teacher-estimated grades instead of attained grades will mean that 2020 entrants are more likely to underattain compared with previous years, 13% more gaining the equivalent of the lowest performance decile and 16% fewer reaching the equivalent of the current top decile, with knock-on effects for postgraduate training.ConclusionsThe replacement of attained A-level examination grades with teacher-estimated grades as a result of the COVID-19 pandemic may result in 2020 medical school entrants having somewhat lower academic performance compared with previous years. Medical schools may need to consider additional teaching for entrants who are struggling or who might need extra support for missed aspects of A-level teaching.

2020 ◽  
Vol 25 (Supplement_1) ◽  
pp. S29-S33
Author(s):  
Laurent Elkrief ◽  
Julien Belliveau ◽  
Tara D’Ignazio ◽  
Philippe Simard ◽  
Didier Jutras-Aswad

Abstract The legalization of recreational cannabis across Canada has revealed the importance of medical education on cannabis-related topics. A recent study has indicated that Canadian physicians report a significant gap in current versus desired knowledge regarding the therapeutic use of cannabis. However, the state of education on cannabis has never been studied in Canadian medical schools. This article presents the preliminary findings of a survey conducted to understand the perceptions of Quebec’s medical students regarding cannabis-related teachings in their current curriculum. Overall, students reported very low to low levels of exposure to, knowledge of, and comfort levels with cannabis-related subjects. The majority of students reported that they felt that their medical curricula did not prepare them to face cannabis-related issues in their future practices. Strategies need to be developed for improving medical school curriculum regarding cannabis-related issues. These findings provide potential key strategies to improve curricula.


2011 ◽  
Vol 93 (3) ◽  
pp. 102-103
Author(s):  
R Raychowdhury

The Postgraduate Medical Education and Training Board (PMETB) was established by an act of Parliament in 2003, to set standards for postgraduate medical education and training and to ensure that those standards are met. On 30 September 2005 PMETB took over the functions of the Specialist Training Authority and the Joint Committee on Postgraduate Training for General Practice. Under article 14(4) of the regulations governing PMETB, doctors whose training or qualifications and experience, considered together, meet the requirements of a Certificate of Completion of Training (CCT) programme in one of the standard CCT specialties, may apply to PMETB for a statement of eligibility for registration. This in turn allows application to the General Medical Council for admission to the specialist register.


2018 ◽  
Vol 25 (1) ◽  
pp. e18-e24 ◽  
Author(s):  
Jiayu Liu ◽  
SherWin Wong ◽  
Gary Foster ◽  
Anne Holbrook

Evidence suggests that newly licensed physicians are not adequately prepared to prescribe medications safely. There is currently no national pre-licensure prescribing competency assessment required in North America. This study’s purpose was to survey Canadian medical school leaders for their interest in and perceived need for a nation-wide prescribing assessment for final year medical students. Method In spring of 2015, surveys were disseminated online to medical education leaders in all 17 Canadian medical schools. The survey included questions on perceived medication prescribing competency in medical schools, and interest in integration of a national assessment into medical school curricula and licensing. Results 372 (34.6 %) faculty from all 17 Canadian medical schools responded. 277 (74.5%) respondents were residency directors, 33 (8.9%) vice deans of medical education or equivalent, and 62 (16.7%) clerkship coordinators. Faculty judged 23.4% (SD 22.9%) of their own graduates’ prescribing knowledge to be unsatisfactory and 131 (44.8%) felt obligated to provide close supervision to more than a third of their new residents due to prescribing concerns. 239 (73.0%) believed that an assessment process would improve their graduates’ quality, 262 (80.4%) thought it should be incorporated into their medical school curricula and 248 (76.0%) into the national licensing process. Except in regards to close supervision due to concerns, there were no significant differences between schools’ responses. Conclusions Amongst Canadian medical school leadership, there is a perceived inadequacy in medical student prescribing competency as well as support for a standardized prescribing competency assessment in curricula and licensing processes.


2021 ◽  
pp. emermed-2020-211052
Author(s):  
Matthew Henry Vincent Byrne ◽  
James Ashcroft ◽  
Laith Alexander ◽  
Jonathan C M Wan ◽  
Anna Harvey

ObjectiveThis systematic review aimed to estimate the willingness of students to volunteer during a disaster, and how well-prepared medical students are for volunteering by assessing their knowledge and medical school curriculum of disaster and pandemic medicine.ResultsA total of 37 studies met inclusion criteria including 11 168 medical students and 91 medical schools. 24 studies evaluated knowledge (64.9%), 16 evaluated volunteering (43.2%) and 5 evaluated medical school curricula (13.5%). Weighted mean willingness to volunteer during a disaster was 68.4% (SD=21.7%, range=26.7%–87.8%, n=2911), and there was a significant difference between those planning to volunteer and those who actually volunteered (p<0.0001). We identified a number of modifiable barriers which may contribute to this heterogeneity. Overall, knowledge of disasters was poor with a weighted mean of 48.9% (SD=15.1%, range=37.1%–87.0%, n=2985). 36.8% of 76 medical schools curricula included teaching on disasters. However, students only received minimal teaching (2–6 hours).ConclusionsThis study demonstrates that there is a large number of students who are willing to volunteer during pandemics. However, they are unlikely to be prepared for these roles as overall knowledge is poor, and this is likely due to minimal teaching on disasters at medical school. During the current COVID-19 pandemic and in future disasters, medical students may be required to volunteer as auxiliary staff. There is a need to develop infrastructure to facilitate this process as well as providing education and training to ensure students are adequately prepared to perform these roles safely.


2014 ◽  
Vol 1 ◽  
pp. JMECD.S17495 ◽  
Author(s):  
Aaron M. McGuffin

There is currently no universally accepted core collection of competencies or medical education material for medical students. Individual medical schools create their own competencies and set of educational material using a variety of approaches. What has resulted is a medical education system wherein medical students are trained without any burden of proof that they are indeed competent in agreed upon areas of knowledge, skills, attitudes and behaviors befit of a graduating medical student. In fact, the only uniform assurance a member of the public in the United States can have for a graduating allopathic medical student is that the student has successfully passed USMLE Step 1 and 2 by correctly answering a rumored 55–65% of questions correctly (yes, that is an F) and that they have maintained at least a “C” average or “Pass” equivalent in all of their medical school courses. This article discusses these inadequacies within the current medical education system, and the need to standardize the competencies and curricula for all medical schools through a narrative disclosing this author's experience with trying to initiate such a movement at his own medical school.


2021 ◽  
Vol 108 (Supplement_2) ◽  
Author(s):  
M Byrne ◽  
J Ashcroft ◽  
L Alexander ◽  
J Wan ◽  
A Harvey

Abstract Introduction We aimed to identify motivators and barriers to volunteering during a disaster and knowledge and medical school curriculum of disaster and pandemic medicine. Method We systematically searched the literature on 28/6/2020, following PRISMA guidelines. Results A total of 37 studies met inclusion criteria including 11,168 medical students and 91 medical schools. 24 studies evaluated knowledge (64.9%), 16 evaluated volunteering (43.2%), and five evaluated medical school curricula (13.5%). Weighted mean willingness to volunteer during a disaster was 68.4% (SD = 21.7%, n = 2911), and there was a significant difference between those planning to volunteer and those who actually volunteered (P&lt;.001). We identified a number of modifiable barriers which may contribute to this difference. Overall, knowledge of disasters was poor with a weighted mean of 48.9% (SD = 15.1%, n = 2985). Conclusions There is a large number of students who are willing to volunteer during pandemics. However, they are likely to be under-prepared for these roles due to poor overall knowledge and limited teaching. During the current COVID-19 pandemic and in future disasters, medical students may be required to volunteer as auxiliary staff. Medical schools need to develop infrastructure to facilitate this process as well as providing education and training to ensure students are adequately prepared for these roles.


2018 ◽  
Vol 52 (3) ◽  
pp. 116-121
Author(s):  
Olufunmilola A. Ogun ◽  
Timothy E. Nottidge ◽  
Sue Roff

Objective: Compare the results of administering the DREEM questionnaire in two Nigerian medical schools offering traditional and student-centred curricular respectively, to identify any differences in the learning environment and appreciate advantages of the more modern curriculum.Methods: A survey design was used. Data was analysed using the DREEM scoring rubric. The independent t-test was used to compare results. Setting: The DREEM questionnaire was administered to final year medical students at two participating centres. Participants: Final year students of a teacher-centred and a student-centred medical school. Results: There were 138 respondents – 50 (96.2% of the final year students) from the teacher centred school and 88 (59.1% of the final year students) from the student-centred school. The mean total DREEM score was 117+22.3 in the former and 119 +23.6 in the latter (p = 0.798). Mean age of students in the teacher centred school was 28 ± 5.28 years, while that of the student-centred school was 23 ± 1.83 years (p < 0.05). Conclusion: The mean total DREEM score proximity between the schools suggests that the younger students using a more student-centred curriculum have less of an appreciation of their improved learning environment than is expected. Thus, the hidden curriculum could be lagging behind the written one. The older students in the teacher centred environment have a more mature appreciation of their learning climate.  Funding: Personal sourcesKeywords: medical education, Nigeria, curriculum, DREEM


Author(s):  
Ian Christopher McManus ◽  
Katherine Woolf ◽  
Dave Harrison ◽  
Paul Tiffin ◽  
Lewis Paton ◽  
...  

Calculated A-level grades will replace actual, attained A-levels and other Key Stage 5 qualifications in 2020 in the UK as a result of the COVID 19 pandemic. This paper assesses the likely consequences for medical schools in particular, beginning with an overview of the research literature on predicted grades, concluding that calculated grades are likely to correlate strongly with the predicted grades that schools currently provide on UCAS applications. A notable absence from the literature is evidence on whether predicted grades are better or worse than actual grades in predicting university outcomes. This paper provides such evidence on the reduced predictive validity of predicted A-level grades in comparison with actual A-level grades. The present study analyses the extensive data on predicted and actual grades which are available in UKMED (United Kingdom Medical Education Database), a large-scale administrative dataset containing longitudinal data from medical school application, through undergraduate and then postgraduate training. In particular, predicted A-level grades as well as actual A-level grades are available, along with undergraduate outcomes and postgraduate outcomes which can be used to assess predictive validity of measures collected at selection. This study looks at two UKMED datasets. In the first dataset we compare actual and predicted A-level grades in 237,030 A-levels taken by medical school applicants between 2010 and 2018. 48.8% of predicted grades were accurate, grades were over-predicted in 44.7% of cases and under-predicted in 6.5% of cases. Some A-level subjects, General Studies in particular, showed a higher degree of over-estimation. Similar over-prediction was found for Extended Project Qualifications, and for SQA Advanced Highers. The second dataset considered 22,150 18-year old applicants to medical school in 2010 to 2014, who had both predicted and actual A-level grades. 12,600 students entered medical school and had final year outcomes available. In addition there were postgraduate outcomes for 1,340 doctors. Undergraduate outcomes are predicted significantly better by actual, attained A-level grades than by predicted A-level grades, as is also the case for postgraduate outcomes. Modelling the effect of selecting only on calculated grades suggests that because of the lesser predictive ability of predicted grades, medical school cohorts for the 2020 entry year are likely to under-attain, with 13% more gaining the equivalent of the current lowest decile of performance, and 16% fewer gaining the equivalent of the current top decile, effects which are then likely to follow through into postgraduate training. The problems of predicted/calculated grades can to some extent, although not entirely, be ameliorated, by taking U(K)CAT, BMAT, and perhaps other measures into account to supplement calculated grades. Medical schools will probably also need to consider whether additional teaching is needed for entrants who are struggling, or might have missed out on important aspects of A-level teaching, with extra support being needed, so that standards are maintained.


Author(s):  
Eugenia Pacitti

Abstract Historians of medicine have observed that the student experience of medical school is difficult to capture. While students sometimes left behind notebooks containing lecture notes and diagrams, there is often little evidence that illuminates their lived experiences and responses to their education. This article analyses written submissions to the publication of the Melbourne Medical Students’ Society, Speculum, between 1884 and 1912, to argue that students at the Melbourne Medical School in this era actively participated in discussions about the curriculum on offer, were highly aware of the moral and ethical consequences of their actions in the dissecting room and took great interest in the advancements and debates of the medical profession. It reclaims the student experience of medical school, which has often been hidden in favour of history written from the perspective of those in positions of power, to offer fresh insights into the history of medical education.


Sign in / Sign up

Export Citation Format

Share Document