Standard Setting for Clinical Competence at Graduation from Medical School: A Comparison of Passing Scores Across Five Medical Schools

2006 ◽  
Vol 11 (2) ◽  
pp. 173-183 ◽  
Author(s):  
Katharine A. M. Boursicot ◽  
Trudie E. Roberts ◽  
Godfrey Pell
Keyword(s):  
Medical School ◽  
Clinical Competence ◽  
Standard Setting ◽  
Medical Schools ◽  
Passing Scores

scholarly journals Variation in Performance on Common Content Items at UK Medical Schools

2021 ◽  
Author(s):  
David Hope ◽  
David Kluth ◽  
Matthew Homer ◽  
Avril Dewar ◽  
Richard Fuller ◽  
...  
Keyword(s):  
Medical School ◽  
Standard Setting ◽  
Medical Schools ◽  
Cross Sectional Study ◽  
Pass Rates ◽  
Cross Sectional ◽  
Study Results ◽  
The Uk ◽  
Common Content ◽  
The Impact

Abstract Background Due to the diverse approaches to medical school assessment, making meaningful cross-school comparisons on knowledge is difficult. Ahead of the introduction of national licensing assessment in the UK, we evaluate schools on “common content” to compare candidates at different schools and evaluate whether they would pass under different standard setting regimes. Such information can then help develop a cross-school consensus on standard setting shared content. Methods We undertook a cross-sectional study in the academic sessions 2016-17 and 2017-18. Sixty “best of five” multiple choice items were delivered each year, with five used in both years. In 2016-17 30 (of 31 eligible) medical schools undertook a mean of 52.6 items with 7,177 participants. In 2017-18 the same 30 medical schools undertook a mean of 52.8 items with 7,165 participants for a full sample of 14,342 medical students sitting common content prior to graduation. Using mean scores, we compared performance across items and carried out a “like-for-like” comparison of schools who used the same set of items then modelled the impact of different passing standards on these schools. Results Schools varied substantially on candidate total score. Schools differed in their performance with large (Cohen’s d around 1) effects. A passing standard that would see 5% of candidates at high scoring schools fail left low-scoring schools with fail rates of up to 40%, whereas a passing standard that would see 5% of candidates at low scoring schools fail would see virtually no candidates from high scoring schools fail. Conclusions Candidates at different schools exhibited significant differences in scores in two separate sittings. Performance varied by enough that standard setting approaches that produce realistic fail rates in one medical school may produce substantially different pass rates in other medical schools – despite identical content and the candidates being governed by the same regulator. Regardless of which hypothetical standards are “correct” as judged by experts, large institutional gaps in pass rates must be explored and understood by medical educators before shared standards are applied. The study results can assist cross-school groups in developing a consensus on standard setting future licensing assessment.

scholarly journals Variation in performance on common content items at UK medical schools

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
David Hope ◽  
David Kluth ◽  
Matthew Homer ◽  
Avril Dewar ◽  
Richard Fuller ◽  
...  
Keyword(s):  
Undergraduate Students ◽  
Standard Setting ◽  
Medical Schools ◽  
Cross Sectional Study ◽  
Pass Rates ◽  
Cross Sectional ◽  
Study Results ◽  
Institutional Differences ◽  
Common Content ◽  
The Impact

Abstract Background Due to differing assessment systems across UK medical schools, making meaningful cross-school comparisons on undergraduate students’ performance in knowledge tests is difficult. Ahead of the introduction of a national licensing assessment in the UK, we evaluate schools’ performances on a shared pool of “common content” knowledge test items to compare candidates at different schools and evaluate whether they would pass under different standard setting regimes. Such information can then help develop a cross-school consensus on standard setting shared content. Methods We undertook a cross-sectional study in the academic sessions 2016-17 and 2017-18. Sixty “best of five” multiple choice ‘common content’ items were delivered each year, with five used in both years. In 2016-17 30 (of 31 eligible) medical schools undertook a mean of 52.6 items with 7,177 participants. In 2017-18 the same 30 medical schools undertook a mean of 52.8 items with 7,165 participants, creating a full sample of 14,342 medical students sitting common content prior to graduation. Using mean scores, we compared performance across items and carried out a “like-for-like” comparison of schools who used the same set of items then modelled the impact of different passing standards on these schools. Results Schools varied substantially on candidate total score. Schools differed in their performance with large (Cohen’s d around 1) effects. A passing standard that would see 5 % of candidates at high scoring schools fail left low-scoring schools with fail rates of up to 40 %, whereas a passing standard that would see 5 % of candidates at low scoring schools fail would see virtually no candidates from high scoring schools fail. Conclusions Candidates at different schools exhibited significant differences in scores in two separate sittings. Performance varied by enough that standards that produce realistic fail rates in one medical school may produce substantially different pass rates in other medical schools – despite identical content and the candidates being governed by the same regulator. Regardless of which hypothetical standards are “correct” as judged by experts, large institutional differences in pass rates must be explored and understood by medical educators before shared standards are applied. The study results can assist cross-school groups in developing a consensus on standard setting future licensing assessment.

scholarly journals Impact of the COVID-19 pandemic on UK medical school widening access schemes: disruption, support and a virtual student led initiative

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Emily R Bligh ◽  
Ellie Courtney ◽  
Rebecca Stirling ◽  
Asveny Rajananthanan ◽  
Hibatallah Altaher ◽  
...  
Keyword(s):  
Medical School ◽  
Work Experience ◽  
Medical Schools ◽  
Educational Background ◽  
Socioeconomic Background ◽  
Widening Participation ◽  
Manipulation Check ◽  
Low Socioeconomic ◽  
Widening Access ◽  
The Impact

Abstract Background COVID-19 has disrupted medical education in the United Kingdom (UK). The pandemic may result in a long-term disproportionate negative impact to students applying to Medical School from a low-socioeconomic background. In addition, the upsurge in Medical School applications increases the likelihood of stricter University entry criteria over the coming years. There is no current research to determine how widening participation of Medicine to students from low-socioeconomic backgrounds can be improved virtually. The aim of this study is to establish the impact of COVID-19 on students enrolled in UK widening access schemes and the role of virtual student led initiatives in widening participation. Methods A voluntary online survey was distributed to UK Sixth Form students (N = 31) enrolled in a widening access scheme who attended Sheffield Neuroscience Society International Virtual Conference in February 2021. The event was free to attend. The five-domain survey consisted of questions determining demographics, career aspirations, impact of COVID-19, academic skillsets and an educational manipulation check. Results There were 30 pre-conference and 26 post-conference responses. 76.7 % had work experience cancelled due to COVID-19. A total of 36.7 % of participants reported participating in virtual work experience. ‘Observe GP’ and ‘Medic Mentor’ were each specified as attended virtual opportunities in 20 % of answers. Post conference, students felt significantly more confident in applying to Medical School (p = 0.008) and more prepared to undertake a presentation (p = 0.002). Educational manipulation check scores increased significantly (p = 0.003). 100 % of students felt inspired to do further CV building activities. Conclusions COVID-19 has negatively impacted pupils enrolled in UK Medical School widening access schemes. Virtual student led initiatives can instill confidence in delegates from low socio-economic backgrounds, increase their career knowledge and inspire them to take part in further CV building exercises. Both Medical Schools and medical students play a key role in widening participation. This study recommends Medical Schools promote access to virtual events, urge private and state schools to declare offered opportunities and act mindfully when determining student’s academic potential in the context of their socioeconomic and/or educational background.

scholarly journals Undergraduate Medical Education: Lifestyle Medicine Curriculum Implementation Standards

2021 ◽  
pp. 155982762110081
Author(s):  
Jennifer L. Trilk ◽  
Shannon Worthman ◽  
Paulina Shetty ◽  
Karen R. Studer ◽  
April Wilson ◽  
...  
Keyword(s):  
Medical Education ◽  
Medical School ◽  
American Medical ◽  
Undergraduate Medical Education ◽  
Curriculum Implementation ◽  
Task Force ◽  
Medical Schools ◽  
Lifestyle Medicine ◽  
Professional Activities ◽  
School Curricula

Lifestyle medicine (LM) is an emerging specialty that is gaining momentum and support from around the world. The American Medical Association passed a resolution to support incorporating LM curricula in medical schools in 2017. Since then, the American College of Lifestyle Medicine Undergraduate Medical Education Task Force has created a framework for incorporating LM into medical school curricula. This article provides competencies for medical school LM curriculum implementation and illustrates how they relate to the Association of American Medical College’s Core Entrustable Professional Activities and the LM Certification Competencies from the American Board of Lifestyle Medicine. Finally, standards are presented for how medical schools may receive certification for integrating LM into their curriculum and how medical students can work toward becoming board certified in LM through an educational pathway.

scholarly journals A Scoping Review of Professional Identity Formation in Undergraduate Medical Education

2021 ◽  
Author(s):  
Shiva Sarraf-Yazdi ◽  
Yao Neng Teo ◽  
Ashley Ern Hui How ◽  
Yao Hao Teo ◽  
Sherill Goh ◽  
...  
Keyword(s):  
Medical Students ◽  
Identity Development ◽  
Medical School ◽  
Professional Identity ◽  
Identity Formation ◽  
Scoping Review ◽  
Medical Schools ◽  
Professional Identity Formation ◽  
Enabling Factors ◽  
Content Analyses

Abstract Background Professional identity formation (PIF) in medical students is a multifactorial phenomenon, shaped by ways that clinical and non-clinical experiences, expectations and environmental factors merge with individual values, beliefs and obligations. The relationship between students’ evolving professional identity and self-identity or personhood remains ill-defined, making it challenging for medical schools to support PIF systematically and strategically. Primarily, to capture prevailing literature on PIF in medical school education, and secondarily, to ascertain how PIF influences on medical students may be viewed through the lens of the ring theory of personhood (RToP) and to identify ways that medical schools support PIF. Methods A systematic scoping review was conducted using the systematic evidence-based approach. Articles published between 1 January 2000 and 1 July 2020 related to PIF in medical students were searched using PubMed, Embase, PsycINFO, ERIC and Scopus. Articles of all study designs (quantitative and qualitative), published or translated into English, were included. Concurrent thematic and directed content analyses were used to evaluate the data. Results A total of 10443 abstracts were identified, 272 full-text articles evaluated, and 76 articles included. Thematic and directed content analyses revealed similar themes and categories as follows: characteristics of PIF in relation to professionalism, role of socialization in PIF, PIF enablers and barriers, and medical school approaches to supporting PIF. Discussion PIF involves iterative construction, deconstruction and inculcation of professional beliefs, values and behaviours into a pre-existent identity. Through the lens of RToP, factors were elucidated that promote or hinder students’ identity development on individual, relational or societal levels. If inadequately or inappropriately supported, enabling factors become barriers to PIF. Medical schools employ an all-encompassing approach to support PIF, illuminating the need for distinct and deliberate longitudinal monitoring and mentoring to foster students’ balanced integration of personal and professional identities over time.

The Impact of a Novel Outdoor Orientation Program on Incoming Medical Students

2021 ◽  
pp. 105382592110486
Author(s):  
Jacquelyn B. Kercheval ◽  
Alec Bernard ◽  
Hanna Berlin ◽  
Nicole Byl ◽  
Boone Marois ◽  
...  
Keyword(s):  
Medical Students ◽  
Medical School ◽  
Personal Development ◽  
Medical Schools ◽  
Orientation Program ◽  
Outdoor Orientation Programs ◽  
One Year ◽  
The Impact ◽  
Outdoor Orientation ◽  
Outdoor Orientation Program

Background: Undergraduate outdoor orientation programs facilitate students’ transition into college. Research has yet to be conducted on the few programs at medical schools, which may have unique benefits given the specific challenges of transitioning to medical school and high rates of burnout among medical students. Purpose: This mixed methods study examines the impact of one medical school's outdoor orientation program on its participants. Methodology/Approach: A survey was administered immediately following the 2018 trip ( N = 56 responses). Follow-up focus groups were conducted with a sample of the same participants ( N = 18) in 2019. Responses were analyzed using descriptive statistics and thematic analysis. Findings/Conclusions: Participants felt that the program helped ease their transition into medical school, establish a support system, and hone personal development and wellness skills. Many of these effects persisted up to one year later. Implications: These findings are of particular interest to the medical and experiential education communities because many outcomes persisted for at least one year after the original trip and aligned with factors believed to protect against medical student burnout. There is opportunity for additional research as well as expansion of similar programs to other medical schools.

scholarly journals Medical Schools' Industry Interaction Policies Not Associated With Trainees' Self-Reported Behavior as Residents: Results of a National Survey

2015 ◽  
Vol 7 (4) ◽  
pp. 595-602 ◽  
Author(s):  
James S. Yeh ◽  
Kirsten E. Austad ◽  
Jessica M. Franklin ◽  
Susan Chimonas ◽  
Eric G. Campbell ◽  
...  
Keyword(s):  
Medical School ◽  
American Medical ◽  
Medical Schools ◽  
Brand Name ◽  
School Policies ◽  
Student Interactions ◽  
Drug Products ◽  
Interaction Behaviors ◽  
American Medical Student Association ◽  
Pharmaceutical Representatives

ABSTRACT Background Medical students attending schools with policies limiting industry/student interactions report fewer relationships with pharmaceutical representatives. Objective To investigate whether associations between students' medical school policies and their more limited industry interaction behaviors persist into residency. Methods We randomly sampled 1800 third-year residents who graduated from 120 allopathic US-based medical schools, using the American Medical Association Physician Masterfile. We surveyed them in 2011 to determine self-reported behavior and preferences for brand-name prescriptions, and we calculated the strength of their medical schools' industry interaction policies using the 2008 American Medical Student Association and Institute on Medicine as a Profession databases. We used logistic regression to estimate the association between strength of school policies and residents' behaviors with adjustments for class size, postresidency career plan, and concern about medical school debt. Results We achieved a 44% survey response rate (n = 739). Residents who graduated from schools with restrictive policies were no more or less likely to accept industry gifts or industry-sponsored meals, speak with marketing representative about drug products, attend industry-sponsored lectures, or prefer brand-name medications than residents who graduated from schools with less restrictive policies. Residents who correctly answered evidence-based prescription questions were about 30% less likely to have attended industry-sponsored lectures (OR = 0.72, 95% CI 0.56–0.98). Conclusions Any effect that medical school industry interaction policies had on insulating students from pharmaceutical marketing did not persist in the behavior of residents in our sample. This suggests that residency training environments are important in influencing behavior.

scholarly journals Do our newly graduated medical doctors have adequate knowledge about neonatal resuscitation?

2007 ◽  
Vol 125 (3) ◽  
pp. 180-185
Author(s):  
Ana Paula de Carvalho Panzeri Carlotti ◽  
Maria Lúcia Silveira Ferlin ◽  
Francisco Eulógio Martinez
Keyword(s):  
Medical School ◽  
Neonatal Resuscitation ◽  
Medical Schools ◽  
Sao Paulo ◽  
The State ◽  
Basic Knowledge ◽  
São Paulo ◽  
Cross Sectional ◽  
Resuscitation Training ◽  
Practical Exam

CONTEXT AND OBJECTIVE: Neonatal resuscitation should be part of medical school curriculums. We aimed to evaluate medical school graduates' knowledge of neonatal resuscitation. DESIGN AND SETTING: Cross-sectional study on the performance of candidates sitting a medical residency exam at Hospital das Clínicas, Faculdade de Medicina de Ribeirão Preto, Universidade de São Paulo, in 2004. METHODS: There were two questions on neonatal resuscitation. One question in the theory test aimed at evaluating basic knowledge on the initial approach towards newly born infants. The question in the practical exam was designed to evaluate the candidate's ability to perform the initial steps of resuscitation and to establish bag-mask ventilation. RESULTS: Out of 642 candidates from 74 medical schools, 151 (23.5%) answered the theory question correctly. Significantly more physicians from public medical schools in the State of São Paulo answered correctly than did those from other schools in Brazil (52.5% versus 9.2%; p < 0.05). A total of 436 candidates did the practical exam. The grades among graduates from medical schools belonging to the State of São Paulo were significantly higher than among those from other schools (5.9 ± 2.6 versus 4.1 ± 2.1; p < 0.001). The grades for the practical question among candidates who had answered the theory question correctly were significantly higher than those obtained by candidates who had given wrong answers (p < 0.05). CONCLUSION: Medical school graduates' knowledge of neonate resuscitation in the delivery room is quite precarious. Emphasis on neonatal resuscitation training is urgently needed in medical schools.

Sign in / Sign up

Export Citation Format

Share Document