The use of the objective structured clinical examination (OSCE) in a practice-based health discipline: Academic and student experience in paramedicine

2020 ◽  
Vol 3 (2) ◽  
Author(s):  
Andy Bell ◽  
Jennifer Kelly ◽  
Peter Lewis
Keyword(s):  
Clinical Examination ◽  
Best Practice ◽  
Assessment Tool ◽  
Clinical Performance ◽  
Reliability And Validity ◽  
Specific Area ◽  
Training Model ◽  
Objective Structured Clinical Examination ◽  
Evidence Based ◽  
Effective Measure

Abstract:Purpose:Over the past two decades, the discipline of Paramedicine has seen expediential growth as it moved from a work-based training model to that of an autonomous profession grounded in academia.  With limited evidence-based literature examining assessment in paramedicine, this paper aims to describe student and academic views on the preference for OSCE as an assessment modality, the sufficiency of pre-OSCE instruction, and whether or not OSCE performance is a perceived indicator of clinical performance.Design/Methods:A voluntary, anonymous survey was conducted to examine the perception of the reliability and validity of the Objective Structured Clinical Examination (OSCE) as an assessment tool by students sitting the examination and the academics that facilitate the assessment. Findings:The results of this study revealed that the more confident the students are in the reliability and validity of the assessment, the more likely they are to perceive the assessment as an effective measure of their clinical performance.  The perception of reliability and validity differs when acted upon by additional variables, with the level of anxiety associated with the assessment and the adequacy of feedback of performance cited as major influencers. Research Implications:The findings from this study indicate the need for further paramedicine discipline specific research into assessment methodologies to determine best practice models for high quality assessment.Practical Implications:The development of evidence based best practice guidelines for the assessment of student paramedics should be of the upmost importance to a young, developing profession such as paramedicine.Originality/Value: There is very little research in the discipline specific area of assessment for paramedicine and discipline specific education research is essential for professional growth.Limitations:The principal researcher was a faculty member of one of the institutions surveyed.  However, all data was non identifiable at time of data collection.  Key WordsParamedic; paramedicine; objective structured clinical examinations; OSCE; education; assessment.

scholarly journals Designing and Implementing the Objective Structured Clinical Examination in Anesthesiology

2014 ◽  
Vol 120 (1) ◽  
pp. 196-203 ◽  
Author(s):  
Maya Jalbout Hastie ◽  
Jessica L. Spellman ◽  
Parwane P. Pagano ◽  
Jonathan Hastie ◽  
Brian J. Egan
Keyword(s):  
Medical Education ◽  
Clinical Examination ◽  
Assessment Tool ◽  
Core Competencies ◽  
Objective Assessment ◽  
Reliability And Validity ◽  
The United States ◽  
Objective Structured Clinical Examination ◽  
Evaluation Tool ◽  
Current Application

Abstract Since its description in 1974, the Objective Structured Clinical Examination (OSCE) has gained popularity as an objective assessment tool of medical students, residents, and trainees. With the development of the anesthesiology residents’ milestones and the preparation for the Next Accreditation System, there is an increased interest in OSCE as an evaluation tool of the six core competencies and the corresponding milestones proposed by the Accreditation Council for Graduate Medical Education. In this article the authors review the history of OSCE and its current application in medical education and in different medical and surgical specialties. They also review the use of OSCE by anesthesiology programs and certification boards in the United States and internationally. In addition, they discuss the psychometrics of test design and implementation with emphasis on reliability and validity measures as they relate to OSCE.

The Objective Structured Clinical Examination: An Alternative Approach to Assessing Student Clinical Performance

1987 ◽  
Vol 26 (1) ◽  
pp. 39-41
Author(s):  
Janet McKnight ◽  
Elizabeth Rideout ◽  
Barbara Brown ◽  
Donna Ciliska ◽  
Diane Patton ◽  
...  
Keyword(s):  
Clinical Examination ◽  
Clinical Performance ◽  
Objective Structured Clinical Examination ◽  
Alternative Approach

scholarly journals Evaluation Considerations for Secondary Uses of Clinical Data: Principles for an Evidence-based Approach to Policy and Implementation of Secondary Analysis

2017 ◽  
Vol 26 (01) ◽  
pp. 59-67 ◽  
Author(s):  
P. J. Scott ◽  
M. Rigby ◽  
E. Ammenwerth ◽  
J. McNair ◽  
A. Georgiou ◽  
...  
Keyword(s):  
Clinical Data ◽  
Health Informatics ◽  
Best Practice ◽  
Data Science ◽  
Clinical Performance ◽  
Secondary Analysis ◽  
Health Data ◽  
Evidence Based ◽  
Great Expectations ◽  
Scientific Context

Summary Objectives: To set the scientific context and then suggest principles for an evidence-based approach to secondary uses of clinical data, covering both evaluation of the secondary uses of data and evaluation of health systems and services based upon secondary uses of data. Method: Working Group review of selected literature and policy approaches. Results: We present important considerations in the evaluation of secondary uses of clinical data from the angles of governance and trust, theory, semantics, and policy. We make the case for a multi-level and multi-factorial approach to the evaluation of secondary uses of clinical data and describe a methodological framework for best practice. We emphasise the importance of evaluating the governance of secondary uses of health data in maintaining trust, which is essential for such uses. We also offer examples of the re-use of routine health data to demonstrate how it can support evaluation of clinical performance and optimize health IT system design. Conclusions: Great expectations are resting upon “Big Data” and innovative analytics. However, to build and maintain public trust, improve data reliability, and assure the validity of analytic inferences, there must be independent and transparent evaluation. A mature and evidence-based approach needs not merely data science, but must be guided by the broader concerns of applied health informatics.

scholarly journals The MRCPsych OSCE workshop: a new game to play?

2004 ◽  
Vol 28 (2) ◽  
pp. 62-65 ◽  
Author(s):  
Asim Naeem ◽  
Joan Rutherford ◽  
Chris Kenn
Keyword(s):  
Clinical Examination ◽  
Royal College ◽  
Clinical Competence ◽  
Reliability And Validity ◽  
Objective Structured Clinical Examination ◽  
Current Evidence ◽  
Consecutive Series ◽  
Patient Assessment ◽  
Good Reliability ◽  
The Individual

In line with the Royal College of Psychiatrists' commitment to improve its professional examinations based on the best current evidence, Spring 2003 has seen the introduction of the objective structured clinical examination (OSCE). This has replaced the individual patient assessment (IPA) in the MRCPsych Part I clinical examination. An OSCE consists of a series of time-limited clinical tasks that candidates have to perform in a consecutive series of ‘stations' or booths. They have the advantage of being able to test clinical competence using a number of different scenarios via a standardised format (Katona et al, 2000). Their use has become widespread over recent years, particularly in undergraduate psychiatry exams (Brewin & Cantwell, 1997), as they have good reliability and validity (Hodges et al, 1998). This was confirmed by the College's initial pilot OSCE, which had a κ score of around 0.8 for the examination as a whole (Oyebode, 2002).

Assessing residents' clinical performance: Cumulative results of a four-year study with the Objective Structured Clinical Examination

Surgery ◽  
1998 ◽  
Vol 124 (2) ◽  
pp. 307-312 ◽  
Author(s):  
Richard W. Schwartz ◽  
Donald B. Witzke ◽  
Michael B. Donnelly ◽  
Terry Stratton ◽  
Amy V. Blue ◽  
...  
Keyword(s):  
Clinical Examination ◽  
Clinical Performance ◽  
Objective Structured Clinical Examination

Effects of Job Burnout and Emotional Labor on Objective Structured Clinical Examination Performance Among Interns and Residents in Taiwan

2017 ◽  
Vol 42 (2) ◽  
pp. 233-257 ◽  
Author(s):  
Chen-Yu Wang ◽  
Jen-De Chen ◽  
Chih-Hung Wang ◽  
Jong-Yi Wang ◽  
Chih-Jaan Tai ◽  
...  
Keyword(s):  
Clinical Examination ◽  
Emotional Labor ◽  
Clinical Performance ◽  
Maslach Burnout Inventory ◽  
Job Burnout ◽  
Objective Structured Clinical Examination ◽  
Measurement Instruments ◽  
Potential Threat ◽  
Cross Sectional ◽  
Interns And Residents

Medical education faces challenges concerning job burnout and emotional labor among junior physicians, which poses a potential threat to the quality of medical care. Although studies have investigated job burnout and emotional labor among physicians, empirical research on the association between job burnout, emotional labor, and clinical performance is lacking. This study investigated the effects of job burnout and emotional labor on clinical performance by using the objective structured clinical examination (OSCE) scores of interns and residents. Specifically, this cross-sectional study utilized the Maslach Burnout Inventory and the Emotional Labor Questionnaire as measurement instruments. A total of 225 interns and residents in central Taiwan answered structured questionnaires before beginning their OSCE. The major statistical analysis method employed was logistic regression. After adjustment for covariates, first-year residents were less likely than other residents to obtain high OSCE scores. The odds of high OSCE performance among interns and residents with high interaction component scores in emotional labor were significantly higher than those with low interaction scores. A high score in the interaction dimension of emotional labor was associated with strong clinical performance. The findings suggest that interventions which motivate positive attitudes and increase interpersonal interaction skills among physicians should receive higher priority.

scholarly journals Evaluation Considerations for Secondary Uses of Clinical Data: Principles for an Evidence-based Approach to Policy and Implementation of Secondary Analysis

2017 ◽  
Vol 26 (01) ◽  
pp. 59-67 ◽  
Author(s):  
P. J. Scott ◽  
M. Rigby ◽  
E. Ammenwerth ◽  
J. McNair ◽  
A. Georgiou ◽  
...  
Keyword(s):  
Clinical Data ◽  
Health Informatics ◽  
Best Practice ◽  
Data Science ◽  
Clinical Performance ◽  
Secondary Analysis ◽  
Health Data ◽  
Evidence Based ◽  
Great Expectations ◽  
Scientific Context

Summary Objectives: To set the scientific context and then suggest principles for an evidence-based approach to secondary uses of clinical data, covering both evaluation of the secondary uses of data and evaluation of health systems and services based upon secondary uses of data. Method: Working Group review of selected literature and policy approaches. Results: We present important considerations in the evaluation of secondary uses of clinical data from the angles of governance and trust, theory, semantics, and policy. We make the case for a multi-level and multi-factorial approach to the evaluation of secondary uses of clinical data and describe a methodological framework for best practice. We emphasise the importance of evaluating the governance of secondary uses of health data in maintaining trust, which is essential for such uses. We also offer examples of the re-use of routine health data to demonstrate how it can support evaluation of clinical performance and optimize health IT system design. Conclusions: Great expectations are resting upon “Big Data” and innovative analytics. However, to build and maintain public trust, improve data reliability, and assure the validity of analytic inferences, there must be independent and transparent evaluation. A mature and evidence-based approach needs not merely data science, but must be guided by the broader concerns of applied health informatics.

Sign in / Sign up

Export Citation Format

Share Document