Reliability, validity and efficiency of multiple choice question and patient management problem item formats in assessment of clinical competence

1985 ◽  
Vol 19 (3) ◽  
pp. 238-247 ◽  
Author(s):  
J. J. NORCINI ◽  
D. B. SWANSON ◽  
L. J. GROSSO ◽  
G. D. WEBSTER
Author(s):  
Susan Hawkins ◽  
Anthony Goreczny ◽  
Nicole Brown

Purpose: The impact of prior problem-based learning (PBL) facilitation experience (measured by length of time facilitating) on student learning and student outcomes is unclear. The purpose of this study was to evaluate relationships of facilitator experience in problem-based learning on student outcomes. This study utilized both modified essay questions (MEQ) in the form of patient management assessments and multiple choice question (MCQ) assessments to evaluate different aspects of student acquisition and application of knowledge. Method: This study examined scores from six multiple choice question examinations and six patient management assessments (PMA), one each from six 5-week units arranged by organ system administered to five cohorts of first-year physician assistant students in a hybrid problem-based learning program where 18 of 45 didactic credits are solely problem-based learning. Facilitation experience, measured in total number of prior units facilitated, was calculated for each facilitator and compared with student evaluative measures. Results: Pearson product moment correlations comparing facilitator experience and scores on the patient management assessments and multiple choice question tests showed no statistically significant correlations between facilitator experience and student outcomes. Univariate analysis of variance tests comparing whether faculty were full-time versus adjunct status and status as graduates of a problem-based learning program versus graduates of programs with other pedagogies with student outcomes showed no statistically significant differences. Conclusions: Neither experience of the facilitator, nor status as full-time versus adjunct, nor status as graduate of a problem-based learning program versus other pedagogy was related to student outcomes. Each facilitator in the study participated in training, observation, and weekly meetings, which may outweigh the effects of facilitator experience. Other factors in need of exploration related to student outcomes in future studies include individual intellectual ability, emotional stability, motivation, self-efficacy, and perseverance.


Author(s):  
Casey Wong ◽  
Paul Denny ◽  
Andrew Luxton-Reilly ◽  
Jacqueline Whalley

Sign in / Sign up

Export Citation Format

Share Document