OSCE Rater Cognition – An International Multi-centre Qualitative Study.
Abstract Introduction This study aimed to explore the decision-making processes of raters during objective structured clinical examinations (OSCEs), in particular to explore the tacit assumptions and beliefs of raters as well as rater idiosyncrasies.MethodsThinking aloud protocol interviews were used to gather data on the thoughts of examiners during their decision-making, while watching trigger OSCE videos and rating candidates. A purposeful recruiting strategy was taken, with a view to interviewing both examiners with many years of experience and those with less experience examining at final medical examination level.ResultsThirty-one interviews were conducted in three centres in three different countries. Three themes were identified during data analysis, entitled ‘OSCEs are inauthentic’, ‘looking for glimpses of truth’ and ‘evolution with experience’. ConclusionThis study gives an insight into how raters approach OSCEs, and how the perceived shortcomings of OSCEs affect how examiners consider candidate behaviours. Some examiners, more likely the more experienced group, may deviate from an organisation’s instructions due to perceived shortcomings of the assessment.