Interpreting Cross-Cultural Bias in Psychological Assessments: An Empirical Example
Cockcroft et al. (2015) fit a multigroup confirmatory factor model to Wechsler Adult Intelligence Scale III (WAIS-III) data from South Africa and the United Kingdom. They found evidence for measurement bias and suggested that bias was greatest in those subtests of the WAIS-III that showcased the largest mean group differences. They went on to state that the "[i]dentification of tests that do not favor individuals from Eurocentric and favorable SES circumstances with advantaged educational backgrounds is valuable in providing direction for the development of culture fair tests", in effect suggesting that the results confirmed the test was biased towards culturally European groups. However, a reanalysis that included estimation of the effect sizes and directions of bias showed that, far from their conclusions, bias operated in different directions, but primarily in favor of the lower-scoring South African population examined in their study. The need for greater qualification in measurement invariance testing is shown and recommended.