Equivalence and Bias in the South African Substance Use Contextual Risk Instrument

2017 ◽  
Vol 120 (1) ◽  
pp. 158-178
Author(s):  
Ishreen Rawoot ◽  
Maria Ann Florence

This article forms part of a larger study that sought to develop and validate a scale to measure individual and contextual factors associated with adolescent substance use in low-socio-economic status South African communities. The scale was developed to inform the process of designing preventative interventions in these communities. This study assessed the construct equivalence and item bias across different language versions of the scale. Exploratory factor analysis, equality of reliabilities, and the Tucker’s phi coefficient of congruence were employed to assess whether the two language versions were equivalent at a scale level. Differential item functioning analysis was conducted using ordinal logistic regression and the Mantel-Haenszel method at an item level. The findings revealed that there are significant differences between the two groups at a scale level. Items were flagged as presenting with moderate to large differential item functioning. The biased items have to be closely examined in order to decide how to address the bias.




2015 ◽  
Vol 15 (13) ◽  
pp. 23 ◽  
Author(s):  
Woo-Yeol Lee ◽  
Sun-Joo Cho ◽  
Rankin W. McGugin ◽  
Ana Beth Van Gulick ◽  
Isabel Gauthier


Author(s):  
Stella Eteng-Uket

The study investigated detecting differential item functioning using item response theory in West African Senior School Certificate English language test in south-south Nigeria. 2 research questions were formulated to guide the study. Using descriptive research survey design for the study, study population was 117845 Senior Secondary 3 students in Edo, Delta, Rivers and Bayelsa state. A sample of 1309 (604 males, 705 females) drawn through multi stage sampling technique was used for the study. Two valid instruments titled: Socio-economic status questionnaire (SSQ) and WASSCE/SSCE English language objective test (ELOT) were used to collect data for the study. The reliability indices of the instruments were estimated using the Cronbach Alpha method of internal consistency and Richard Kuderson 20 with coefficient values of .84 for the English Language objective test and .71 for the socio-economic status questionnaire respectively. Chi-square and Lord Wald test statistics statistical technique employed by Item Response Theory for Patient Reported Outcome (IRTPRO) was the technique used in data analysis which provided answers to the research questions at.05 level of significance. On analysis, the result revealed that 13 items functioned differently significant between the male and female group and significantly 23 items differentially functioned between High and low socio-economic status group. Thus, this shows 18% DIF based on gender and 32% based on socio-economic status indicating large DIF and items that are potentially biased. Based on the findings, recommendation were made and one among others was that Item Response theory should be used as DIF detection method by large scale public examination and test developers.





2020 ◽  
Vol 18 (1) ◽  
Author(s):  
Marina Bruderer-Hofstetter ◽  
Mark A. Dubbelman ◽  
André Meichtry ◽  
Florian Koehn ◽  
Thomas Münzer ◽  
...  

Abstract Background Instrumental Activities of Daily Living (IADL) limitations are associated with reduced health-related quality of life for people with mild cognitive impairment (MCI). For these people, the assessment of IADL is crucial to the diagnostic process, as well as for the evaluation of new interventions addressing MCI. The Amsterdam IADL Questionnaire Short Version (A-IADL-Q-SV) is an established assessment tool with good psychometric properties that has been shown to be robust to cultural differences in Western countries. The aims of this study were to: (1) cross-culturally adapt and validate the A-IADL-Q-SV for the German-speaking population of Switzerland; (2) investigate its cultural comparability; and (3) evaluate further psychometric properties. Methods The A-IADL-Q-SV German was pretested on clinicians and participants in a memory clinic setting. The psychometric properties and cultural comparability of the questionnaire were investigated in memory clinic settings including participants with MCI or mild dementia, as well as participants with normal cognition recruited from the community. Item response theory (IRT) was applied to investigate measurement invariance by means of differential item functioning to assess item bias. Additionally, the test–retest reliability on scale level, the construct validity through hypothesis testing and the discriminant validity of the A-IADL-Q-SV German were evaluated. Results Ninety-six informants of participants with normal cognition, MCI or mild dementia completed the A-IADL-Q-SV German. The basic assumptions for IRT scoring were met. No meaningful differential item functioning for culture was detected between the Swiss and Dutch reference samples. High test–retest reliability on scale level (ICC 0.93; 95% CI 0.9–0.96) was found. More than 75% of the observed correlations between the A-IADL-Q-SV German and clinical measures of cognition and functional status were found to be in the direction and of the magnitude hypothesized. The A-IADL-Q-SV German was shown to be able to discriminate between participants with normal cognition and MCI, as well as MCI and mild dementia. Conclusions The A-IADL-Q-SV German is a psychometrically robust measurement tool for a Swiss population with normal cognition, MCI and mild dementia. Thus, it provides a valuable tool to assess IADL functioning in clinical practices and research settings in Switzerland. Trial registration This study was registered retrospectively in July 2019 on ClinicalTrials.gov (NCT04012398).



Sign in / Sign up

Export Citation Format

Share Document