RATERS' DIFFERENTIAL ITEM FUNCTIONING AND MANTEL-HAENSZEL PROCEDURES APPLIED TO AN ITEM ANALYSIS OF WRITE-ANSWER TYPE TEST

Purpose An item analysis of Bishop's (1983) Test for Reception of Grammar (TROG) in its French version (F-TROG; Lecocq, 1996) was conducted to determine whether the difficulty of items is similar for participants with or without intellectual disability (ID). Method In Study 1, responses to the 92 F-TROG items by 55 participants with Down syndrome (DS), 55 with ID of undifferentiated etiology (UND), and 55 typical children (TYP) matched on their F-TROG total score were compared using the transformed item difficulties method, a statistical approach designed to detect differential item functioning (DIF) between groups. In Study 2, an additional comparison involving 526 TYP participants and 526 participants with UND was conducted to increase the statistical power of the analysis. Results The difficulty of items was highly similar whatever the sample size or clinical status of participants. Fewer than 3.5% of the items were flagged as showing DIF. Conclusions Tests such as the TROG can be used with confidence in clinical practice as well as in research studies comparing participants with or without ID. Methods designed for investigating potential internal test bias—such as done here—should be more regularly employed in the developmental disability field to affirm the absence of DIF.

Download Full-text

Use of differential item functioning (DIF) analysis for bias analysis in test construction

SA Journal of Industrial Psychology ◽

10.4102/sajip.v30i4.175 ◽

2004 ◽

Vol 30 (4) ◽

Cited By ~ 4

Author(s):

Marié De Beer

Keyword(s):

Differential Item Functioning ◽

Item Analysis ◽

Test Construction ◽

Learning Potential ◽

Bias Analysis ◽

Gender Culture ◽

Adaptive Test ◽

Item Functioning ◽

Ability Levels ◽

Final Item

When differential item functioning (DIF) item analysis procedures based on item response theory (IRT) are used during test construction, it is possible to draw item characteristic curves for the same item for different subgroups. These curves indicate how each item functions at various ability levels for different subgroups. DIF is indicated by the area between the curves. In the construction of the Learning Potential Computerised Adaptive Test (LPCAT), this method was used to identify items that indicated bias in terms of gender, culture, language or level of education. Items that exceeded a predetermined amount of DIF were discarded from the final item bank, irrespective of which subgroup was being advantaged or disadvantaged. The process and results of the DIF analysis are discussed.Opsomming Waar differensiële itemfunksioneringsprosedures (DIF-prosedures) vir itemontleding gebaseer op itemresponsteorie (IRT) tydens toetskonstruksie gebruik word, is dit moontlik om itemkarakteristiekekrommes vir dieselfde item vir verskillende subgroepe voor te stel. Hierdie krommes dui aan hoe elke item vir die verskillende subgroepe op verskillende vermoënsvlakke te funksioneer. DIF word aangetoon deur die area tussen die krommes. DIF is in die konstruksie van die 'Learning Potential Computerised Adaptive test (LPCAT)' gebruik om die items te identifiseer wat sydigheid ten opsigte van geslag, kultuur, taal of opleidingspeil geopenbaar het. Items wat ’n voorafbepaalde vlak van DIF oorskry het, is uit die finale itembank weggelaat, ongeag die subgroep wat bevoordeel of benadeel is. Die proses en resultate van die DIF-ontleding word bespreek.

Download Full-text

Item analysis and differential item functioning of a brief conduct problem screen.

Psychological Assessment ◽

10.1037/a0025831 ◽

2012 ◽

Vol 24 (2) ◽

pp. 444-454 ◽

Cited By ~ 5

Author(s):

Johnny Wu ◽

◽

Kevin M. King ◽

Katie Witkiewitz ◽

Sarah Jensen Racz ◽

...

Keyword(s):

Differential Item Functioning ◽

Item Analysis ◽

Conduct Problem ◽

Item Functioning

Download Full-text

Item Analysis of the Czech Version of the WJ IV COG Battery from a Group of Romani Children

International Journal of Environmental Research and Public Health ◽

10.3390/ijerph181910518 ◽

2021 ◽

Vol 18 (19) ◽

pp. 10518

Author(s):

Alena Kajanová ◽

Tomáš Urbánek ◽

Tomáš Mrhálek ◽

Stanislav Ondrášek ◽

Olga Shivairová ◽

...

Keyword(s):

Czech Republic ◽

Statistical Analysis ◽

Differential Item Functioning ◽

Item Difficulty ◽

Item Analysis ◽

The Czech Republic ◽

Czech Population ◽

Item Functioning ◽

Culturally Influenced ◽

Quota Sampling

The objective of the article is to present an item analysis of selected subtests of the Czech version of the WJ IV COG battery from a group of Romani children, ages 7–11. The research sample consisted of 400 school-aged Romani children from the Czech Republic who were selected by quota sampling. A partial comparative sample for the analysis was the Czech population collected as norms of the Czech edition of © Propsyco (n = 936). The Woodcock–Johnson IV COG was used as a research tool. Statistical analysis was performed in Winstep software using Differential Item Functioning; differences between groups were expressed in logits and tested via the Rasch–Welch T-test. It was discovered that higher item difficulty was noted in the verbal subtests, although variability in item difficulty was found across all subtests. The analysis of individual items makes it possible to discover which tasks are most culturally influenced.

Download Full-text

Erfassung von mathematischen Kompetenzen im Vorschulalter mit MARKO-D

Diagnostica ◽

10.1026/0012-1924/a000258 ◽

2021 ◽

Vol 67 (1) ◽

pp. 13-23

Author(s):

Ariana Garrote ◽

Elisabeth Moser Opitz

Keyword(s):

Differential Item Functioning ◽

Item Functioning

Zusammenfassung. In dieser Studie wurde der Test MARKO-D (Mathematik- und Rechenkonzepte im Vorschulalter–Diagnose) mit einer Stichprobe von Kindern aus der deutschsprachigen Schweiz ( N = 555) im ersten und zweiten Kindergartenjahr erprobt und es wurde analysiert, ob sich die Altersnormen der deutschen Stichprobe auf die Schweiz übertragen lassen. Zudem wurde der Test mit einer Teilstichprobe ( n = 87) hinsichtlich Messinvarianz über die Zeit untersucht. Die Ergebnisse des eindimensionalen Rasch-Modells zeigen, dass das Instrument für die Schweiz geeignet ist. Die Testleistungen hängen jedoch vom Kindergartenbesuch ab. Für die Schweiz müssten deshalb nebst Altersnormen auch Normen pro Kindergartenhalbjahr verwendet werden. Die Analyse mittels Differential Item Functioning ergab, dass 17 von 55 Items von großer Messvarianz über die Zeit betroffen sind. Um das Instrument für Längsschnittuntersuchungen einsetzen zu können, müsste es weiterentwickelt werden.

Download Full-text

Differential Item Functioning in Brief Instruments of Disordered Eating

European Journal of Psychological Assessment ◽

10.1027/1015-5759/a000472 ◽

2019 ◽

Vol 35 (6) ◽

pp. 823-833 ◽

Cited By ~ 4

Author(s):

Desiree Thielemann ◽

Felicitas Richter ◽

Bernd Strauss ◽

Elmar Braehler ◽

Uwe Altmann ◽

...

Keyword(s):

Differential Item Functioning ◽

Disordered Eating ◽

Structural Equation ◽

Young Female ◽

Eating Attitudes ◽

Equation Model ◽

German Population ◽

Test Fairness ◽

Item Functioning ◽

Multiple Indicator

Abstract. Most instruments for the assessment of disordered eating were developed and validated in young female samples. However, they are often used in heterogeneous general population samples. Therefore, brief instruments of disordered eating should assess the severity of disordered eating equally well between individuals with different gender, age, body mass index (BMI), and socioeconomic status (SES). Differential item functioning (DIF) of two brief instruments of disordered eating (SCOFF, Eating Attitudes Test [EAT-8]) was modeled in a representative sample of the German population ( N = 2,527) using a multigroup item response theory (IRT) and a multiple-indicator multiple-cause (MIMIC) structural equation model (SEM) approach. No DIF by age was found in both questionnaires. Three items of the EAT-8 showed DIF across gender, indicating that females are more likely to agree than males, given the same severity of disordered eating. One item of the EAT-8 revealed slight DIF by BMI. DIF with respect to the SCOFF seemed to be negligible. Both questionnaires are equally fair across people with different age and SES. The DIF by gender that we found with respect to the EAT-8 as screening instrument may be also reflected in the use of different cutoff values for men and women. In general, both brief instruments assessing disordered eating revealed their strengths and limitations concerning test fairness for different groups.

Download Full-text

An IRT Investigation of the Validity of Non-Patient Analogue Research Using the Beck Depression Inventory

European Journal of Psychological Assessment ◽

10.1027/1015-5759.11.1.14 ◽

1995 ◽

Vol 11 (1) ◽

pp. 14-20 ◽

Cited By ~ 22

Author(s):

Sean M. Hammond

Keyword(s):

Differential Item Functioning ◽

Beck Depression Inventory ◽

Rating Scale ◽

Latent Trait ◽

Scale Model ◽

Item Functioning ◽

Two Samples ◽

Patient Groups ◽

Analogue Research ◽

Rating Scale Model

This paper presents an IRT analysis of the Beck Depression Inventory which was carried out to assess the assumption of an underlying latent trait common to non-clinical and patient samples. A one parameter rating scale model was fitted to data drawn from a patient and non-patient sample. Findings suggest that while the BDI fits the model reasonably well for the two samples separately there is sufficient differential item functioning to raise serious duobts of the viability of using it analogously with patient and non-patient groups.

Download Full-text