Using Item Response Theory to Develop Revised (SSOSH-7) and Ultra-Brief (SSOSH-3) Self-Stigma of Seeking Help Scales

Assessment ◽  
2020 ◽  
pp. 107319112095849
Author(s):  
Rachel E. Brenner ◽  
Kimberly F. Colvin ◽  
Joseph H. Hammer ◽  
David L. Vogel
Keyword(s):  
Item Response Theory ◽  
Item Response ◽  
Latent Variable ◽  
Help Seeking ◽  
The Self ◽  
Response Theory ◽  
Student Sample ◽  
Item Functioning ◽  
Seeking Help ◽  
Highly Correlated

The current research developed ultra-brief (SSOSH-3) and revised (SSOSH-7) versions of the Self-Stigma of Seeking Help scale. Item response theory was used to examine the amount of information each item provided across the latent variable scale and test whether items functioned differently across women and men. In a sample of 857 community adults, results supported removal of three reverse-scored items to create the SSOSH-7. The three most informative items were retained to create the SSOSH-3. Differential item functioning testing supported the use of both versions across women and men. Results replicated in an undergraduate student sample ( n = 661). In both samples, the SSOSH-3 (αs = .82-.87) and SSOSH-7 (αs = .87-.89) demonstrated evidence of internal consistency. The SSOSH-3 ( rs ≥ .89) and SSOSH-7 ( rs ≥ .97) were highly correlated with the original SSOSH across samples and demonstrated significant correlations with help-seeking constructs and in similar magnitude to the original SSOSH.

A Bifactor Multidimensional Item Response Theory Model for Differential Item Functioning Analysis on Testlet-Based Items

2011 ◽  
Vol 35 (8) ◽  
pp. 604-622 ◽  
Author(s):  
Hirotaka Fukuhara ◽  
Akihito Kamata
Keyword(s):  
Item Response Theory ◽  
Differential Item Functioning ◽  
Item Response ◽  
Estimation Method ◽  
Multidimensional Item Response Theory ◽  
Multidimensional Item Response ◽  
Response Theory ◽  
Data Set ◽  
Detection Rates ◽  
Item Functioning

A differential item functioning (DIF) detection method for testlet-based data was proposed and evaluated in this study. The proposed DIF model is an extension of a bifactor multidimensional item response theory (MIRT) model for testlets. Unlike traditional item response theory (IRT) DIF models, the proposed model takes testlet effects into account, thus estimating DIF magnitude appropriately when a test is composed of testlets. A fully Bayesian estimation method was adopted for parameter estimation. The recovery of parameters was evaluated for the proposed DIF model. Simulation results revealed that the proposed bifactor MIRT DIF model produced better estimates of DIF magnitude and higher DIF detection rates than the traditional IRT DIF model for all simulation conditions. A real data analysis was also conducted by applying the proposed DIF model to a statewide reading assessment data set.

scholarly journals A-08 Examination of Three Functional Living Scales Using Item Response Theory Modeling in a Mixed Sample

2020 ◽  
Vol 35 (6) ◽  
pp. 781-781
Author(s):  
W Goette ◽  
A Carlew ◽  
J Schaffert ◽  
H Rossetti ◽  
L Lacritz
Keyword(s):  
Higher Education ◽  
Item Response Theory ◽  
Item Response ◽  
Rating Scale ◽  
Functional Change ◽  
Response Theory ◽  
Clinical Dementia Rating ◽  
Predominately White ◽  
Multiple Observations ◽  
Item Functioning

Abstract Objective Characterize three functional living scales under item response theory and examine these scales for evidence of differential item functioning (DIF) by participant and/or informant ethnicity and education. Method Baseline data from 3155 participants [Mage = 70.59(9.55); Medu = 13.3(4.26); 61.72%female] enrolled in the Texas Alzheimer’s Research and Care Consortium with data from the Clinical Dementia Rating Scale (CDR; functional items), Physical Self-Maintenance Scale (PSMS), and Instrumental Activities of Daily Living Scale (IADL) were used. The sample was predominately white (93.94%) and 35.97% identified as Hispanic. Graded response models fit all three tests best. DIF was examined by iteratively dropping item-by-item constraints and then testing model fit. Results The CDR demonstrated overall good item functioning with clear separation between all of the rating categories for each item, while the PSMS and IADL did not, suggesting the item ratings should be reconsidered. DIF was observed by ethnicity (Hispanic v. non-Hispanic) and education (separated into low, average, high) for every item on all three scales (all ps ≤ .01 after adjustment for multiple observations). Hispanic ethnicity and higher education subjects were more likely to be rated as more impaired. Conclusions Results suggest these three commonly used functional scales have DIF depending on the ethnicity and education of the patient. This finding has implications for understanding functional change in certain populations, particularly the potential for mischaracterization of impairment in minority samples. The finding that individuals with higher education tended to be rated as more functionally impaired warrants further investigation.

scholarly journals Determining differential item functioning and its effect on the test scores of selected pib indexes, using item response theory techniques

2001 ◽  
Vol 27 (2) ◽  
Author(s):  
Pieter Schaap
Keyword(s):  
Item Response Theory ◽  
Differential Item Functioning ◽  
Item Response ◽  
Test Scores ◽  
Response Theory ◽  
South Africans ◽  
Test Characteristics ◽  
Potential Index ◽  
Item Functioning

The objective of this article is to present the results of an investigation into the item and test characteristics of two tests of the Potential Index Batteries (PIB) in terms of differential item functioning (DIP) and the effect thereof on test scores of different race groups. The English Vocabulary (Index 12) and Spelling Tests (Index 22) of the PIB were analysed for white, black and coloured South Africans. Item response theory (IRT) methods were used to identify items which function differentially for white, black and coloured race groups. Opsomming Die doel van hierdie artikel is om die resultate van n ondersoek na die item- en toetseienskappe van twee PIB (Potential Index Batteries) toetse in terme van itemsydigheid en die invloed wat dit op die toetstellings van rassegroepe het, weer te gee. Die Potential Index Batteries (PIB) se Engelse Woordeskat (Index 12) en Spellingtoetse (Index 22) is ten opsigte van blanke, swart en gekleurde Suid-Afrikaners ontleed. Itemresponsteorie (IRT) is gebruik om items te identifiseer wat as sydig (DIP) vir die onderskeie rassegroepe beskou kan word.

Using the Short Form of the MSBS to Assess State Boredom Among Adolescents: Psychometric Evidence by Applying Item Response Theory

Assessment ◽  
2019 ◽  
pp. 107319111986465
Author(s):  
Maria Anna Donati ◽  
Elisa Borace ◽  
Edoardo Franchi ◽  
Caterina Primi
Keyword(s):  
High School Students ◽  
Item Response Theory ◽  
Item Response ◽  
Short Form ◽  
Response Theory ◽  
School Students ◽  
Gender Invariance ◽  
Item Functioning ◽  
State Boredom ◽  
Psychometric Evidence

The Multidimensional State Boredom Scale (MSBS) is widely used, but evidence regarding its psychometric properties among adolescents is lacking. In particular, the functioning of the scale across genders is unknown. As a result, we used item response theory (IRT) to investigate gender invariance of the Short Form of the MSBS (MSBS-SF) among adolescents. Four hundred and sixty-six Italian high school students (51% male; M = 16.7, SD = 1.44) were recruited. A confirmatory factor analysis demonstrated the unidimensionality of the scale, and IRT analyses indicated that the scale was sufficiently informative. Differential item functioning (DIF) across genders showed that only one item had DIF that was both nonuniform and small in size. Additionally, relationships with negative/positive urgency and present/future-oriented time perspectives were found. Overall, this study offers evidence that the MSBS-SF is a valuable and useful scale for measuring state boredom among male and female adolescents.

scholarly journals Differential item functioning of the Boston Naming Test in cognitively normal African American and Caucasian older adults

2009 ◽  
Vol 15 (5) ◽  
pp. 758-768 ◽  
Author(s):  
OTTO PEDRAZA ◽  
NEILL R. GRAFF-RADFORD ◽  
GLENN E. SMITH ◽  
ROBERT J. IVNIK ◽  
FLOYD B. WILLIS ◽  
...  
Keyword(s):  
African American ◽  
Item Response Theory ◽  
Differential Item Functioning ◽  
Item Response ◽  
Group Performance ◽  
Response Theory ◽  
Boston Naming Test ◽  
Item Functioning ◽  
The Impact ◽  
Naming Test

AbstractScores on the Boston Naming Test (BNT) are frequently lower for African American when compared with Caucasian adults. Although demographically based norms can mitigate the impact of this discrepancy on the likelihood of erroneous diagnostic impressions, a growing consensus suggests that group norms do not sufficiently address or advance our understanding of the underlying psychometric and sociocultural factors that lead to between-group score discrepancies. Using item response theory and methods to detect differential item functioning (DIF), the current investigation moves beyond comparisons of the summed total score to examine whether the conditional probability of responding correctly to individual BNT items differs between African American and Caucasian adults. Participants included 670 adults age 52 and older who took part in Mayo’s Older Americans and Older African Americans Normative Studies. Under a two-parameter logistic item response theory framework and after correction for the false discovery rate, 12 items where shown to demonstrate DIF. Of these 12 items, 6 (“dominoes,” “escalator,” “muzzle,” “latch,” “tripod,” and “palette”) were also identified in additional analyses using hierarchical logistic regression models and represent the strongest evidence for race/ethnicity-based DIF. These findings afford a finer characterization of the psychometric properties of the BNT and expand our understanding of between-group performance. (JINS, 2009, 15, 758–768.)

Interval Estimation of Latent Variable Scores in Item Response Theory

2017 ◽  
Vol 43 (3) ◽  
pp. 259-285 ◽  
Author(s):  
Yang Liu ◽  
Ji Seung Yang
Keyword(s):  
Item Response Theory ◽  
Item Response ◽  
Latent Variable ◽  
Interval Estimation ◽  
Random Variable ◽  
Item Parameter ◽  
Response Theory ◽  
Inference Problem ◽  
Irt Model ◽  
Item Parameter Estimation

The uncertainty arising from item parameter estimation is often not negligible and must be accounted for when calculating latent variable (LV) scores in item response theory (IRT). It is particularly so when the calibration sample size is limited and/or the calibration IRT model is complex. In the current work, we treat two-stage IRT scoring as a predictive inference problem: The target of prediction is a random variable that follows the true posterior of the LV conditional on the response pattern being scored. Various Bayesian, fiducial, and frequentist prediction intervals of LV scores, which can be obtained from a simple yet generic Monte Carlo recipe, are evaluated and contrasted via simulations based on several measures of prediction quality. An empirical data example is also presented to illustrate the use of candidate methods.

The Teen Screen for Dating Violence: An Item Response Theory Analysis

2019 ◽  
pp. 088626051986372 ◽  
Author(s):  
Kelly Emelianchik-Key ◽  
Kimberly F. Colvin
Keyword(s):  
Item Response Theory ◽  
Item Response ◽  
Dating Violence ◽  
Teen Dating Violence ◽  
Response Theory ◽  
Item Functioning ◽  
Item Response Theory Analysis ◽  
Males And Females ◽  
Teen Dating ◽  
Study Participants

There continues to be a lack of fundamental knowledge regarding assessment, conceptualization, and treatment of teen dating violence (TDV). This deficiency of knowledge becomes even greater when examining gender differences in violence experience, perpetration, and perception. This article details the item response theory (IRT) analysis of the Teen Screen for Dating Violence (TSDV) and includes an assessment of differential item functioning (DIF) reported by gender. The TSDV examines adolescents’ perception, experience, perpetration, and exposure to violence, while also exploring support systems. The study participants included males and females between 13 and 21 years of age. Further refinement of the TSDV contributes to a more accurate and comprehensive conceptualization of TDV measurement. The results of this study support the use of the TSDV to assess for TDV in the adolescent population. The DIF analysis reveals that many of the items function differently for males and females, which provides evidence indicating that how TDV is experienced, perceived, and perpetrated differs across gender. The TSDV can assist clinicians in early TDV prevention, intervention, and education for males and females. It can also assist researchers in more accurately estimating perpetration, experience, and conceptualization of the three violence facets (emotional, physical, and sexual) in males and females. To further expand TDV knowledge, we offer recommendations for the use of the TSDV in various settings. The TSDV is a vital tool for clinicians, supervisors, and researchers to implement to mitigate the TDV epidemic and help bridge the gap in mental health services.

Sign in / Sign up

Export Citation Format

Share Document