scholarly journals Psychometric evaluation of an Italian custom 4-item short form of the PROMIS anxiety item bank in immune-mediated inflammatory diseases: an item response theory analysis

PeerJ ◽  
2021 ◽  
Vol 9 ◽  
pp. e12100
Author(s):  
Marco Tullio Liuzza ◽  
Rocco Spagnuolo ◽  
Gabriella Antonucci ◽  
Rosa Daniela Grembiale ◽  
Cristina Cosco ◽  
...  
Keyword(s):  
Item Response Theory ◽  
Psychometric Properties ◽  
Item Response ◽  
Inflammatory Diseases ◽  
Short Form ◽  
Latent Trait ◽  
Test Reliability ◽  
Control Group ◽  
Response Theory ◽  
Patient Reported

Background There has recently been growing interest in the roles of inflammation in contributing to the development of anxiety in people with immune-mediated inflammatory diseases (IMID). Patient-reported outcome measures can facilitate the assessment of physical and psychological functioning. The National Institutes of Health (NIH)’s Patient-Reported Outcomes Measurement Information System (PROMIS®) is a set of Patient-Reported Outcomes (PROs) that cover physical appearance, mental health, and social health. The PROMIS has been built through an Item Response Theory approach (IRT), a model-based measurement in which trait level estimates depend on both persons’ responses and on the properties of the items that were administered. The aim of this study is to test the psychometric properties of an Italian custom four-item Short Form of the PROMIS Anxiety item bank in a cohort of outpatients with IMIDs. Methods We selected four items from the Italian standard Short Form Anxiety 8a and administered them to consecutive outpatients affected by Inflammatory Bowel disease (n = 246), rheumatological (n = 100) and dermatological (n = 43) diseases, and healthy volunteers (n = 280). Data was analyzed through an Item Response Theory (IRT) analysis in order to evaluate the psychometric properties of the Italian adaptation of the PROMIS anxiety short form. Results Taken together, Confirmatory Factor Analysis and Exploratory Factor analysis suggest that the unidimensionality assumption of the instrument holds. The instrument has excellent reliability from a Classical Theory of Test (CTT) standpoint (Cronbach’s α = 0.93, McDonald’s ω = 0.92). The 2PL Graded Response Model (GRM) model provided showed a better goodness of fit as compared to the 1PL GRM model, and local independence assumption appears to be met overall. We did not find signs of differential item functioning (DIF) for age and gender, but evidence for uniform (but not non-uniform) DIF was found in three out of four items for the patient vs. control group. Analysis of the test reliability curve suggested that the instrument is most reliable for higher levels of the latent trait of anxiety. The groups of patients exhibited higher levels of anxiety as compared to the control group (ps < 0.001, Bonferroni-corrected). The groups of patients were not different between themselves (p = 1, Bonferroni-corrected). T-scores based on estimated latent trait and raw scores were highly correlated (Pearson’s r = 0.98) and led to similar results. Discussion The Italian custom four-item short form from the PROMIS anxiety form 8a shows acceptable psychometric properties both from a CTT and an IRT standpoint. The Test Reliability Curve shows that this instrument is mostly informative for people with higher levels of anxiety, making it particularly suitable for clinical populations such as IMID patients.

Psychometric evaluation of an Italian adaptation of the PROMIS® anxiety short form in Immune-Mediated Inflammatory Diseases. An Item Response Theory analysis.

2020 ◽  
Author(s):  
Rocco Spagnuolo ◽  
Gabriella Antonucci ◽  
Rosa Daniela Grembiale ◽  
Cristina Cosco ◽  
Vanessa Funari ◽  
...  
Keyword(s):  
Factor Analysis ◽  
Item Response Theory ◽  
Psychometric Properties ◽  
Item Response ◽  
Patient Reported Outcomes ◽  
Inflammatory Diseases ◽  
Short Form ◽  
Response Theory ◽  
Immune Mediated ◽  
Patient Reported

Background: The prevalence of anxiety is three times greater in patients with chronic diseases than in the general population. There has recently been growing interest in the roles of inflammation in contributing to the development of anxiety in people with Immune-mediated inflammatory diseases (IMID). Patient-reported outcome measures can facilitate the assessment of physical and psychological functioning. In recent years various patient outcome measures (PROMs) have been implemented. The National Institutes of Health (NIH)'s Patient-Reported Outcomes Measurement Information System (PROMIS®) is a set of publicly available and standardized Patient-Reported Outcomes (PROs) that cover physical appearance, mental health, and social health. The PROMIS® has been built through an Item Response Theory approach (IRT), a model-based measurement in which trait level estimates depend on both persons' responses and on the properties of the items that were administered. The aim of this study is to test the psychometric properties of the original anxiety items of the PROMIS® in a cohort of outpatients with IMIDs.Methods: We translated the original eight anxiety items from the PROMIS into Italian and administered them to consecutive outpatients affected by Inflammatory Bowel disease (n = 246), rheumatological (n = 100) and dermatological (n = 43) diseases, and healthy volunteers (n = 280). We analyzed the data through an Item Response Theory (IRT) analysis to evaluate the psychometric properties of the Italian adaptation of the PROMIS® anxiety short form.Results: Taken together, Confirmatory Factor Analysis and Exploratory Factor analysis suggested that the unidimensionality assumption if the instrument holds. The instrument has excellent reliability from a Classical Theory of Test (CTT) standpoint (Cronbach's ⍺ = .94, McDonald's ω = .95). The 1PL Graded Response Model (GRM) model provided a good balance between the goodness of fit and parsimony (BIC = 9099.82) as compared to the 2PL GRM model (BIC = 9111.02). We did not find signs of Differential Item Functioning (DIF), but we found that the local independence assumption was violated for some items. The analysis of the test reliability curve suggested that the instrument is most reliable for higher levels of the latent trait of anxiety.Discussion: The Italian adaptation of the PROMIS® anxiety short form shows acceptable psychometric properties both from a CTT and an IRT standpoint. Its compatibility with the 1 parameter logistic (1PL) model implies that its total score is a sufficient statistic for the latent anxiety trait. The TRC shows that this instrument is mostly informative for people with higher levels of anxiety, making it particularly suitable for clinical populations such as IMID patients.

Geriatric Anxiety Scale: item response theory analysis, differential item functioning, and creation of a ten-item short form (GAS-10)

2014 ◽  
Vol 27 (7) ◽  
pp. 1099-1111 ◽  
Author(s):  
Anne E. Mueller ◽  
Daniel L. Segal ◽  
Brandon Gavett ◽  
Meghan A. Marty ◽  
Brian Yochim ◽  
...  
Keyword(s):  
Older Adults ◽  
Item Response Theory ◽  
Psychometric Properties ◽  
Differential Item Functioning ◽  
Item Response ◽  
Short Form ◽  
Anxiety Scale ◽  
Response Theory ◽  
Item Functioning ◽  
The Impact

ABSTRACTBackground:The Geriatric Anxiety Scale (GAS; Segal et al. (Segal, D. L., June, A., Payne, M., Coolidge, F. L. and Yochim, B. (2010). Journal of Anxiety Disorders, 24, 709–714. doi:10.1016/j.janxdis.2010.05.002) is a self-report measure of anxiety that was designed to address unique issues associated with anxiety assessment in older adults. This study is the first to use item response theory (IRT) to examine the psychometric properties of a measure of anxiety in older adults.Method:A large sample of older adults (n = 581; mean age = 72.32 years, SD = 7.64 years, range = 60 to 96 years; 64% women; 88% European American) completed the GAS. IRT properties were examined. The presence of differential item functioning (DIF) or measurement bias by age and sex was assessed, and a ten-item short form of the GAS (called the GAS-10) was created.Results:All GAS items had discrimination parameters of 1.07 or greater. Items from the somatic subscale tended to have lower discrimination parameters than items on the cognitive or affective subscales. Two items were flagged for DIF, but the impact of the DIF was negligible. Women scored significantly higher than men on the GAS and its subscales. Participants in the young-old group (60 to 79 years old) scored significantly higher on the cognitive subscale than participants in the old-old group (80 years old and older).Conclusions:Results from the IRT analyses indicated that the GAS and GAS-10 have strong psychometric properties among older adults. We conclude by discussing implications and future research directions.

Evaluation of the Psychometric Properties of the Asian Adolescent Depression Scale and Construction of a Short Form: An Item Response Theory Analysis

Assessment ◽  
2015 ◽  
Vol 24 (5) ◽  
pp. 660-676 ◽  
Author(s):  
Barbara Chuen Yee Lo ◽  
Yue Zhao ◽  
Alice Wai Yee Kwok ◽  
Wai Chan ◽  
Calais Kin Yuen Chan
Keyword(s):  
Item Response Theory ◽  
Psychometric Properties ◽  
Item Response ◽  
Adolescent Depression ◽  
Depressive Symptomatology ◽  
Short Form ◽  
Depression Scale ◽  
Response Theory ◽  
Item Response Theory Analysis ◽  
Full Form

The present study applied item response theory to examine the psychometric properties of the Asian Adolescent Depression Scale and to construct a short form among 1,084 teenagers recruited from secondary schools in Hong Kong. Findings suggested that some items of the full form reflected higher levels of severity and were more discriminating than others, and the Asian Adolescent Depression Scale was useful in measuring a broad range of depressive severity in community youths. Differential item functioning emerged in several items where females reported higher depressive severity than males. In the short form construction, preliminary validation suggested that, relative to the 20-item full form, our derived short form offered significantly greater diagnostic performance and stronger discriminatory ability in differentiating depressed and nondepressed groups, and simultaneously maintained adequate measurement precision with a reduced response burden in assessing depression in the Asian adolescents. Cultural variance in depressive symptomatology and clinical implications are discussed.

Item Response Theory Analysis of the Big Five Questionnaire for Children–Short Form (BFC-SF): A Self-Report Measure of Personality in Children Aged 11–12 Years

2020 ◽  
Vol 34 (1) ◽  
pp. 40-63 ◽  
Author(s):  
Miles Bore ◽  
Kristin R. Laurens ◽  
Megan J. Hobbs ◽  
Melissa J. Green ◽  
Stacy Tzoumakis ◽  
...  
Keyword(s):  
Item Response Theory ◽  
Psychometric Properties ◽  
Item Response ◽  
Big Five ◽  
Short Form ◽  
Self Report ◽  
Big Five Personality ◽  
Response Theory ◽  
Personality Dimensions ◽  
Report Measure

Prior investigations indicate that the five core personality dimensions (the “Big Five”) are measurable by middle childhood. The aim of this research was to examine the psychometric properties of a short-form self-report measure of the Big Five personality dimensions in children that would be suitable for administration online in large population-based studies. Twenty-five questionnaire items in English, derived from the 65-item Big Five Questionnaire for Children in Italian (Barbaranelli, Caprara, Rabasca, & Pastorelli, 2003), were completed online by 27,415 Australian children in Year 6 (mean age 11.92 years). An item response theory approach evaluated the psychometric properties and resolved a 20-item short-form questionnaire. Exploratory and confirmatory factor analyses supported the Big Five structure. Construct validity was demonstrated via correlations between Big Five scores and the Strengths and Difficulties Questionnaire subscales (Goodman, 2001). The 20 items provide a brief, reliable, and valid child self-report measure of the Big Five personality dimensions.

scholarly journals Item Response Theory, Computerized Adaptive Testing, and PROMIS: Assessment of Physical Function

2013 ◽  
Vol 41 (1) ◽  
pp. 153-158 ◽  
Author(s):  
James F. Fries ◽  
James Witter ◽  
Matthias Rose ◽  
David Cella ◽  
Dinesh Khanna ◽  
...  
Keyword(s):  
Item Response Theory ◽  
Physical Function ◽  
Item Response ◽  
Computerized Adaptive Testing ◽  
Short Form ◽  
Adaptive Testing ◽  
Self Report ◽  
Measurement Information ◽  
Response Theory ◽  
Patient Reported

Objective.Patient-reported outcome (PRO) questionnaires record health information directly from research participants because observers may not accurately represent the patient perspective. Patient-reported Outcomes Measurement Information System (PROMIS) is a US National Institutes of Health cooperative group charged with bringing PRO to a new level of precision and standardization across diseases by item development and use of item response theory (IRT).Methods.With IRT methods, improved items are calibrated on an underlying concept to form an item bank for a “domain” such as physical function (PF). The most informative items can be combined to construct efficient “instruments” such as 10-item or 20-item PF static forms. Each item is calibrated on the basis of the probability that a given person will respond at a given level, and the ability of the item to discriminate people from one another. Tailored forms may cover any desired level of the domain being measured. Computerized adaptive testing (CAT) selects the best items to sharpen the estimate of a person’s functional ability, based on prior responses to earlier questions. PROMIS item banks have been improved with experience from several thousand items, and are calibrated on over 21,000 respondents.Results.In areas tested to date, PROMIS PF instruments are superior or equal to Health Assessment Questionnaire and Medical Outcome Study Short Form-36 Survey legacy instruments in clarity, translatability, patient importance, reliability, and sensitivity to change.Conclusion.Precise measures, such as PROMIS, efficiently incorporate patient self-report of health into research, potentially reducing research cost by lowering sample size requirements. The advent of routine IRT applications has the potential to transform PRO measurement.

Item Response Theory Analysis: PROMIS® Anxiety Form and Generalized Anxiety Disorder Scale

2021 ◽  
pp. 019394592110159
Author(s):  
Wen Liu ◽  
Lilian Dindo ◽  
Katherine Hadlandsmyth ◽  
George Jay Unick ◽  
M. Bridget Zimmerman ◽  
...  
Keyword(s):  
Anxiety Disorder ◽  
Item Response Theory ◽  
Item Response ◽  
Generalized Anxiety Disorder ◽  
Item Difficulty ◽  
Short Form ◽  
Generalized Anxiety ◽  
Response Theory ◽  
Patient Reported ◽  
Item Scale

Little research has compared item functioning of the Patient-Reported Outcomes Measurement Information System (PROMIS®) anxiety short form 6a and the generalized anxiety disorder 7-item scale using item response theory models. This was a secondary analysis of self-reported assessments from 67 at-risk U.S. military veterans. The two measures performed comparably well with data fitting adequately to models, acceptable item discriminations, and item and test information curves being unimodal and symmetric. The PROMIS® anxiety short form 6a performed better in that item difficulty estimates had a wider range and distributed more evenly and all response categories had less floor effect, while the third category in most items of the generalized anxiety disorder 7-item scale were rarely used. While both measures may be appropriate, findings provided preliminary information supporting use of the PROMIS® anxiety short form 6a as potentially preferable, especially for veterans with low-to-moderate anxiety. Further testing is needed in larger, more diverse samples.

scholarly journals Two parallel short forms to measure disease- and treatment-associated knowledge in rheumatoid arthritis: application of item response theory

2020 ◽  
Vol 4 (2) ◽  
Author(s):  
Marieke J Spijk-de Jonge ◽  
Martijn A H Oude Voshaar ◽  
Lisanne Renskers ◽  
Anita M P Huis ◽  
Mart A F J van de Laar ◽  
...  
Keyword(s):  
Item Response Theory ◽  
Educational Attainment ◽  
Psychometric Properties ◽  
Item Response ◽  
Short Form ◽  
Item Bank ◽  
T Test ◽  
Response Theory ◽  
Short Forms ◽  
Paired T Test

Abstract Objective The aim was to develop two disease- and treatment-related knowledge about RA (DataK-RA) short forms using item response theory-based linear optimal test design. Methods We used the open source Excel add-in solver to program a linear optimization algorithm to develop two short forms from the DataK-RA item bank. The algorithm was instructed to optimize precision (i.e. reliability) of the scores for both short forms, subject to a number of constraints that served to ensure that each short form would include unique items and that the short forms would have similar psychometric properties. Agreement among item response theory scores obtained from the different short forms was assessed using the Bland–Altman method and Student’s paired t-test. Construct validity and relative efficiency of the short forms was evaluated by relating the score to age, sex and educational attainment. Results Two short forms were derived from the DataK-RA item bank that satisfied all content constraints. Both short forms included 15 unique items and yielded reliable scores (r &gt; 0.70), with low ceiling and floor effects. The short forms yielded statistically indistinguishable mean scores according to Student’s paired t-test and Bland–Altman analysis. Scores on short forms 1 and 2 were associated with age, sex and educational attainment to a similar extent. Conclusion In this study, we developed two DataK-RA short forms with unique items, yet similar psychometric properties, that can be used to assess patients pre- and post-test interventions aimed at improving disease-related knowledge in RA patients.

scholarly journals The Revised Mood Rhythm Instrument: A Large Multicultural Psychometric Study

2021 ◽  
Vol 10 (3) ◽  
pp. 388
Author(s):  
Melissa Alves Braga de Oliveira ◽  
Euclides de Mendonça Filho ◽  
Alicia Carissimi ◽  
Luciene Lima dos Santos Garay ◽  
Marina Scop ◽  
...  
Keyword(s):  
Factor Analysis ◽  
Item Response Theory ◽  
Network Analysis ◽  
Psychometric Properties ◽  
Item Response ◽  
Response Theory ◽  
Item Response Theory Analysis ◽  
Increased Risk ◽  
Psychometric Analyses ◽  
Self Reporting Questionnaire

Background: Recent studies with the mood rhythm instrument (MRhI) have shown that the presence of recurrent daily peaks in specific mood symptoms are significantly associated with increased risk of psychiatric disorders. Using a large sample collected in Brazil, Spain, and Canada, we aimed to analyze which MRhI items maintained good psychometric properties across cultures. As a secondary aim, we used network analysis to visualize the strength of the association between the MRhI items. Methods: Adults (n = 1275) between 18–60 years old from Spain (n = 458), Brazil (n = 415), and Canada (n = 401) completed the MRhI and the self-reporting questionnaire (SRQ-20). Psychometric analyses followed three steps: Factor analysis, item response theory, and network analysis. Results: The factor analysis indicated the retention of three factors that grouped the MRhI items into cognitive, somatic, and affective domains. The item response theory analysis suggested the exclusion of items that displayed a significant divergence in difficulty measures between countries. Finally, the network analysis revealed a structure where sleepiness plays a central role in connecting the three domains. These psychometric analyses enabled a psychometric-based refinement of the MRhI, where the 11 items with good properties across cultures were kept in a shorter, revised MRhI version (MRhI-r). Limitations: Participants were mainly university students and, as we did not conduct a formal clinical assessment, any potential correlations (beyond the validated SRQ) cannot be ascertained. Conclusions: The MRhI-r is a novel tool to investigate self-perceived rhythmicity of mood-related symptoms and behaviors, with good psychometric properties across multiple cultures.

scholarly journals Using Item Response Theory to Identify Responders to Treatment: Examples with the Patient-Reported Outcomes Measurement Information System (PROMIS®) Physical Function Scale and Emotional Distress Composite

Psychometrika ◽  
2021 ◽  
Author(s):  
Ron D. Hays ◽  
Karen L. Spritzer ◽  
Steven P. Reise
Keyword(s):  
Item Response Theory ◽  
Physical Function ◽  
Item Response ◽  
Emotional Distress ◽  
Classical Test Theory ◽  
Test Theory ◽  
Measurement Information ◽  
Response Theory ◽  
Reliable Change ◽  
Patient Reported

AbstractThe reliable change index has been used to evaluate the significance of individual change in health-related quality of life. We estimate reliable change for two measures (physical function and emotional distress) in the Patient-Reported Outcomes Measurement Information System (PROMIS®) 29-item health-related quality of life measure (PROMIS-29 v2.1). Using two waves of data collected 3 months apart in a longitudinal observational study of chronic low back pain and chronic neck pain patients receiving chiropractic care, and simulations, we compare estimates of reliable change from classical test theory fixed standard errors with item response theory standard errors from the graded response model. We find that unless true change in the PROMIS physical function and emotional distress scales is substantial, classical test theory estimates of significant individual change are much more optimistic than estimates of change based on item response theory.

Sign in / Sign up

Export Citation Format

Share Document