scholarly journals Performance of a Rasch-based method for group comparisons of longitudinal change and response shift at the item level in PRO data: a simulation study

Methods ◽  
2022 ◽  
Author(s):  
Myriam Blanchin ◽  
Priscilla Brisson ◽  
Véronique Sébille
Keyword(s):  
Simulation Study ◽  
Response Shift ◽  
Longitudinal Change ◽  
Item Level ◽  
Group Comparisons

scholarly journals Overall performance of Oort’s procedure for response shift detection at item level: a pilot simulation study

2015 ◽  
Vol 24 (8) ◽  
pp. 1799-1807 ◽  
Author(s):  
Antoine Vanier ◽  
Véronique Sébille ◽  
Myriam Blanchin ◽  
Alice Guilleux ◽  
Jean-Benoit Hardouin
Keyword(s):  
Simulation Study ◽  
Response Shift ◽  
Item Level ◽  
Shift Detection ◽  
Overall Performance

A Simulation Study of Reliability and Validity of Multiple-Choice Test Scores Under Six Response-Scoring Modes

1982 ◽  
Vol 7 (4) ◽  
pp. 333-351 ◽  
Author(s):  
Robert B. Frary
Keyword(s):  
Simulation Study ◽  
Test Scores ◽  
Reliability And Validity ◽  
Internal Consistency Reliability ◽  
Choice Test ◽  
True Score ◽  
Multiple Choice Test ◽  
Item Level ◽  
Four Levels ◽  
Carry Over

Responses to a 40-item, four-choice test were simulated for 120 examinees under six response-scoring modes including number-right, corrected-for-guessing and answer-until-correct. Separate score sets were generated to reflect five levels of prevalence of misinformation (belief that an answer is a distractor) and five levels of propensity-to-guess contrary to instructions for modes designed to inhibit guessing. Criteria were simulated using the number-right mode with five levels of misinformation prevalence and four levels of true-score relationship with the predictor. The entire process was repeated with the introduction of normally distributed, random error at the item level. This process yielded 260 sets of five scores (predictor and four criteria), which were examined to determine differential effects on reliability and validity attributable to the response-scoring modes. Modes permitting multiple responses to an item were found to yield genuine increases in internal consistency reliability, which tended to carry over into validity coefficients. However, the validity differences among all the response-scoring modes simulated were small, probably too small to justify the additional cost and complexity of modes other than number-right.

scholarly journals How to Investigate the Effects of Groups on Changes in Longitudinal Patient-Reported Outcomes and Response Shift Using Rasch Models

2020 ◽  
Vol 11 ◽  
Author(s):  
Karima Hammas ◽  
Véronique Sébille ◽  
Priscilla Brisson ◽  
Jean-Benoit Hardouin ◽  
Myriam Blanchin
Keyword(s):  
Patient Reported Outcomes ◽  
Measurement Theory ◽  
Response Shift ◽  
Longitudinal Change ◽  
Measurement Occasion ◽  
Longitudinal Measurement ◽  
Shift Analysis ◽  
Patient Reported ◽  
Shift Effect ◽  
Over Time

In order to investigate patients’ experience of healthcare, repeated assessments of patient-reported outcomes (PRO) are increasingly performed in observational studies and clinical trials. Changes in PRO can however be difficult to interpret in longitudinal settings as patients’ perception of the concept being measured may change over time, leading to response shift (longitudinal measurement non-invariance) and possibly to erroneous interpretation of the observed changes in PRO. Several statistical methods for response shift analysis have been proposed, but they usually assume that response shift occurs in the same way in all individuals within the sample regardless of their characteristics. Many studies aim at comparing the longitudinal change of PRO into two groups of patients (treatment arm, different pathologies, …). The group variable could have an effect on PRO change but also on response shift effect and the perception of the questionnaire at baseline. In this paper, we propose to enhance the ROSALI algorithm based on Rasch Measurement Theory for the analysis of longitudinal PRO data to simultaneously investigate the effects of group on item functioning at the first measurement occasion, on response shift and on changes in PRO over time. ROSALI is subsequently applied to a longitudinal dataset on change in emotional functioning in patients with breast cancer or melanoma during the year following diagnosis. The use of ROSALI provides new insights in the analysis of longitudinal PRO data.

scholarly journals An item-level response shift study on the change of health state with the rating of asthma-specific quality of life: a report from the PROMIS® Pediatric Asthma Study

2016 ◽  
Vol 25 (6) ◽  
pp. 1349-1359 ◽  
Author(s):  
Pranav K. Gandhi ◽  
Carolyn E. Schwartz ◽  
Bryce B. Reeve ◽  
Darren A. DeWalt ◽  
Heather E. Gross ◽  
...  
Keyword(s):  
Quality Of Life ◽  
Pediatric Asthma ◽  
Response Shift ◽  
Health State ◽  
Item Level ◽  
Shift Study

Longitudinal Change in Response Processes: A Response Shift Perspective

2017 ◽  
pp. 251-276 ◽  
Author(s):  
Richard Sawatzky ◽  
Tolulope T. Sajobi ◽  
Ronak Brahmbhatt ◽  
Eric K. H. Chan ◽  
Lisa M. Lix ◽  
...  
Keyword(s):  
Response Shift ◽  
Longitudinal Change

Comparison Of Item-Level And Score-Level Typological Analysis: A Simulation Study

1976 ◽  
Vol 11 (2) ◽  
pp. 135-145 ◽  
Author(s):  
Antanas Suziedelis ◽  
Maurice Lorr ◽  
Xenia Tonesk
Keyword(s):  
Simulation Study ◽  
Item Level

scholarly journals Comparison of structural equation modelling, item response theory and Rasch measurement theory-based methods for response shift detection at item level: A simulation study

2019 ◽  
Vol 29 (4) ◽  
pp. 1015-1029 ◽  
Author(s):  
Myriam Blanchin ◽  
Alice Guilleux ◽  
Jean-Benoit Hardouin ◽  
Véronique Sébille
Keyword(s):  
Item Response Theory ◽  
Item Response ◽  
Structural Equation Modelling ◽  
Structural Equation ◽  
Measurement Theory ◽  
Response Shift ◽  
Rasch Measurement ◽  
Rasch Measurement Theory ◽  
Equation Modelling ◽  
Item Level

When assessing change in patient-reported outcomes, the meaning in patients’ self-evaluations of the target construct is likely to change over time. Therefore, methods evaluating longitudinal measurement non-invariance or response shift at item-level were proposed, based on structural equation modelling or on item response theory. Methods coming from Rasch measurement theory could also be valuable. The lack of evaluation of these approaches prevents determining the best strategy to adopt. A simulation study was performed to compare and evaluate the performance of structural equation modelling, item response theory and Rasch measurement theory approaches for item-level response shift detection. Performances of these three methods in different situations were evaluated with the rate of false detection of response shift (when response shift was not simulated) and the rate of correct response shift detection (when response shift was simulated). The Rasch measurement theory-based method performs better than the structural equation modelling and item response theory-based methods when recalibration was simulated. Consequently, the Rasch measurement theory-based approach should be preferred for studies investigating only recalibration response shift at item-level. For structural equation modelling and item response theory, the low rates of reprioritization detection raise issues on the potential different meaning and interpretation of reprioritization at item-level.

Sign in / Sign up

Export Citation Format

Share Document