scholarly journals Rasch Model of the COVID-19 Symptom Checklist - Towards a Higher Quality of Self-Reported Measurement

2021 ◽  
Author(s):  
Tanja A Stamm ◽  
Valentin Ritschl ◽  
Maisa Omara ◽  
Margaret R Andrews ◽  
Nils Mevenkamp ◽  
...  
Keyword(s):  
Rasch Model ◽  
Pollen Allergy ◽  
Educational Status ◽  
Measurement Model ◽  
Measurement Precision ◽  
The Self ◽  
Symptom Checklist ◽  
Personal Factors ◽  
Lay Persons ◽  
The Rasch Model

Abstract Background: Inaccurate measurement of self-reported instruments including questionnaires and symptom checklists jeopardizes the comparability of the results. We therefore used advanced psychometric modelling to determine if the fundamental principles of measurement of an online self-reported COVID-19 symptom checklist were met or whether adaptations were necessary to increase measurement precision.Methods: Fit to the Rasch model was examined in a sample of 1638 Austrian citizens who completed an online COVID-19 symptom checklist on up to 20 days during a period of restrictive country-wide COVID-19 measures.Results: The longitudinal application of the self-reported COVID-19 symptom checklist increased the fit to the Rasch model. The items ‘fatigue’, ‘headache’ and ‘sneezing’ had the highest likelihood to be affirmed. The item ‘cough’ showed a significant misfit to the fundamental measurement model and an additional dependency to ’dry cough/no sputum production’. Several personal factors, such as gender, age group, educational status, COVID-19 test status, comorbidities, immunosuppressive medication, pregnancy and pollen allergy led to systematic differences in the patterns of how symptoms were affirmed. Adjustments ranged from ±0.25 to ±0.01 on the metric scales (0 to 10) to which the raw scores were transformed.Conclusion: Except for some basic adaptations, the present analysis supports the combination of items. More accurate item wordings co-created with lay persons and adjustments for personal factors would increase measurement precision of the self-reported COVID-19 symptom checklist.

scholarly journals Rasch Model of the COVID-19 Symptom Checklist—A Psychometric Validation Study

Viruses ◽  
2021 ◽  
Vol 13 (9) ◽  
pp. 1762
Author(s):  
Tanja A. Stamm ◽  
Valentin Ritschl ◽  
Maisa Omara ◽  
Margaret R. Andrews ◽  
Nils Mevenkamp ◽  
...  
Keyword(s):  
Construct Validity ◽  
Internal Consistency ◽  
Rasch Model ◽  
Pollen Allergy ◽  
Measurement Model ◽  
Psychometric Validation ◽  
Symptom Checklist ◽  
Personal Factors ◽  
Specific Symptom ◽  
The Rasch Model

While self-reported Coronavirus Disease 2019 (COVID-19) symptom checklists have been extensively used during the pandemic, they have not been sufficiently validated from a psychometric perspective. We, therefore, used advanced psychometric modelling to explore the construct validity and internal consistency of an online self-reported COVID-19 symptom checklist and suggested adaptations where necessary. Fit to the Rasch model was examined in a sample of 1638 Austrian citizens who completed the checklist on up to 20 days during a lockdown. The items’ fatigue’, ‘headache’ and ‘sneezing’ had the highest likelihood to be affirmed. The longitudinal application of the symptom checklist increased the fit to the Rasch model. The item ‘cough’ showed a significant misfit to the fundamental measurement model and an additional dependency to ‘dry cough/no sputum production’. Several personal factors, such as gender, age group, educational status, COVID-19 test status, comorbidities, immunosuppressive medication, pregnancy and pollen allergy led to systematic differences in the patterns of how symptoms were affirmed. Raw scores’ adjustments ranged from ±0.01 to ±0.25 on the metric scales (0 to 10). Except for some basic adaptations that increases the scale’s construct validity and internal consistency, the present analysis supports the combination of items. More accurate item wordings co-created with laypersons would lead to a common understanding of what is meant by a specific symptom. Adjustments for personal factors and comorbidities would allow for better clinical interpretations of self-reported symptom data.

scholarly journals Measurement Precision and Efficiency of Computerized Adaptive Testing for the Activities-specific Balance Confidence Scale in People With Stroke

2021 ◽  
Author(s):  
Bryant A Seamon ◽  
Steven A Kautz ◽  
Craig A Velozo
Keyword(s):  
Rasch Model ◽  
Computerized Adaptive Testing ◽  
Adaptive Testing ◽  
Measurement Precision ◽  
Strongly Correlated ◽  
Computerized Adaptive Test ◽  
Balance Confidence ◽  
Adaptive Test ◽  
The Rasch Model ◽  
Confidence Scale

Abstract Objective Administrative burden often prevents clinical assessment of balance confidence in people with stroke. A computerized adaptive test (CAT) version of the Activities-specific Balance Confidence Scale (ABC CAT) can dramatically reduce this burden. The objective of this study was to test balance confidence measurement precision and efficiency in people with stroke with an ABC CAT. Methods We conducted a retrospective cross-sectional simulation study with data from 406 adults approximately 2-months post-stroke in the Locomotor-Experience Applied Post-Stroke (LEAPS) trial. Item parameters for CAT calibration were estimated with the Rasch model using a random sample of participants (n = 203). Computer simulation was used with response data from remaining 203 participants to evaluate the ABC CAT algorithm under varying stopping criteria. We compared estimated levels of balance confidence from each simulation to actual levels predicted from the Rasch model (Pearson correlations and mean standard error (SE)). Results Results from simulations with number of items as a stopping criterion strongly correlated with actual ABC scores (full item, r = 1, 12-item, r = 0.994; 8-item, r = 0.98; 4-item, r = 0.929). Mean SE increased with decreasing number of items administered (full item, SE = 0.31; 12-item, SE = 0.33; 8-item, SE = 0.38; 4-item, SE = 0.49). A precision-based stopping rule (mean SE = 0.5) also strongly correlated with actual ABC scores (r = .941) and optimized the relationship between number of items administrated with precision (mean number of items 4.37, range [4–9]). Conclusions An ABC CAT can determine accurate and precise measures of balance confidence in people with stroke with as few as 4 items. Individuals with lower balance confidence may require a greater number of items (up to 9) and attributed to the LEAPS trial excluding more functionally impaired persons. Impact Statement Computerized adaptive testing can drastically reduce the ABC’s test administration time while maintaining accuracy and precision. This should greatly enhance clinical utility, facilitating adoption of clinical practice guidelines in stroke rehabilitation. Lay Summary If you have had a stroke, your physical therapist will likely test your balance confidence. A computerized adaptive test version of the ABC scale can accurately identify balance with as few as 4 questions, which takes much less time.

scholarly journals Comparing item parameter estimates and fit statistics of the Rasch model from three different traditions

2020 ◽  
Vol 24 (1) ◽  
Author(s):  
Bahrul Hayat ◽  
Muhammad Dwirifqi Kharisma Putra ◽  
Bambang Suryadi
Keyword(s):  
Factor Analysis ◽  
Rasch Model ◽  
Measurement Model ◽  
Rasch Measurement ◽  
Item Parameter ◽  
Rasch Models ◽  
Rasch Measurement Model ◽  
Item Factor Analysis ◽  
The Rasch Model ◽  
Special Case

Rasch model is a method that has a long history in its application in the fields of social and behavioral sciences including educational measurement. Under certain circumstances, Rasch models are known as a special case of Item response theory (IRT), while IRT is equivalent to the Item Factor Analysis (IFA) models as a special case of Structural Equation Models (SEM), although there are other ‘tradition’ that consider Rasch measurement models not part of both. In this study, a simulation study was conducted to using simulated data to explain how the interrelationships between the Rasch model as a constraint version of 2-parameter logistic (2-PL) IRT, Rasch model as an item factor analysis were compared with the Rasch measurement model using Mplus, IRTPRO and WINSTEPS program, each of which came from its own 'tradition'. The results of this study indicate that Rasch models and IFA as a special case of SEM are mathematically equal, as well as the Rasch measurement model, but due to different philosophical perspectives people might vary in their understanding about this concept. Given the findings of this study, it is expected that confusion and misunderstanding between the three can be overcome.

scholarly journals The direction of the response scale matters – accounting for the unit of measurement

2019 ◽  
Vol 53 (5) ◽  
pp. 871-891
Author(s):  
Thomas Salzberger ◽  
Monika Koller
Keyword(s):  
Rasch Model ◽  
Measurement Theory ◽  
Measurement Precision ◽  
Spatial Proximity ◽  
Validity And Reliability ◽  
Measurement Instruments ◽  
Response Scale ◽  
Content Type ◽  
Unit Of Measurement ◽  
The Rasch Model

Purpose Psychometric analyses of self-administered questionnaire data tend to focus on items and instruments as a whole. The purpose of this paper is to investigate the functioning of the response scale and its impact on measurement precision. In terms of the response scale direction, existing evidence is mixed and inconclusive. Design/methodology/approach Three experiments are conducted to examine the functioning of response scales of different direction, ranging from agree to disagree versus from disagree to agree. The response scale direction effect is exemplified by two different latent constructs by applying the Rasch model for measurement. Findings The agree-to-disagree format generally performs better than the disagree-to-agree variant with spatial proximity between the statement and the agree-pole of the scale appearing to drive the effect. The difference is essentially related to the unit of measurement. Research limitations/implications A careful investigation of the functioning of the response scale should be part of every psychometric assessment. The framework of Rasch measurement theory offers unique opportunities in this regard. Practical implications Besides content, validity and reliability, academics and practitioners utilising published measurement instruments are advised to consider any evidence on the response scale functioning that is available. Originality/value The study exemplifies the application of the Rasch model to assess measurement precision as a function of the design of the response scale. The methodology raises the awareness for the unit of measurement, which typically remains hidden.

scholarly journals A Rasch analysis of the self-administered Foot Health Assessment Instrument (S-FHAI)

BMC Nursing ◽  
2021 ◽  
Vol 20 (1) ◽  
Author(s):  
Minna Stolt ◽  
Anders Kottorp ◽  
Riitta Suhonen
Keyword(s):  
Psychometric Properties ◽  
Rasch Model ◽  
Rasch Analysis ◽  
Health Assessment ◽  
Secondary Data ◽  
The Self ◽  
Assessment Instrument ◽  
Foot Health ◽  
Item Functioning ◽  
The Rasch Model

Abstract Background Reliable and valid measurement is the foundation of evidence-based practice. The self-administered Foot Health Assessment Instrument (S-FHAI) was recently developed to measure patients’ evaluations of their own foot health. Evidence regarding the psychometric properties of the S-FHAI is limited. The aim of this study was to investigate those properties by using a Rasch analysis. Methods This methodological study analysed secondary data that was collected from nurses (n = 411) in 2015. The psychometric properties of the S-FHAI were evaluated using the Rasch model. Unidimensionality was analysed first, followed by item functioning, person misfit and differential item functioning (DIF). Results The S-FHAI demonstrated evidence of unidimensionality, with an acceptable item fit according to the Rasch model. Person fit and person separation were low, however, indicating restricted separation among different respondents. Item separation was high, demonstrating clear discrimination between the items. No DIF was detected in relation to gender, but significant DIF was demonstrated in relation to age for 6 of the 25 items. Conclusions The S-FHAI has potential for use in investigating self-reported foot health. The Rasch analysis revealed that the psychometric properties of the instrument were acceptable, although some issues should be addressed to improve the scale. In future, it may be beneficial to analyse the sensitivity of the items and to test the S-FHAI in more diverse patient populations.

scholarly journals Application of Rasch Model in Constructing Walkability Indices for Urban Neighborhood Area

2018 ◽  
Vol 3 (6) ◽  
pp. 39-47
Author(s):  
Roslina Sapawi ◽  
Ismail Said
Keyword(s):  
Rasch Model ◽  
Publishing House ◽  
Measurement Model ◽  
Urban Neighborhood ◽  
Urban Neighbourhoods ◽  
Item Functioning ◽  
Physical Attributes ◽  
International Publishing ◽  
The Rasch Model ◽  
Open Access Article

Physical attributes for walkable urban neighborhood required summary of indices. The development of indices is based on the hierarchy of walking need theory which applies dimensions of accessibility, safety, comfort and pleasurability. The aim of this research is to construct indices of physical attributes by detecting differential item functioning (DIF) based on respondent’s demographic factors and their perceived environment. 7he ßndings using the Rasch model has dropped l6 items and maintains 20 items that reliable to gauge the 4 dimensions. This research could be used to obtain indices in a justly manner and become an indicator for walkable urban neighbourhood model. Keywords: Walkability; urban neighbourhoods; physical environment attributes, Rasch measurement model eISSN 2514-751X © 2018. The Authors. Published for AMER ABRA cE-Bs by e-International Publishing House, Ltd., UK. This is an open-access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/). Peer–review under responsibility of AMER (Association of Malaysian Environment-Behaviour Researchers), ABRA (Association of Behavioural Researchers on Asians) and cE-Bs (Centre for Environment-Behaviour Studies), Faculty of Architecture, Planning & Surveying, Universiti Teknologi MARA, Malaysia.

scholarly journals SCHFI 6.2 Self-Care Confidence Scale - Brazilian version: psychometric analysis using the Rasch model

2020 ◽  
Vol 28 ◽  
Author(s):  
Diná de Almeida Lopes Monteiro da Cruz ◽  
Ana Maria Miranda Martins Wilson ◽  
Michele Nakahara Melo ◽  
Ana Paula da Conceição ◽  
Leidy Johanna Rueda Diaz
Keyword(s):  
Heart Failure ◽  
Psychometric Properties ◽  
Rasch Model ◽  
Self Care ◽  
The Self ◽  
Psychometric Analysis ◽  
Brazilian Version ◽  
Secondary Study ◽  
The Rasch Model ◽  
Confidence Scale

Objective: to evaluate the psychometric properties of the Self-Care Confidence Scale in heart failure in the Brazilian version of the Self Care Heart Failure Index, version 6.2, using the Rasch model criteria. Method: secondary study, of psychometric analysis, using the Rasch model, of the six items of the scale. The sample consisted of 409 patients with heart failure undergoing outpatient treatment [mean age 57.9 (standard deviation = 11.6) years, 54.8% male]. Results: of the total of six items, one (“De maneira geral, você está confiante sobre estar livre dos sintomas de insuficiência cardíaca?”) presented maladjustment to the model (Infit = 1.84 and Outfit = 1.99). After the exclusion of this item, the others showed a good fit, composed one dimension and explained 55% of the variance in the data; the categories of response to the items were adequate, the values of separation and reliability of person were 2.13 and 0.82, respectively, and Cronbach’s alpha was 0.87. Items of extreme difficulty were identified and there is no differential functioning of the items in relation to sex. Conclusion: with the exclusion of the first item, the Self-Care Confidence Scale showed good psychometric properties, with caution in interpreting the results of the six-item scale.

scholarly journals Development and evaluation of the measurement properties of a generic questionnaire measuring patient perceptions of person-centred care

2020 ◽  
Vol 20 (1) ◽  
Author(s):  
Helena Fridberg ◽  
Lars Wallin ◽  
Catarina Wallengren ◽  
Anders Kottorp ◽  
Henrietta Forsman ◽  
...  
Keyword(s):  
Mixed Methods ◽  
Rasch Model ◽  
Delphi Study ◽  
Measurement Model ◽  
Measurement Properties ◽  
Free Text ◽  
Key Informants ◽  
Generic Questionnaire ◽  
Field Notes ◽  
The Rasch Model

Abstract Background Implementation of person-centred care (PCC) is a challenging undertaking. Thus, a call has been issued for a robust and generic instrument to measure and enable evaluation of PCC across settings and patient groups. This study aimed to develop a generic questionnaire measuring patients’ perceptions of PCC. Further aims were to evaluate its content and measurement properties using a mixed-methods approach entailing Rasch and qualitative content analyses. Methods The study was conducted in three iterative phases. Phase one included six key informants to gain a broad view of the concept. Phase two entailed a Delphi study involving two rounds with eight experts who generated ratings on relevance, readability, comprehensiveness and suggestions for revision. Data were analysed using the Item Content Validity Index in conjunction with qualitative comments to improve the questionnaire. Phase three was performed using a mixed-methods design. Quantitative data were collected from patients (n = 553) responding to the questionnaire who were recruited from six in- and outpatient care units in a health care region in Sweden. Data was analysed using the Rasch measurement model. Qualitative data were based on the respondents’ free-text comments, cognitive interviews (n = 10) and field notes, and then analysed with deductive content analysis. Results A questionnaire was developed and operationalised based on the information given by key informants in phase one and then validated for its content by experts in phase two. In phase three Rasch analyses revealed problems with targeting, thresholds and two misfitting items. These problems were corroborated by data from the qualitative analyses, which also revealed some issues of wording and interpretation of items. When thresholds were resolved and two items removed, the questionnaire met the assumptions of the Rasch model. Conclusions Experts gave the questionnaire content high ratings and it met measurement requirements assumed by the Rasch model after revisions. Those problems on targeting that remain need to be addressed in future studies. Meanwhile, we regard the questionnaire as of sufficient quality to be useful in benchmarking PCC.

scholarly journals Analysis of the Ruff 2 & 7 Test of Attention with the Rasch Poisson Counts Model

2019 ◽  
Vol 12 (1) ◽  
pp. 7-11
Author(s):  
Mahsa Nadri ◽  
Purya Baghaei ◽  
Zahra Zohoorian
Keyword(s):  
Item Response ◽  
Rasch Model ◽  
Internal Validity ◽  
Measurement Model ◽  
Cognitive Tasks ◽  
Theory Analysis ◽  
Item Response Theory Analysis ◽  
The Individual ◽  
The Rasch Model ◽  
Poisson Counts

Background:Attention is a basic neurocognitive function which is a prerequisite for performance on more complex cognitive tasks. The Ruff 2 & 7 test is a well-known measure of attention with a well-supported theoretical and empirical underpinnings.Objective:The Ruff 2 & 7 test, has not been subjected to rigorous item response theory analysis yet. The purpose of this research was to examine the fit of the Ruff 2 & 7 test to the Rasch Poisson Counts Model (RPCM).Methods:Responses of 138 nonclinical subjects to the Ruff 2 & 7 test were analyzed with the RPCM measurement model using ‘lme4’ package in R. The fit of the individual items (blocks) and the overall test to the model were examined.Results:Findings showed that three out of seven scoring techniques fit the Rasch model. The scoring techniques which fitted the model were total number of characters cancelled, total number of characters correctly cancelled, and total number of characters correctly cancelled minus errors of commission.Conclusion:Three of the scoring techniques fit the RPCM which support the internal validity of the test when these scoring procedures were employed. Therefore, the Ruff 2 & 7 test is psychometrically uni-dimensional when these three scores are computed.

Sign in / Sign up

Export Citation Format

Share Document