Are the Items of the Starkstein Apathy Scale Fit for the Purpose of Measuring Apathy Post-Stroke?

Given the importance of apathy for stroke, we felt it was time to scrutinize the commonly used Starkstein Apathy Scale (SAS) for psychometric evidence that it is fit for this purpose. The objectives were to: (i) estimate the extent to which the SAS items fit a hierarchical continuum of the Rasch Model; and (ii) estimate the strength of the relationships between the Rasch analysed SAS and converging constructs related to stroke outcomes. Methods Data on 238 people with stroke (mean age=63.1 years (SD=12.1) women=37.4%) from a clinical trial of a community-based intervention targeting participation were available at 5 time points yielding 856 SAS questionnaires. SAS has 14 items, rated on a 4-point scale with higher values indicating more apathy. Psychometric properties were tested using Rasch partial-credit model, correlation, and regression. The construct was modeled as motivation with items rescored as high is better. Results Rasch analysis indicated that the response options were disordered for 8/14 items, pointing to unreliability in the interpretation of the response options; they were consequently reduced from 4 to 3. Only 9/14 items fit the Rasch model and therefore suitable for creating a total score. The new rSAS was deemed unidimensional (residual correlations: < 0.3), reasonably reliable (person separation index: 0.74), with item-locations uniform across time, age, sex, and education. However, 30% of scores were >2 SD above the standardized mean but only 2/9 items covered this range (construct mistargeting). Apathy (rSAS/SAS) was correlated weakly with anxiety/depression and uncorrelated with physical capacity. Regression showed that the effect of apathy on participation and health perception was similar for rSAS/SAS versions: R2 participation measures ranged from 0.11 to 0.29; R2 for health perception was ~0.25. When placed on the same scale (0-42), rSAS value was 6.5 units lower than SAS value with minimal floor/ceiling effects. Estimated change over time was identical (0.12 units/month) which was not substantial (1.44 units/year) but greater than expected assuming no change (t: 3.6 and 2.4). Conclusion The retained items of the rSAS targeted behaviours more than beliefs and results support the rSAS as a robust measure of apathy in people with chronic stroke.

Download Full-text

Are the Items of the Starkstein Apathy Scale Fit for the Purpose of Measuring Apathy Post-stroke?

Frontiers in Psychology ◽

10.3389/fpsyg.2021.754103 ◽

2021 ◽

Vol 12 ◽

Author(s):

Stanley Hum ◽

Lesley K. Fellows ◽

Christiane Lourenco ◽

Nancy E. Mayo

Keyword(s):

Psychometric Properties ◽

Rasch Model ◽

Health Perception ◽

Partial Credit Model ◽

Stroke Outcomes ◽

Response Options ◽

Residual Correlations ◽

Anxiety Depression ◽

Model Correlation ◽

The Rasch Model

Importance: Given the importance of apathy for stroke, we felt it was time to scrutinize the psychometric properties of the commonly used Starkstein Apathy Scale (SAS) for this purpose.Objectives: The objectives were to: (i) estimate the extent to which the SAS items fit a hierarchical continuum of the Rasch Model; and (ii) estimate the strength of the relationships between the Rasch analyzed SAS and converging constructs related to stroke outcomes.Methods: Data was from a clinical trial of a community-based intervention targeting participation. A total of 857 SAS questionnaires were completed by 238 people with stroke from up to 5 time points. SAS has 14 items, rated on a 4-point scale with higher values indicating more apathy. Psychometric properties were tested using Rasch partial-credit model, correlation, and regression. Items were rescored so higher scores are interpreted as lower apathy levels.Results: Rasch analysis indicated that the response options were disordered for 8/14 items, pointing to unreliability in the interpretation of the response options; they were consequently reduced from 4 to 3. Only 9/14 items fit the Rasch model and therefore suitable for creating a total score. The new rSAS was deemed unidimensional (residual correlations: < 0.3), reasonably reliable (person separation index: 0.74), with item-locations uniform across time, age, sex, and education. However, 30% of scores were > 2 SD above the standardized mean but only 2/9 items covered this range (construct mistargeting). Apathy (rSAS/SAS) was correlated weakly with anxiety/depression and uncorrelated with physical capacity. Regression showed that the effect of apathy on participation and health perception was similar for rSAS/SAS versions: R2 participation measures ranged from 0.11 to 0.29; R2 for health perception was ∼0.25. When placed on the same scale (0–42), rSAS value was 6.5 units lower than SAS value with minimal floor/ceiling effects. Estimated change over time was identical (0.12 units/month) which was not substantial (1.44 units/year) but greater than expected assuming no change (t: 3.6 and 2.4).Conclusion: The retained items of the rSAS targeted domains of behaviors more than beliefs and results support the rSAS as a robust measure of apathy in people with chronic stroke.

Download Full-text

Rasch analysis of the firefighters’ critical incident inventory questionnaire

Work ◽

10.3233/wor-213627 ◽

2021 ◽

pp. 1-11

Author(s):

Goris Nazari ◽

Steve Lu ◽

Tara Packham ◽

Joy C. MacDermid

Keyword(s):

Rasch Model ◽

Critical Incident ◽

Secondary Data ◽

Chi Square ◽

Service Workers ◽

Response Options ◽

Medical Trauma ◽

Chi Square Test ◽

Emergency Service Workers ◽

The Rasch Model

BACKGROUND: The Critical Incident Inventory (CII) was developed to assess stressful exposures in firefighters and emergency service workers. The CII includes six subscales: trauma to self, victims known to fire-emergency worker, multiple casualties, incidents involving children, unusual or problematic tactical operations, and exposure to severe medical trauma. OBJECTIVES: To examine the construct validity of all subscales of the Critical Incident Inventory (CII) by assessing the unidimensionality of the scales, and the interval properties of CII subscales by examining fit to the Rasch model and ordering of item thresholds. METHODS: This was a secondary data analysis based on survey data collected from a sample of 390 firefighters. RESULTS: Item 4 and Item 20 were removed with the confirmation of unacceptable fit residual. This revised version of the CII showed satisfactory fit to the Rasch model by non-significant Chi-square test and acceptable level of item fit. We rescored the CII original version and considered all items as only dichotomous response options where 0 represented the original no experience, and 1 presents the combination of experiencing 1, 2, 3 cases. CONCLUSION: The re-appraisal of the revised version CII indicated a satisfactory level of Rasch model fit.

Download Full-text

Assessment Instrument Development for a Chronological Thinking Skills with the Rasch Model

AL-ISHLAH: Jurnal Pendidikan ◽

10.35445/alishlah.v13i2.551 ◽

2021 ◽

Vol 13 (2) ◽

pp. 1160-1166

Author(s):

Ofianto Ofianto ◽

Tri Zahra Ningsih

Keyword(s):

Rasch Model ◽

Preliminary Investigation ◽

Sampling Technique ◽

Thinking Skills ◽

Assessment Instrument ◽

Development Model ◽

Partial Credit Model ◽

Learning History ◽

Instrument Reliability ◽

The Rasch Model

Chronological thinking skills are one of the most critical goals in learning history, distinguishing it from other sciences. This skill is not a natural skill that already exists in students but is a skill that needs to be developed in students, especially in studying history. This study aims to develop an instrument for assessing chronological thinking skills with the Rasch model. The development model adopted the Gall Borg development model by adjusting to the research objectives and needs. The adaptation of the Borg Gall model resulted in four stages in this study: (1) needs analysis and preliminary investigation, (2) planning and preparation of product development, (3) expert validation, and (4) instrument implementation. This research was conducted in Senior High School (SMA), involving 120 students from three schools. Sampling was carried out employing the proportional sampling technique. The data was collected using validation sheets, tests, and assessment sheets (scoring rubric). Data analysis was then performed with the Quest Program utilizing the Partial Credit Model (PCM). The results showed that the chronological thinking skills assessment instrument with the Rasch model was valid and reliable. The validity value of items that fit the model ranged from 0.77 to 1.30, and the instrument reliability value of 0.76 was in the high category. Therefore, it could be concluded that the assessment instrument developed can measure students' chronological thinking skills.

Download Full-text

Critical Values for Yen’s Q3: Identification of Local Dependence in the Rasch Model Using Residual Correlations

Applied Psychological Measurement ◽

10.1177/0146621616677520 ◽

2016 ◽

Vol 41 (3) ◽

pp. 178-194 ◽

Cited By ~ 117

Author(s):

Karl Bang Christensen ◽

Guido Makransky ◽

Mike Horton

Keyword(s):

Rasch Model ◽

Critical Values ◽

Local Dependence ◽

Residual Correlations ◽

The Rasch Model

Download Full-text

DEMQOL and DEMQOL-Proxy: a Rasch analysis among those diagnosed with dementia

Health and Quality of Life Outcomes ◽

10.1186/s12955-019-1216-8 ◽

2019 ◽

Vol 17 (1) ◽

Cited By ~ 1

Author(s):

A. A. Jolijn Hendriks ◽

Sarah C. Smith ◽

Nick Black

Keyword(s):

Rasch Model ◽

Rasch Analysis ◽

Qualitative Investigation ◽

Family Carers ◽

Local Independence ◽

Response Options ◽

Item Fit ◽

Item Functioning ◽

Diagnosis Of Dementia ◽

The Rasch Model

Abstract Background In previous work we concluded that DEMQOL and DEMQOL-Proxy can provide robust measurement of HRQL in dementia when scores are derived from analysis using the Rasch model. As the study sample included people with mild cognitive impairment, we undertook a replication study in the subsample with a diagnosis of dementia (PWD). PWD constitute the population for whom DEMQOL and DEMQOL-Proxy were originally developed. Methods We conducted a Rasch model analysis using the RUMM2030 software to re-evaluate DEMQOL (441 PWD) and DEMQOL-Proxy (342 family carers). We evaluated scale to sample targeting, ordering of item thresholds, item fit to the model, and differential item functioning (sex, age, severity, relationship), local independence, unidimensionality and reliability. Results For both DEMQOL and DEMQOL-Proxy, results were highly similar to the results in the original sample. We found the same problems with content and response options. Conclusions DEMQOL and DEMQOL-Proxy can provide robust measurement of HRQL in people with a diagnosis of dementia when scores are derived from analysis using the Rasch model. As in the wider sample, the problems identified with content and response options require qualitative investigation in order to improve the scoring of DEMQOL and DEMQOL-Proxy.

Download Full-text

Rasch Analysis of an Indonesian version of the General Self-Efficacy Scale-12: A Comparison of Rating Scale Model (RSM) and Partial Credit Model (PCM)

Indonesian Journal of Educational Assesment ◽

10.26499/ijea.v3i1.55 ◽

2020 ◽

Vol 3 (1) ◽

pp. 52

Author(s):

Muhammad Dwirifqi Kharisma Putra ◽

Heri Retnawati

Keyword(s):

Rasch Model ◽

Self Efficacy ◽

Cognitive Theory ◽

Rating Scale ◽

Scale Model ◽

Partial Credit Model ◽

Partial Credit ◽

General Self Efficacy ◽

The Rasch Model ◽

Rating Scale Model

Self-efficacy is one of the most researched topics in education and psychology, which grounded within social cognitive theory. Various instruments are available that can be used to measure general self-efficacy. As a foundational instrument in the measurement of general self-efficacy, the study investigated the psychometric properties of the General Self-Efficacy Scale-12 (GSES-12). Although the instrument has been adapted into Bahasa, the contribution of the Rasch measurement model in validating this instrument has never done before. By utilizing various advantages of the Rasch model, the polytomous Rasch model (RSM and PCM) were used. The data used in this study are secondary data from previous research. The sample consisted of 303 students (132 male, 171 female) with an age range 18 - 22 years old (mean age = 19.56, SD = 1.20). The results of Rasch's analysis show that the psychometric characteristics of GSES-12 are adequate. The data fit to the Partial Credit Model compared to Rating Scale Model. All assumptions in applying the Rasch model are fulfilled, and also the item fit to the model. Implications and suggestions for future research are also discussed.

Download Full-text

Using Partial Credit Model to Improve the Quality of an Instrument

International Journal of Evaluation and Research in Education (IJERE) ◽

10.11591/ijere.v7i4.15146 ◽

2018 ◽

Vol 7 (4) ◽

pp. 313

Author(s):

Saras Krishnan ◽

Noraini Idris

Keyword(s):

Rasch Model ◽

Reliability And Validity ◽

Measurement Instrument ◽

Partial Credit Model ◽

Partial Credit ◽

Instrument Analysis ◽

Key Indicators ◽

The Rasch Model ◽

Underlying Variable

<p>In using the Rasch model to improve the quality of an instrument, analysis purports to determine if the sample collaborates well with the items in the instrument such that the results are measuring a single underlying variable. The relevant properties of Rasch analysis are reliability and validity which are key indicators of the quality of a measurement instrument. This paper discusses the use of one type of Rasch model that is the Partial Credit Model to investigate reliability and validity of an instrument. By removing or changing items in the instrument when conditions of reliability and validity are not met, the quality of the instrument is improved.</p>

Download Full-text

A Rasch analysis of the Person-Centred Climate Questionnaire – staff version

BMC Health Services Research ◽

10.1186/s12913-019-4803-9 ◽

2019 ◽

Vol 19 (1) ◽

Author(s):

Mark Wilberforce ◽

Anders Sköldunger ◽

David Edvardsson

Keyword(s):

Rasch Model ◽

Rasch Analysis ◽

Test Theory ◽

Care Staff ◽

Measurement Properties ◽

Partial Credit Model ◽

Measurement Instruments ◽

Single Measure ◽

Testing Procedures ◽

The Rasch Model

Abstract Background Person-centred care is the bedrock of modern dementia services, yet the evidence-base to support its implementation is not firmly established. Research is hindered by a need for more robust measurement instruments. The 14-item Person-Centred Climate Questionnaire - Staff version (PCQ-S) is one of the most established scales and has promising measurement properties. However, its construction under classical test theory methods leaves question marks over its rigour and the need for evaluation under more modern testing procedures. Methods The PCQ-S was self-completed by nurses and other care staff working across nursing homes in 35 Swedish municipalities in 2013/14. A Rasch analysis was undertaken in RUMM2030 using a partial credit model suited to the Likert-type items. Three subscales of the PCQ-S were evaluated against common thresholds for overall fit to the Rasch model; ordering of category thresholds; unidimensionality; local dependency; targeting; and Differential Item Functioning. Three subscales were evaluated separately as unidimensional models and then combined as subtests into a single measure. Due to large number of respondents (n = 4381), two random sub-samples were drawn, with a satisfactory model established in the first (‘evaluation’) and confirmed in the second (‘validation’). Final item locations and a table converting raw scores to Rasch-transformed values were created using the full sample. Results All three subscales had disordered thresholds for some items, which were resolved by collapsing categories. The three subscales fit the assumptions of the Rasch model after the removal of two items, except for subscale 3, where there was evidence of local dependence between two items. By forming subtests, the 3 subscales were combined into a single Rasch model which had satisfactory fit statistics. The Rasch form of the instrument (PCQ-S-R) had an adequate but modest Person Separation Index (< 0.80) and some evidence of mistargeting due to a low number of ‘difficult-to-endorse’ items. Conclusions The PCQ-S-R has 12 items and can be used as a unidimensional scale with interval level properties, using the nomogram presented within this paper. The scale is reliable but has some inefficiencies due to too few high-end thresholds inhibiting discrimination amongst populations who already perceive that person-centred care is very good in their environment.

Download Full-text