scholarly journals Investigating psychometric properties of the arm activity measure – Thai version (ArmA-TH) sub‐scales using the Rasch model

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Montana Buntragulpoontawee ◽  
Jeeranan Khunachiva ◽  
Patreeya Euawongyarti ◽  
Nahathai Wongpakaran ◽  
Tinakon Wongpakaran ◽  
...  

Abstract Background This study investigated the ArmA-TH sub-scale measurement properties based on item response theory using the Rasch model. Methods Patients with upper limb hemiplegia resulting from cerebrovascular and other brain disorders were asked to complete the ArmA-TH questionnaire. Rasch analysis was performed to test how well the ArmA-TH passive and active function sub-scales fit the Rasch model by investigating unidimensionality, response category functioning, reliability of person and item, and differential item functioning (DIF) for age, sex, and education. Results Participants had stroke or other acquired brain injury (n = 185), and the majority were men (126, 68.1 %), with a mean age of 55 (SD 22). Most patients (91, 49.2 %) had graduated from elementary/primary school. For the ArmA-TH passive function scale, all items had acceptable fit statistics. The scale’s unidimensionality and local independence were supported. The reliability was acceptable. A disordered threshold was found for five items, and none indicated DIF. For the ArmA-TH active function scale, one item was misfit and three were locally dependent. The reliability was good. No items showed DIF. All items had disordered thresholds, and the data fitted the Rasch model better after rescoring. Conclusions Both sub-scales of ArmA-TH fitted the Rasch model and were valid and reliable. The disordered thresholds should be further investigated.

2020 ◽  
Author(s):  
Montana Buntragulpoontawee ◽  
Jeeranan Khunachiva ◽  
Patreeya Euawongyarti ◽  
Nahathai Wongpakaran ◽  
Tinakon Wongpakaran ◽  
...  

Abstract Background: This study investigated the ArmA-TH measurement properties based on item response theory, using the Rasch model. Methods: Patients with upper limb hemiplegia resulting from cerebrovascular and other brain disorders were asked to completed the ArmA-TH questionnaire. Rasch analysis was performed to test how well the ArmA-TH passive and active function sub-scales fit the Rasch model by investigating unidimensionality, response category functioning, reliability of the person and item, and differential item functioning (DIF) for age, sex and education. Results: Participants had stroke or other acquired brain injury (n=185) and the majority were men 126(68.1%), with a mean age of 55(SD 22). Most patients 91(49.2%) graduated elementary/primary school. For the ArmA-TH passive function scale, all items had acceptable fit statistics. The scale’s unidimensionality, and local independence were supported. The reliability was acceptable. Disordered threshold was found in five items, none was DIF. For the ArmA-TH active function scale, one item was misfitting and three were locally dependent. The reliability was good. DIF was not found. All items had disordered thresholds, and data fitted the Rasch model better after rescoring.Conclusions: Both sub-scales of ArmA-TH fitted the Rasch model, and are valid and reliable. The disordered thresholds should be further investigated.


2020 ◽  
Author(s):  
Montana Buntragulpoontawee ◽  
Jeeranan Khunachiva ◽  
Patreeya Euawongyarti ◽  
Nahathai Wongpakaran ◽  
Tinakon Wongpakaran ◽  
...  

Abstract Background: This study investigated the ArmA-TH measurement properties based on item response theory, using the Rasch model. Methods: Patients with upper limb hemiplegia resulting from cerebrovascular and other brain disorders were asked to completed the ArmA-TH questionnaire. Rasch analysis was performed to test how well the ArmA-TH passive and active function sub-scales fit the Rasch model by investigating unidimensionality, response category functioning, reliability of the person and item, and differential item functioning (DIF) for age, sex and education. Results: Participants had stroke or other acquired brain injury (n=185) and the majority were men 126(68.1%), with a mean age of 55(SD 22). Most patients 91(49.2%) graduated elementary/primary school. For the ArmA-TH passive function scale, all items had acceptable fit statistics. The scale’s unidimensionality, and local independence were supported. The reliability was acceptable. Disordered threshold was found in five items, none was DIF. For the ArmA-TH active function scale, one item was misfitting and three were locally dependent. The reliability was good. DIF was not found. All items had disordered thresholds, and data fitted the Rasch model better after rescoring.Conclusions: Both sub-scales of ArmA-TH fitted the Rasch model, and are valid and reliable. The disordered thresholds should be further investigated.


2013 ◽  
Vol 93 (11) ◽  
pp. 1507-1519 ◽  
Author(s):  
Clayon B. Hamilton ◽  
Bert M. Chesworth

Background The original 20-item Upper Extremity Functional Index (UEFI) has not undergone Rasch validation. Objective The purpose of this study was to determine whether Rasch analysis supports the UEFI as a measure of a single construct (ie, upper extremity function) and whether a Rasch-validated UEFI has adequate reproducibility for individual-level patient evaluation. Design This was a secondary analysis of data from a repeated-measures study designed to evaluate the measurement properties of the UEFI over a 3-week period. Methods Patients (n=239) with musculoskeletal upper extremity disorders were recruited from 17 physical therapy clinics across 4 Canadian provinces. Rasch analysis of the UEFI measurement properties was performed. If the UEFI did not fit the Rasch model, misfitting patients were deleted, items with poor response structure were corrected, and misfitting items and redundant items were deleted. The impact of differential item functioning on the ability estimate of patients was investigated. Results A 15-item modified UEFI was derived to achieve fit to the Rasch model where the total score was supported as a measure of upper extremity function only. The resultant UEFI-15 interval-level scale (0–100, worst to best state) demonstrated excellent internal consistency (person separation index=0.94) and test-retest reliability (intraclass correlation coefficient [2,1]=.95). The minimal detectable change at the 90% confidence interval was 8.1. Limitations Patients who were ambidextrous or bilaterally affected were excluded to allow for the analysis of differential item functioning due to limb involvement and arm dominance. Conclusion Rasch analysis did not support the validity of the 20-item UEFI. However, the UEFI-15 was a valid and reliable interval-level measure of a single dimension: upper extremity function. Rasch analysis supports using the UEFI-15 in physical therapist practice to quantify upper extremity function in patients with musculoskeletal disorders of the upper extremity.


2019 ◽  
Vol 17 (1) ◽  
Author(s):  
A. A. Jolijn Hendriks ◽  
Sarah C. Smith ◽  
Nick Black

Abstract Background In previous work we concluded that DEMQOL and DEMQOL-Proxy can provide robust measurement of HRQL in dementia when scores are derived from analysis using the Rasch model. As the study sample included people with mild cognitive impairment, we undertook a replication study in the subsample with a diagnosis of dementia (PWD). PWD constitute the population for whom DEMQOL and DEMQOL-Proxy were originally developed. Methods We conducted a Rasch model analysis using the RUMM2030 software to re-evaluate DEMQOL (441 PWD) and DEMQOL-Proxy (342 family carers). We evaluated scale to sample targeting, ordering of item thresholds, item fit to the model, and differential item functioning (sex, age, severity, relationship), local independence, unidimensionality and reliability. Results For both DEMQOL and DEMQOL-Proxy, results were highly similar to the results in the original sample. We found the same problems with content and response options. Conclusions DEMQOL and DEMQOL-Proxy can provide robust measurement of HRQL in people with a diagnosis of dementia when scores are derived from analysis using the Rasch model. As in the wider sample, the problems identified with content and response options require qualitative investigation in order to improve the scoring of DEMQOL and DEMQOL-Proxy.


Author(s):  
Kang-Hyun Park ◽  
Ickpyo Hong ◽  
Ji-Hyuk Park

Lifestyle plays an important role in determining health and vitality among older adults. However, there is limited evidence regarding lifestyle assessment. This study examined the psychometric properties of the Yonsei Lifestyle Profile-Satisfaction (YLP-S). The participants in the study included 156 older adults. Rasch analysis was used to test unidimensionality, fit statistics, and the precision of the YLP-S. The YLP-S demonstrated a unidimensional measurement construct, and 18 items fit the Rasch model. The YLP-S illustrated reasonable precision (person strata = 5.37). Only 4 items showed differential item functioning by sex or age groups. The findings indicate that the YLP-S demonstrated sound internal validity and can be used by health professionals to measure the multifaceted lifestyle of older adults.


2018 ◽  
Vol 27 (4) ◽  
pp. 579-593
Author(s):  
Sergio L. Peral ◽  
Madelyn Geldenhuys

A Rasch validation was performed on the Tims, Bakker, and Derks’s Job Crafting Scale (JCS) in the South African working context. The JCS, which has been linked to employee well-being and career-related outcomes, continues to be the most widely used measure of job crafting behavior. Data obtained from the JCS generally showed good fit to the Rasch model. Four items were flagged during the analysis for displaying misfit (1 item) or differential item functioning (3 items), warranting further research attention. The study disclosed the dimensionality of the JCS, the hierarchical ordering and fit of the items, the functionality of the response format, and the ability of the JCS to measure invariantly across men and women, yielding new and interesting insights into the psychometric properties of the scale. The study contributes to research concerning the validity of the JCS in a non-European context, particularly through the use of Rasch analysis as a validation technique.


2018 ◽  
Vol 11 (3) ◽  
pp. 242-246 ◽  
Author(s):  
Jennifer L. Hunnicutt ◽  
Brittany N. Hand ◽  
Chris M. Gregory ◽  
Harris S. Slone ◽  
Michelle M. McLeod ◽  
...  

Background: Measurement properties of the short form of the Knee injury and Osteoarthritis Outcome Score (KOOS-JR) are not established in individuals after anterior cruciate ligament reconstruction (ACLR). The purpose of this study was to determine the extent to which the KOOS-JR measures the construct of knee health in individuals post-ACLR using Rasch analysis. Hypothesis: The KOOS-JR will fit the Rasch model, but significant ceiling effects will be present. Study Design: Cross-sectional study. Level of Evidence: Level 3. Methods: Rasch analysis of the KOOS-JR from 166 individuals 10 months post-ACLR was conducted. Unidimensionality, a key criterion of the Rasch model, was evaluated using confirmatory factor analysis. Model fit of the rating scale, items, and persons were evaluated. Mean square fit statistics ≥1.6 and standardized z-scores ≥2.0 were indicative of person or item misfit. Additionally, reliability indicators including person reliability and separation indices were examined. Results: The KOOS-JR fit the criteria of unidimensionality. All items demonstrated model fit; however, ceiling effects were noted (n = 36; 22%). Person reliability was low (0.47). Calculation of person strata revealed that the KOOS-JR did not separate participants into more than 1 stratum. The mean person measure was 3.56 logits higher than the mean item measure, indicating that this sample is skewed toward increased knee health. Conclusion: Although the KOOS-JR represented a unidimensional construct with items and persons fitting the Rasch model, several limitations were noted: ceiling effects, low person reliability, and poor person differentiation. Ceiling effects indicate that many individuals in this sample experienced better knee health than the KOOS-JR items were able to measure. Clinical Relevance: Evaluating the measurement properties of the KOOS-JR is necessary to determine its clinical value in sports medicine. In later stages after ACLR recovery, administration of the KOOS-JR may not be adequate.


BMC Nursing ◽  
2021 ◽  
Vol 20 (1) ◽  
Author(s):  
Minna Stolt ◽  
Anders Kottorp ◽  
Riitta Suhonen

Abstract Background Reliable and valid measurement is the foundation of evidence-based practice. The self-administered Foot Health Assessment Instrument (S-FHAI) was recently developed to measure patients’ evaluations of their own foot health. Evidence regarding the psychometric properties of the S-FHAI is limited. The aim of this study was to investigate those properties by using a Rasch analysis. Methods This methodological study analysed secondary data that was collected from nurses (n = 411) in 2015. The psychometric properties of the S-FHAI were evaluated using the Rasch model. Unidimensionality was analysed first, followed by item functioning, person misfit and differential item functioning (DIF). Results The S-FHAI demonstrated evidence of unidimensionality, with an acceptable item fit according to the Rasch model. Person fit and person separation were low, however, indicating restricted separation among different respondents. Item separation was high, demonstrating clear discrimination between the items. No DIF was detected in relation to gender, but significant DIF was demonstrated in relation to age for 6 of the 25 items. Conclusions The S-FHAI has potential for use in investigating self-reported foot health. The Rasch analysis revealed that the psychometric properties of the instrument were acceptable, although some issues should be addressed to improve the scale. In future, it may be beneficial to analyse the sensitivity of the items and to test the S-FHAI in more diverse patient populations.


2021 ◽  
Author(s):  
Gaopei Zhu ◽  
Zhongli Wang ◽  
Peixia Guan ◽  
Yuhang Zhu ◽  
Juan Li ◽  
...  

Abstract Background The impact of urbanization on the physical and mental health of the rural-urban population has been ignored. The primary objective of this investigation was to demonstrate the reliability, validity, and responsiveness of the 10-item Kessler Psychological Distress Scale (K10) in the measurement of psychological distress in the rural-urban fringe population. Methods Data were obtained from the mental health section of chronic disease survey in Longzihu District, urban-rural fringe area, of Bengbu City, with 3354 participants. The Mandarin version of K10 was used for face-to-face interviews. The Rasch model was used to analyze the psychometry characteristics and differential item functioning (DIF) of K10.Results Rasch analysis results revealed that the K10 scale showed ordered response categories. The results of principal component analysis (PCA) and information-weighted fit statistic (infit) mean square (MNSQ) indicated that the K10 scale conforms to unidimensionality. The Cronbach's alpha coefficient of K10 was 0.916 (95% confidence interval (CI): 0.907,0.924), which had good reliability, but the Cronbach's alpha coefficient would be increased if the fifth item was removed. The results of the Rasch model showed that all the 10 items in the K10 scale had a good fitting effect (Infit MNSQ value, 0.928-1.072). A non-significant differential item functioning (DIF) was found on K10 of age and gender. Overall, the K10 scale was more difficult, and the psychological distress score of the subjects was generally low.Conclusion Rasch analysis showed that the Mandarin version of K10 was an effective and reliable scale for measuring and screening mental distress of residents in the urban-rural fringe. However, it was still recommended that further research should be conducted to solve inappropriate and difficult items.


2019 ◽  
Vol 19 (1) ◽  
Author(s):  
Mark Wilberforce ◽  
Anders Sköldunger ◽  
David Edvardsson

Abstract Background Person-centred care is the bedrock of modern dementia services, yet the evidence-base to support its implementation is not firmly established. Research is hindered by a need for more robust measurement instruments. The 14-item Person-Centred Climate Questionnaire - Staff version (PCQ-S) is one of the most established scales and has promising measurement properties. However, its construction under classical test theory methods leaves question marks over its rigour and the need for evaluation under more modern testing procedures. Methods The PCQ-S was self-completed by nurses and other care staff working across nursing homes in 35 Swedish municipalities in 2013/14. A Rasch analysis was undertaken in RUMM2030 using a partial credit model suited to the Likert-type items. Three subscales of the PCQ-S were evaluated against common thresholds for overall fit to the Rasch model; ordering of category thresholds; unidimensionality; local dependency; targeting; and Differential Item Functioning. Three subscales were evaluated separately as unidimensional models and then combined as subtests into a single measure. Due to large number of respondents (n = 4381), two random sub-samples were drawn, with a satisfactory model established in the first (‘evaluation’) and confirmed in the second (‘validation’). Final item locations and a table converting raw scores to Rasch-transformed values were created using the full sample. Results All three subscales had disordered thresholds for some items, which were resolved by collapsing categories. The three subscales fit the assumptions of the Rasch model after the removal of two items, except for subscale 3, where there was evidence of local dependence between two items. By forming subtests, the 3 subscales were combined into a single Rasch model which had satisfactory fit statistics. The Rasch form of the instrument (PCQ-S-R) had an adequate but modest Person Separation Index (< 0.80) and some evidence of mistargeting due to a low number of ‘difficult-to-endorse’ items. Conclusions The PCQ-S-R has 12 items and can be used as a unidimensional scale with interval level properties, using the nomogram presented within this paper. The scale is reliable but has some inefficiencies due to too few high-end thresholds inhibiting discrimination amongst populations who already perceive that person-centred care is very good in their environment.


Sign in / Sign up

Export Citation Format

Share Document