scholarly journals Matrix Analogies Test - Short Form: An Evaluation of its Measurement Properties for a Sample of Greek School-aged Children using Rasch Analysis

2015 ◽  
Vol 03 (03) ◽  
Author(s):  
Georgia Spiliotopoulou
2018 ◽  
Vol 11 (3) ◽  
pp. 242-246 ◽  
Author(s):  
Jennifer L. Hunnicutt ◽  
Brittany N. Hand ◽  
Chris M. Gregory ◽  
Harris S. Slone ◽  
Michelle M. McLeod ◽  
...  

Background: Measurement properties of the short form of the Knee injury and Osteoarthritis Outcome Score (KOOS-JR) are not established in individuals after anterior cruciate ligament reconstruction (ACLR). The purpose of this study was to determine the extent to which the KOOS-JR measures the construct of knee health in individuals post-ACLR using Rasch analysis. Hypothesis: The KOOS-JR will fit the Rasch model, but significant ceiling effects will be present. Study Design: Cross-sectional study. Level of Evidence: Level 3. Methods: Rasch analysis of the KOOS-JR from 166 individuals 10 months post-ACLR was conducted. Unidimensionality, a key criterion of the Rasch model, was evaluated using confirmatory factor analysis. Model fit of the rating scale, items, and persons were evaluated. Mean square fit statistics ≥1.6 and standardized z-scores ≥2.0 were indicative of person or item misfit. Additionally, reliability indicators including person reliability and separation indices were examined. Results: The KOOS-JR fit the criteria of unidimensionality. All items demonstrated model fit; however, ceiling effects were noted (n = 36; 22%). Person reliability was low (0.47). Calculation of person strata revealed that the KOOS-JR did not separate participants into more than 1 stratum. The mean person measure was 3.56 logits higher than the mean item measure, indicating that this sample is skewed toward increased knee health. Conclusion: Although the KOOS-JR represented a unidimensional construct with items and persons fitting the Rasch model, several limitations were noted: ceiling effects, low person reliability, and poor person differentiation. Ceiling effects indicate that many individuals in this sample experienced better knee health than the KOOS-JR items were able to measure. Clinical Relevance: Evaluating the measurement properties of the KOOS-JR is necessary to determine its clinical value in sports medicine. In later stages after ACLR recovery, administration of the KOOS-JR may not be adequate.


2021 ◽  
Vol 19 (1) ◽  
Author(s):  
Sze-Ee Soh ◽  
Renata Morello ◽  
Darshini Ayton ◽  
Susannah Ahern ◽  
Ri Scarborough ◽  
...  

Abstract Background The 12-item Short-Form Health Survey version 2 (SF-12v2), a widely used, generic patient-reported measure of health status that provides summary scores of physical and mental health. No study to date has examined the measurement properties of the SF-12v2 in patients with lung cancer using Rasch analysis. The aim of this study was to extend the psychometric evaluations of the SF-12 within the lung cancer population to ensure its validity and reliability to assess the health status in this population. Methods Participants in the Victorian Lung Cancer Registry (VLCR) who completed the SF-12v2 between 2012 and 2016 were included in this study. The structural validity of the SF-12v2 was assessed using Rasch analysis. Overall fit to the Rasch measurement model was examined as well as five key measurement properties: uni-dimensionality, response thresholds, internal consistency, measurement invariance and targeting. Results A total of 342 participants completed the SF-12v2 three months following their lung cancer diagnosis. The SF-12 Physical Component Score (PCS-12) did not fit the overall Rasch measurement model (χ2 107.0; p < 0.001). Three items deviated significantly from the Rasch model (item fit residual beyond ± 2.5) with signs of dependency between item responses and disordered thresholds. Nevertheless, the PCS-12 was uni-dimensional with good internal consistency (person separation index [PSI] 0.83) and reasonable targeting. In contrast, the SF-12 Mental Component Score (MCS-12) had good overall model fit (χ2 35.1; p = 0.07), reasonable targeting and good internal consistency (PSI 0.81). Conclusions Rasch analysis suggests that there is general support for the reliability of the SF-12v2 as a measure of physical and mental health in people with lung cancer. However, the appropriateness of some items (e.g. pain) in the PCS-12 is questionable and further refinement of the scale including changing the response options may be required to improve the ability of the SF-12v2 to more appropriately assess the health status of this population.


2019 ◽  
Vol 25 (8) ◽  
pp. 1277-1290 ◽  
Author(s):  
Kathryn A Sexton ◽  
John R Walker ◽  
Laura E Targownik ◽  
Lesley A Graff ◽  
Clove Haviva ◽  
...  

Abstract Objectives Existing measures of inflammatory bowel disease (IBD) symptoms are not well suited to self-report, inadequate in measurement properties, insufficiently specific, or burdensome for brief or repeated administration. We aimed to develop a patient-reported outcome measure to assess a broader range of IBD symptoms. Methods The IBD Symptoms Inventory (IBDSI) was developed by adapting symptom items from existing clinician-rated or diary-format inventories; after factor analysis, 38 items were retained on 5 subscales: bowel symptoms, abdominal discomfort, fatigue, bowel complications, and systemic complications. Participants completed the IBDSI and other self-report measures during a clinic visit. A nurse administered the Harvey Bradshaw Index (HBI) for Crohn’s disease (CD) or the Powell-Tuck Index (PTI) for ulcerative colitis (UC), and a gastroenterologist completed a global assessment of disease severity (PGA). Results The 267 participants with CD (n = 142) or UC (n = 125), ages 18 to 81 (M = 43.4, SD = 14.6) were 58.1% female, with a mean disease duration of 13.9 (SD = 10.5) years. Confirmatory factor analysis supported the 5 subscales. The total scale and subscales showed good reliability and significant correlations with self-report symptom and IBD quality of life measures, the HBI, PTI, and PGA. Conclusions The IBDSI showed strong measurement properties: a supported factor structure, very good internal consistency, convergent validity, and excellent sensitivity and specificity to clinician-rated active disease. Self-report HBI and PTI items, when extracted from this measure, produced scores comparable to clinician-administered versions. The 38-item IBDSI, or 26-item short form, can be used as a brief survey of common IBD symptoms in clinic or research settings.


2021 ◽  
Vol 19 (1) ◽  
Author(s):  
Daniel Y. T. Fong ◽  
Janet Y. H. Wong ◽  
Edmond P. H. Choi ◽  
K. F. Lam ◽  
C. Kwok

Abstract Background The Short Form 12-item Health Survey (SF-12v2) was originally developed in English, but it is also available in Hong Kong (HK) Chinese. While both language versions had their measurement properties well assessed in their respective populations, their measurement invariance in scores has not been examined. Therefore, we aimed to assess their measurement invariance. Methods We conducted a cross-sectional study on individuals aged 18 years or older at a university campus. Those who were bilingual in English and Chinese were randomly assigned to self-complete either the standard English or the HK Chinese SF-12v2. Measurement invariance of the two components and eight scales of the SF-12v2 was concluded if the corresponding 90% confidence interval (CI) for the difference between the two language versions entirely fell within the minimal clinically important difference of ± 3 units. Multiple-group confirmatory factor analysis (CFA) was also performed. Results A total of 1013 participants completed the SF-12v2 (496 in English and 517 in HK Chinese), with a mean age of 22 years (Range 18–58), and 626 participants (62%) were female. There were no significant differences in demographics. Only the physical and mental components and the mental health (MH) scale had their 90% CIs (0.21 to 1.61, − 1.00 to 0.98, and − 0.86 to 2.84, respectively) completely fall within the ± 3 units. The multiple-group CFA showed partial strict invariance. Conclusions The English and HK Chinese versions of the SF-12v2 can be used in studies with their two components and MH scores pooled in the analysis.


2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Magnus Johansson ◽  
Anthony Biglan

Abstract Background This paper describes the development and psychometric evaluation of a behavioral assessment instrument primarily intended for use with workgroups in any type of organization. The instrument was developed based on the Nurturing Environments framework which describes four domains important for health, well-being, and productivity; minimizing toxic social interactions, teaching and reinforcing prosocial behaviors, limiting opportunities for problem behaviors, and promoting psychological flexibility. The instrument is freely available to use and adapt under a CC-BY license and intended as a tool that is easy for any group to use and interpret to identify key behaviors to improve their psychosocial work environment. Methods Questionnaire data of perceived frequency of behaviors relevant to nurturance were collected from nine different organizations in Sweden. Data were analyzed using confirmatory factor analysis, Rasch analysis, and correlations to investigate relationships with relevant workplace measures. Results The results indicate that the 23-item instrument is usefully divided in two factors, which can be described as risk and protective factors. Toxic social behaviors make up the risk factor, while the protective factor includes prosocial behavior, behaviors that limit problems, and psychological flexibility. Rasch analysis showed that the response categories work as intended for all items, item fit is satisfactory, and there was no significant differential item functioning across age or gender. Targeting indicates that measurement precision is skewed towards lower levels of both factors, while item thresholds are distributed over the range of participant abilities, particularly for the protective factor. A Rasch score table is available for ordinal to interval data transformation. Conclusions This initial analysis shows promising results, while more data is needed to investigate group-level measurement properties and validation against concrete longitudinal outcomes. We provide recommendations for how to work in practice with a group based on their assessment data, and how to optimize the measurement precision further. By using a two-dimensional assessment with ratings of both frequency and perceived importance of behaviors the instrument can help facilitate a participatory group development process. The Group Nurturance Inventory is freely available to use and adapt for both commercial and non-commercial use and could help promote transparent assessment practices in organizational and group development.


2013 ◽  
Vol 93 (11) ◽  
pp. 1507-1519 ◽  
Author(s):  
Clayon B. Hamilton ◽  
Bert M. Chesworth

Background The original 20-item Upper Extremity Functional Index (UEFI) has not undergone Rasch validation. Objective The purpose of this study was to determine whether Rasch analysis supports the UEFI as a measure of a single construct (ie, upper extremity function) and whether a Rasch-validated UEFI has adequate reproducibility for individual-level patient evaluation. Design This was a secondary analysis of data from a repeated-measures study designed to evaluate the measurement properties of the UEFI over a 3-week period. Methods Patients (n=239) with musculoskeletal upper extremity disorders were recruited from 17 physical therapy clinics across 4 Canadian provinces. Rasch analysis of the UEFI measurement properties was performed. If the UEFI did not fit the Rasch model, misfitting patients were deleted, items with poor response structure were corrected, and misfitting items and redundant items were deleted. The impact of differential item functioning on the ability estimate of patients was investigated. Results A 15-item modified UEFI was derived to achieve fit to the Rasch model where the total score was supported as a measure of upper extremity function only. The resultant UEFI-15 interval-level scale (0–100, worst to best state) demonstrated excellent internal consistency (person separation index=0.94) and test-retest reliability (intraclass correlation coefficient [2,1]=.95). The minimal detectable change at the 90% confidence interval was 8.1. Limitations Patients who were ambidextrous or bilaterally affected were excluded to allow for the analysis of differential item functioning due to limb involvement and arm dominance. Conclusion Rasch analysis did not support the validity of the 20-item UEFI. However, the UEFI-15 was a valid and reliable interval-level measure of a single dimension: upper extremity function. Rasch analysis supports using the UEFI-15 in physical therapist practice to quantify upper extremity function in patients with musculoskeletal disorders of the upper extremity.


Sign in / Sign up

Export Citation Format

Share Document