Development of a Comprehensive Outcome Measure for Motor Coordination, Step 2: Reliability and Construct Validity in Chronic Stroke Patients

2021 ◽  
Vol 35 (2) ◽  
pp. 194-203
Author(s):  
Roni Molad ◽  
Sandra R. Alouche ◽  
Marika Demers ◽  
Mindy F. Levin

Background A comprehensive scale assessing motor coordination of multiple body segments was developed using a 3-phase content validation process. The Comprehensive Coordination Scale (CCS) evaluates motor coordination defined as the ability to produce context-dependent movements of multiple effectors in both spatial and temporal domains. The scale assesses motor coordination in individuals with neurological injuries at 2 levels of movement description: the motor performance level describes end point movements (ie, hand, foot), and the movement quality level describes limb joints/trunk movements contributing to end point movement. Objective To determine measurement properties of the scale in people with chronic stroke. Methods Standardized approaches determined the internal consistency (factor loadings), intrarater and interrater reliability (interclass correlation coefficient), measurement error (SEM; minimal detectable change [MDC]), construct validity, and interpretability (ie, ceiling and floor effects) of the CCS. Results Data from 30 patients with chronic stroke were used for the analysis. The internal consistency of the scale was high (0.94), and the scale consisted of separate factors characterizing end point motor performance and movement quality. Intrarater (intraclass correlation coefficient [ICC] = 0.97-0.97) and interrater (ICC=0.76-0.98) reliability of the whole scale and subscales were good to excellent. The CCS had an SEM of 1.80 points (total score = 69 points) and an MDC95 of 4.98 points. The CCS total score was related to Fugl-Meyer Assessment total and motor scores and had no ceiling or floor effects. Conclusions The CCS scale has strong measurement properties and may be a useful measure of spatial and temporal coordination deficits in chronic stroke survivors.

2021 ◽  
Vol 22 (1) ◽  
Author(s):  
Malou E. M. te Molder ◽  
Johanna E. Vriezekolk ◽  
Menno R. Bénard ◽  
Petra J. C. Heesterbeek

Abstract Background Patients undergoing total knee arthroplasty (TKA) tend to be younger and tend to receive TKA at an earlier stage compared to 20 years ago. The Oxford Knee Score – Activity and Participation (OKS-APQ) questionnaire evaluates higher levels of activity and participation, reflecting activity patterns of younger or more active people. The purpose of this study was to translate the OKS-APQ questionnaire into Dutch, and to evaluate its measurement properties in pre- and postoperative TKA patients. Methods The OKS-APQ was translated and adapted according to the forward–backward translation multi step approach and tested for clinimetric quality. Floor and ceiling effects, structural validity, construct validity, internal consistency and test–retest reliability were evaluated using COSMIN quality criteria. The OKS-APQ, the Oxford Knee Score (OKS), the Short Form-36 (SF-36), a Visual Analogue Scale (VAS) for pain and the Forgotten Joint Score (FJS) were assessed in 131 patients (72 preoperative and 59 postoperative TKA patients), and the OKS-APQ was administered twice in 50 patients (12 preoperative and 38 postoperative TKA patients), after an interval of minimal 2 weeks. Results Floor effects were observed in preoperative patients. Confirmatory factor analyses (CFA) indicated a good fit of a 1-factor model by the following indices: (Comparative Fit Index (CFI): 0.97, Tucker-Lewis Index (TLI): 0.96 and Standardized Root Mean Square Residual (SRMR): 0.03). Construct validity was supported as > 75% of the hypotheses were confirmed. Internal consistency (Cronbach α’s from 0.81 to 0.95) was good in the pooled and separate pre- and postoperative samples and test–retest reliability (Intraclass Correlation Coefficients (ICCs) from 0.63 – 0.85) were good in postoperative patients and moderate in preoperative patients. The standard Error of Measurements (SEMs) ranged from 8.5 – 12.2 and the Smallest Detectable Changes in individuals (SDCind) ranged from 23.5 – 34.0 (on a scale from 0 to 100). Conclusions Preliminary findings suggest that the Dutch version of the OKS-APQ is reliable and valid for a Dutch postoperative TKA patient sample. However, in a preoperative TKA sample, the OKS-APQ seems less suitable, because of floor effects and lower test–retest reliability. The Dutch version of the OKS-APQ can be used alongside the OKS to discriminate among levels of activity and participation in postoperative patients.


Author(s):  
Marco Fabbri ◽  
Alessia Beracci ◽  
Monica Martoni ◽  
Debora Meneo ◽  
Lorenzo Tonetti ◽  
...  

Sleep quality is an important clinical construct since it is increasingly common for people to complain about poor sleep quality and its impact on daytime functioning. Moreover, poor sleep quality can be an important symptom of many sleep and medical disorders. However, objective measures of sleep quality, such as polysomnography, are not readily available to most clinicians in their daily routine, and are expensive, time-consuming, and impractical for epidemiological and research studies., Several self-report questionnaires have, however, been developed. The present review aims to address their psychometric properties, construct validity, and factorial structure while presenting, comparing, and discussing the measurement properties of these sleep quality questionnaires. A systematic literature search, from 2008 to 2020, was performed using the electronic databases PubMed and Scopus, with predefined search terms. In total, 49 articles were analyzed from the 5734 articles found. The psychometric properties and factor structure of the following are reported: Pittsburgh Sleep Quality Index (PSQI), Athens Insomnia Scale (AIS), Insomnia Severity Index (ISI), Mini-Sleep Questionnaire (MSQ), Jenkins Sleep Scale (JSS), Leeds Sleep Evaluation Questionnaire (LSEQ), SLEEP-50 Questionnaire, and Epworth Sleepiness Scale (ESS). As the most frequently used subjective measurement of sleep quality, the PSQI reported good internal reliability and validity; however, different factorial structures were found in a variety of samples, casting doubt on the usefulness of total score in detecting poor and good sleepers. The sleep disorder scales (AIS, ISI, MSQ, JSS, LSEQ and SLEEP-50) reported good psychometric properties; nevertheless, AIS and ISI reported a variety of factorial models whereas LSEQ and SLEEP-50 appeared to be less useful for epidemiological and research settings due to the length of the questionnaires and their scoring. The MSQ and JSS seemed to be inexpensive and easy to administer, complete, and score, but further validation studies are needed. Finally, the ESS had good internal consistency and construct validity, while the main challenges were in its factorial structure, known-group difference and estimation of reliable cut-offs. Overall, the self-report questionnaires assessing sleep quality from different perspectives have good psychometric properties, with high internal consistency and test-retest reliability, as well as convergent/divergent validity with sleep, psychological, and socio-demographic variables. However, a clear definition of the factor model underlying the tools is recommended and reliable cut-off values should be indicated in order for clinicians to discriminate poor and good sleepers.


2019 ◽  
Vol 20 (1) ◽  
Author(s):  
Alexander Tingulstad ◽  
Rikke Munk ◽  
Margreth Grotle ◽  
Ørjan Vigdal ◽  
Kjersti Storheim ◽  
...  

Abstract Background The Back Beliefs Questionnaire (BBQ) is a 14-item patient-reported questionnaire that measures attitudes and beliefs about the consequences of back pain. The BBQ has recently been translated into Norwegian, but its psychometric properties have not yet been tested. The aim of this study is to evaluate the reliability and construct validity of the BBQ when used on elderly patients with back pain. Method A prospective cohort study with a test-retest design among 116 elderly patients (> 55 years of age) seeking primary care for a new episode of back pain. Test-retest, standard error of measurement (SEM), minimal detectable change (MDC), internal consistency and construct validity by a priori hypotheses (Spearman’s- and Pearson correlation coefficient) were tested. Results A total of 116 patients, mean age (SD) 67.7 (8.3), were included and 63 patients responded to the test-retest assessment. The mean (SD) BBQ sum scores (range 9–45) were 29.8 (7.0) and 29.2 (6.7) for the test and retest respectively. The test-retest was acceptable with an intraclass correlation coefficient of 0.71 (95% CI, 0.54–0.82), SEM was 3.8 and MDC 10.5. Internal consistency with Cronbach’s alpha was good (0.82) and acceptable construct validity was supported by the confirmation of 75% of the a priori hypotheses. Conclusion The Norwegian version of the BBQ demonstrated acceptable test-retest reliability and good construct validity and can be used to assess pessimistic beliefs in elderly patients with back pain.


2020 ◽  
Vol 18 (1) ◽  
Author(s):  
Tarek Mahmood ◽  
Minhaj Rahim Choudhury ◽  
Md Nazrul Islam ◽  
Syed Atiqul Haq ◽  
Md Abu Shahin ◽  
...  

Abstract Background This study was focused on translation and cultural adaptation of the English Lequesne Algofunctional index (LAI) into Bengali for patients with primary knee osteoarthritis (OA) and testing reliability and validity of the Bengali version of the LAI. Methods This study was carried out in the Department of Rheumatology, BSM Medical University, Dhaka, Bangladesh. Using the forward–backward method the English LAI was translated into Bengali including cultural adaptation. For pretesting, A sample of 40 patients with primary knee osteoarthritis were screened using the Bengali version of LAI. Following the pretest, 130 consecutive patients with symptomatic knee OA completed the interviewer administered Bengali LAI, the validated Bengali version of SF-36, Visual Analogue Scale for Pain, Distance Walked and Activities of Daily Living. For the retest 60 randomly selected patients from the cohort were administered the Bengali LAI 7 days later. An item by item analysis was performed. Internal consistency was assessed by Cronbach’s alpha, test–retest reliability by intraclass correlation coefficient (ICC) and Kappa coefficient, construct validity was measured using the Spearman rank correlation coefficient. Results It took 3.25 ± 0.71 min to complete the Bengali LAI and the mean score was 9.23 ± 4.58. For the Bengali LAI Cronbach’s alpha score was 0.88, test–retest reliability assessed by ICC was 0.97. For construct validity, excellent convergent validity was achieved (ρ = 0.93) but the divergent validity was moderate (ρ = 0.43). Conclusions The Bengali LAI showed excellent convergent validity, internal consistency and test–retest reliability, only the divergent validity was moderate. So, the Bengali LAI can be applied as a HRQoL assessment tool for primary knee OA patients.


2020 ◽  
pp. 026921552096647
Author(s):  
Tobias Braun ◽  
Detlef Marks ◽  
Christian Thiel ◽  
Alexandra Menig ◽  
Christian Grüneberg

Objective: To examine the measurement properties of the de Morton Mobility Index (DEMMI), a performance-based clinical outcome assessment of mobility capacity, in hospital patients with Parkinson’s disease. Design: Cross-sectional study. Participants: Hospital patients with Parkinson’s disease. Main outcome measure(s): Structural validity and unidimensionality (Rasch analysis), construct validity, internal consistency reliability, and inter-rater reliability of the de Morton Mobility Index (scale range: 0–100 points) were established. The minimal detectable change, the 95% limits of agreement and possible floor and ceiling effects were calculated to indicate interpretability. Results: We analysed validity ( n = 100; mean age: 70 years; 71% male) and reliability ( n = 47; mean age: 71 years; 68% male) in two samples. The mean Hoehn and Yahr stage was 3.2 and the mean disease duration was 12 years in both samples. Rasch analysis indicated unidimensionality with an overall fit to the model (chi-square = 21.49, P = 0.122). Seventy-three percent of hypotheses on construct validity were confirmed. Internal consistency reliability (Cronbach’s alpha = 0.91) and inter-rater reliability (intraclass correlation coefficient = 0.88; 95% confidence interval: 0.80 to 0.93) were sufficient. The minimal detectable change with 90% confidence was 17.5 points and the limits of agreement were 31%. No floor or ceiling effects were observed. The mean administration time was 6.6 minutes. Conclusion: This study provides evidence of unidimensionality, sufficient internal consistency reliability, inter-rater reliability, construct validity, and feasibility of the de Morton Mobility Index in hospital patients with Parkinson’s disease. Trial registration: German Clinical Trials Register (DRKS00004681). Registered May 6, 2013.


2021 ◽  
Vol 103-B (4) ◽  
pp. 627-634 ◽  
Author(s):  
Shiraz A. Sabah ◽  
Abtin Alvand ◽  
David J. Beard ◽  
Andrew J. Price

Aims To estimate the measurement properties for the Oxford Knee Score (OKS) in patients undergoing revision knee arthroplasty (responsiveness, minimal detectable change (MDC-90), minimal important change (MIC), minimal important difference (MID), internal consistency, construct validity, and interpretability). Methods Secondary data analysis was performed for 10,727 patients undergoing revision knee arthroplasty between 2013 to 2019 using a UK national patient-reported outcome measure (PROM) dataset. Outcome data were collected before revision and at six months postoperatively, using the OKS and EuroQol five-dimension score (EQ-5D). Measurement properties were assessed according to COnsensus-based Standards for the selection of health status Measurement Instruments (COSMIN) guidelines. Results A total of 9,219 patients had complete outcome data. Mean preoperative OKS was 16.7 points (SD 8.1), mean postoperative OKS 29.1 (SD 11.4), and mean change in OKS + 12.5 (SD 10.7). Median preoperative EQ-5D index was 0.260 (interquartile range (IQR) 0.055 to 0.691), median postoperative EQ-5D index 0.691 (IQR 0.516 to 0.796), and median change in EQ-5D index + 0.240 (IQR 0.000 to 0.567). Internal consistency was good with Cronbach’s α 0.88 (baseline) and 0.94 (post-revision). Construct validity found a high correlation of OKS total score with EQ-5D index ( r = 0.76 (baseline), r = 0.83 (post-revision), p < 0.001). The OKS was responsive with standardized effect size (SES) 1.54 (95% confidence interval (CI) 1.51 to 1.57), compared to SES 0.83 (0.81 to 0.86) for the EQ-5D index. The MIC for the OKS was 7.5 points (95% CI 5.5 to 8.5) based on the optimal cut-off with specificity 0.72, sensitivity 0.60, and area under the curve 0.66. The MID for the OKS was 5.2 points. The MDC-90 was 3.9 points. The OKS did not demonstrate significant floor or ceiling effects. Conclusion This study found that the OKS was a useful and valid instrument for assessment of outcome following revision knee arthroplasty. The OKS was responsive to change and demonstrated good measurement properties. Cite this article: Bone Joint J 2021;103-B(4):627–634.


PLoS ONE ◽  
2021 ◽  
Vol 16 (12) ◽  
pp. e0261815
Author(s):  
Anna Röschel ◽  
Christina Wagner ◽  
Mona Dür

Objectives Informal caregivers often experience a restriction in occupational balance. The self-reported questionnaire on Occupational Balance in Informal Caregivers (OBI-Care) is a measurement instrument to assess occupational balance in informal caregivers. Measurement properties of the German version of the OBI-Care had previously been assessed in parents of preterm infants exclusively. Thus, the aim of this study was to examine the measurement properties of the questionnaire in a mixed population of informal caregivers. Methods A psychometric study was conducted, applying a multicenter cross-sectional design. Measurement properties (construct validity, internal consistency, and interpretability) of each subscale of the German version of the OBI-Care were examined. Construct validity was explored by assessing dimensionality, item fit and overall fit to the Rasch model, and threshold ordering. Internal consistency was examined with inter-item correlations, item-total correlations, Cronbach’s alpha, and person separation index. Interpretability was assessed by inspecting floor and ceiling effects. Results A total of 196 informal caregivers, 171 (87.2%) female and 25 (12.8%) male participated in this study. Mean age of participants was 52.27 (±12.6) years. Subscale 1 was multidimensional, subscale 2 and subscale 3 were unidimensional. All items demonstrated item fit and overall fit to the Rasch model and displayed ordered thresholds. Cronbach’s Alpha and person separation index values were excellent for each subscale. There was no evidence of ceiling or floor effects. Conclusions We identified satisfying construct validity, internal consistency, and interpretability. Thus, the findings of this study support the application of the German version of the OBI-Care to assess occupational balance in informal caregivers.


2021 ◽  
Vol 28 (1) ◽  
pp. 133-148
Author(s):  
Il-Sun Ko ◽  
Jin Sook Kim ◽  
Soyoung Choi

Purpose: The purpose of this study was to evaluate the measurement properties of spirituality-related assessment tools published in Korean journals.Methods: The databases used to search the literature reporting use of the spirituality-related assessment tools were RISS, NDSL, DBpia, KoreaMed, and KISS. The quality of the measurement properties was evaluated based on the reported internal consistency, content validity, criterion validity, construct validity, reproducibility, responsiveness, floor-ceiling effects and interpretability based on the tools review criteria suggested by Terwee et al.Results: Twenty-five assessment tools (including 7 original Korean versions) were identified from the 208 Korean studies published up to November, 2016. All of the 25 tools reported internal consistency and content validity; construct validity was reported in 21 tools while only six tools had reported on criterion validity. None of the studies reported on the reproducibility, responsiveness, and floor-ceiling effects. Among 25 spirituality-related assessment tools, the spiritual well-being scale was identified as the most commonly used tool for spirituality assessment.Conclusion: Among 25 spirituality-related assessment tools used in Korean studies, all of them satisfied only three criteria out of the eight criteria for measurement properties, internal consistency, content validity, and interpretability. The results of this study provide evidence to develop reliable and valid tools that will satisfy the criteria for measurement properties. In addition, standardized, reliable, and valid assessment tools must be chosen for spirituality-related study.


2019 ◽  
Vol 100 (2) ◽  
pp. 346-358 ◽  
Author(s):  
Lieke M A Dekkers ◽  
Anjo J W M Janssen ◽  
A Rogier T Donders ◽  
Maria W G Nijhuis-van der Sanden ◽  
Bert J M de Swart

Abstract Background The Observable Movement Quality (OMQ) Scale measures generic movement quality. Each item of the OMQ Scale focuses on a different element; together, the 15 items assess the whole construct of movement quality. Objective The aim of this study was to determine the construct validity of the OMQ Scale using 7 hypotheses defined to conform to the Consensus-Based Standards for the Selection of Health Measurement Instruments. Design This was an exploratory validation study. Methods A pediatric physical therapist assessed motor performance in 101 children using an age-specific motor test and the OMQ Scale. The direction, magnitude, and rationale for 7 hypotheses, which concerned relationships (n = 2), probability of low scores (n = 4), and difference between diagnosis subgroups (n = 1), were defined. Results The results confirmed 6 of the 7 hypotheses, indicating sufficient construct validity. Significant positive relationships were found between OMQ Scale total scores and the severity of motor disabilities (r = 0.72) and z scores on motor tests (r = 0.60). Probabilities for low scores on OMQ Scale items—exceeding the chi-square critical value—were confirmed for children diagnosed with spasticity, psychomotor retardation, mitochondrial diseases, and ataxia; however, probabilities for low OMQ Scale item scores on strength regulation in children with ataxia were not confirmed. OMQ Scale total scores for children who were not ambulatory because of neurological conditions were significantly different from those for children who were not ambulatory because of fatigue (r = 0.66). Limitations The sample of children was based on theoretical assumptions about relevant variations in clinical representations; on the basis of the results, it appears that children with low strength regulation were underrepresented. Conclusion The confirmation of nearly all hypotheses supported the validity of the OMQ Scale for measuring movement quality in clinical practice in addition to standardized age-adequate motor performance tests.


2020 ◽  
pp. 154596832098195
Author(s):  
Sandra R. Alouche ◽  
Roni Molad ◽  
Marika Demers ◽  
Mindy F. Levin

Background Motor coordination, the ability to produce context-dependent organized movements in spatial and temporal domains, is impaired after neurological injuries. Outcome measures assessing coordination mostly quantify endpoint performance variables (ie, temporal qualities of whole arm movement) but not movement quality (ie, trunk and arm joint displacements). Objective To develop an outcome measure to assess coordination of multiple body segments at both endpoint trajectory and movement quality levels, based on observational kinematics, in adults with neurological injuries. Methods A 3-phase study was used to develop the Comprehensive Coordination Scale (CCS): instrument development, Delphi process, and focus group meeting. The CCS was constructed from common tests used in clinical practice and research. Rating scales for different behavioral elements were developed to guide analysis. For content validation, 8 experts (ie, neurological clinicians/researchers) answered questionnaires about relevance, comprehension, and feasibility of each test and rating scale. A focus group conducted with 6 of 8 experts obtained consensus on rating scale and instruction wording, and identified gaps. Three additional experts reviewed the revised CCS content to obtain a final version. Results Experts identified a gap regarding assessment of hand/finger coordination. The CCS final version is composed of 6 complementary tests of coordination: finger-to-nose, arm-trunk, finger, lower extremity, and 2- and 4-limb interlimb coordination. Constructs include spatial and temporal variables totaling 69 points. Higher scores indicate better performance. Conclusions The CCS may be an important, understandable and feasible outcome measure to assess spatial and temporal coordination. CCS measurement properties are presented in the companion article.


Sign in / Sign up

Export Citation Format

Share Document