A reliability and validity study on upper limb range of motion measurement using mobile sensor compared with goniometers

Introduction: The use of tele-rehabilitation devices to aid physiotherapy has gained popularity in recent years. In particular, measuring limb range of motion with a wearable mobile sensor can facilitate rehabilitation therapies by providing more efficient progress monitoring and reducing clinicians’ workload. This study aimed to examine the test-retest reliability and validity of using a wearable mobile sensor to measure upper limb range of motion (ROM). Materials and methods: Participants were recruited by convenient sampling. They were instructed to perform four kinds of upper limb movements including shoulder flexion, abduction, external rotation and elbow flexion, from which the ROM was measured by Mobile sensors REBEE (XCLR8 Technologies) and a standard goniometer (Model 12-1000) in each movement. Each kind of movements and the two ROM measurements were performed twice for the evaluation of test-retest reliability using Intraclass Correlation Coefficients (ICC). Pearson's correlations were computed between the ROM measured by the mobile sensors and the goniometer in each movement to assess construct validities of the mobile sensors. The agreement (95% mean difference) between the two sets of measurement was illustrated by Bland-Altman plots. Results: Thirty-four asymptomatic young Asian adults (15 males) participated in this study (Mage ± SD, 24.2 ± 3.82 years). The ICC for the ROM measured by the sensors were between 0.94 and 0.99, p <0.01 and for the goniometer measurements were between 0.95 and 0.98, p <0.01 in the four movements, indicating excellent reliability in both measurement methods. The Pearson's correlation between the sensor’s and goniometric ROM measurements in four kinds of movements ranged from r =0.96 to 0.99, p <0.01, indicating a very strong construct validity for using the mobile sensors to measure upper limb ROM. The mean difference between the two measurements ranged from 0.13 degrees to 7.6 degrees. Conclusions: The results demonstrated that measuring upper limb ROM using the mobile sensors by non-healthcare trained students were as reliable and valid as using the standard universal goniometers by healthcare trained students. The findings implied that the wearable mobile sensors possibly allow non-healthcare trained carers to measure clinically useful, reliable and valid upper limb ROM from patients, which may facilitate symptom monitoring and improve the efficiency of the rehabilitation process.

Download Full-text

Reliability of the ForceFrame With and Without a Fixed Upper-Limb Mold in Shoulder Rotation Strength Assessments Compared With Traditional Hand-Held Dynamometry

Journal of Sport Rehabilitation ◽

10.1123/jsr.2020-0434 ◽

2021 ◽

pp. 1-4

Author(s):

Jamon Couch ◽

Marc Sayers ◽

Tania Pizzari

Keyword(s):

Upper Limb ◽

External Rotation ◽

Intraclass Correlation ◽

Correlation Coefficients ◽

Shoulder Abduction ◽

Minimal Detectable Change ◽

Retest Reliability ◽

Intraclass Correlation Coefficients ◽

Shoulder Strength ◽

Test Retest Reliability

Context: An imbalance between shoulder internal rotation (IR) and external rotation (ER) strength in athletes is proposed to increase the risk of sustaining a shoulder injury. Hand-held (HHD) and externally fixed dynamometry are reliable forms of assessing shoulder IR and ER strength. A new externally fixed device with an attachable fixed upper-limb mold (The ForceFrame) exists; however, its reliability in measuring shoulder strength is yet to be investigated. Objective: To determine the test–retest reliability of the ForceFrame, with and without the fixed upper-limb mold, in the assessment of shoulder IR and ER strength, as compared with HHD. Design: Test–retest reliability study. Setting: Laboratory, clinical. Participants: Twenty-two healthy and active individuals were recruited from the university community and a private physiotherapy practice. Main Outcome Measures: Maximal isometric shoulder IR and ER strength was measured using the ForceFrame and traditional HHD in neutral and at 90° shoulder abduction. Mean (SD) strength measures were calculated. Test–retest reliability was analyzed using intraclass correlation coefficients (3, 1). The SEM and minimal detectable change were calculated. Results: Good to excellent test–retest reliability was found for all shoulder strength tests across Hand-held dynamometry (HHD) and externally fixed dynamometry (EFD) are reliable forms (intraclass correlation coefficients [3, 1] = .854–.916). The minimal detectable changes ranged between 25.61 and 41.84 N across tests. Test–retest reliability was not affected by the dynamometer or testing position. Conclusions: The results from this study indicate that both the ForceFrame and HHD are suitable for measuring shoulder strength in clinical practice. The use of the fixed upper-limb mold with the ForceFrame does not improve reliability.

Download Full-text

Validity and reliability of the Mandarin version of the Treatment Burden Questionnaire among stroke patients in Mainland China

Family Practice ◽

10.1093/fampra/cmab004 ◽

2021 ◽

Author(s):

Qi Zhang ◽

Ke Zhang ◽

Miao Li ◽

Jiaxin Gu ◽

Xintong Li ◽

...

Keyword(s):

Internal Consistency ◽

Convergent Validity ◽

Intraclass Correlation ◽

Reliability And Validity ◽

Therapeutic Interventions ◽

Treatment Burden ◽

Validity And Reliability ◽

Stroke Patients ◽

Retest Reliability ◽

Test Retest Reliability

Abstract Objectives To examine the validity and reliability of the Mandarin version of the Treatment Burden Questionnaire (TBQ) among stroke patients. Background Stroke patients need long-term management of symptoms and life situation, and treatment burden has recently emerged as a new concept that can influence the health outcomes during the rehabilitation process. Methods The convenience sampling method was used to recruit 187 cases of stroke patients in a tertiary grade hospital in Tianjin for a formal investigation. Item analysis, reliability and validity tests were carried out. The reliability test included internal consistency and test–retest reliability. And as well as content, structure and convergent validity were performed for the validity test. Results Of the 187 completed questionnaires, only 180 (96.3%) were suitable for analysis. According to the experts’ evaluation, the I-CVI of each item was from 0.833 to 1.000, and the S-CVI was 0.967. The exploratory factor analysis yielded three-factor components with a cumulative variation of 53.054%. Convergent validity was demonstrated using measures of Morisky’s Medication Adherence Scale 8 (r = –0.450, P < 0.01). All correlations between items and global scores ranged from 0.403 to 0.638. Internal consistency reliability and test–retest reliability were found to be acceptable, as indicated by a Cronbach’s α of 0.824 and an intraclass correlation coefficient of 0.846, respectively. Conclusions The Mandarin TBQ had acceptable validity and reliability. The use of TBQ in the assessment of treatment burden of stroke survivor may benefit health resources allocation and provide tailor therapeutic interventions to construct minimally disruptive care.

Download Full-text

Reliability and Validity of the Thai Version of the Carolinas Comfort Scale

Journal of the Medical Association of Thailand ◽

10.35755/jmedassocthai.2021.11.12652 ◽

2021 ◽

Vol 104 (11) ◽

pp. 1784-1787

Keyword(s):

Inguinal Hernia ◽

Hernia Repair ◽

Inguinal Hernia Repair ◽

Correlation Coefficient ◽

Intraclass Correlation Coefficient ◽

Intraclass Correlation ◽

Reliability And Validity ◽

Internal Consistency Reliability ◽

Retest Reliability ◽

Test Retest Reliability

Objective: To evaluate the reliability and validity of the Thai version of the Carolinas Comfort Scale (CCS) to measure health-related quality of life (HRQoL) in post-hernia repaired patients. Materials and Methods: Three hundred twenty-eight patients that underwent the inguinal hernia repair procedure in Vajira Hospital were recruited in the present study. The Thai version of CCS (TCCS) was performed entirely by the patient, and the test-retest reliability was conducted at a 2-week interval. Results: The TCCS’s internal consistency reliability was excellent (Cronbach’s alpha 0.89). The inter-rater reliability was found to agree with the intraclass correlation coefficient of 0.90. The test-retest reliability over two weeks was high, with an intraclass correlation coefficient of 0.92. Conclusion: The Thai version of CCS was found to have adequate reliability and validity and could be used to measure HRQoL in Thai patients that undergo inguinal hernia repair. Keywords: Reliability; Validity; Carolinas Comfort Scale; Thai version

Download Full-text

Reliability and Validity of Turkish Myasthenia Gravis-Activities of Daily Living Scale

OTJR Occupation Participation and Health ◽

10.1177/1539449220961077 ◽

2020 ◽

pp. 153944922096107

Author(s):

Ecem Karanfil ◽

Yeliz Salcı ◽

Ayla Fil-Balkan ◽

Can Ebru Bekircan-Kurt ◽

Sevim Erdem Özdamar ◽

...

Keyword(s):

Construct Validity ◽

Myasthenia Gravis ◽

Activities Of Daily Living ◽

Daily Living ◽

Intraclass Correlation ◽

Reliability And Validity ◽

Life Questionnaire ◽

Good Test ◽

Retest Reliability ◽

Test Retest Reliability

Linguistic, reliable, and valid secondary efficacy measures are important in clinical settings and studies. The aim of the study is to report test–retest reliability and construct validity of Turkish version of Myasthenia Gravis-Activities of Daily Living Scale (MG-ADL-T) in Myasthenia Gravis (MG) patients. Fifty-two ocular and generalized individuals with MG, applying to rehabilitation center, were included in the study. MG-ADL-T, MG quality-of-life questionnaire (MG-QoL), MG composite (MGC), quantitative MG score (QMGS), and pulmonary function test were administered. Reliability was assessed with intraclass correlation coefficient (ICC) and Cronbach’s alpha. Spearman correlation test and receiver operating characteristic (ROC) analysis were performed for construct validity. MG-ADL-T had fair internal consistency (Cronbach’s α = .67), excellent test–retest reliability (ICC = 0.96) and moderate construct validity (MG-QoL, r = 0.59; QMGS, r = .58; MGC, r = .68). MG-ADL, a unique scale that evaluates activities of daily living (ADL), has good test–retest reliability and construct validity in Turkish MG patients.

Download Full-text

Test-Retest Reliability and Validity of the Six Minute Stepper Test to Evaluate Functional Exercise Capacity in Patients with Ankylosing Spondylitis

Modern Rheumatology ◽

10.1093/mr/roab094 ◽

2021 ◽

Author(s):

Selin Bayram ◽

Deran Oskay ◽

Nurten Gizem Tore ◽

Fulden Sari ◽

Devrim Can Saraç ◽

...

Keyword(s):

Ankylosing Spondylitis ◽

Exercise Capacity ◽

Convergent Validity ◽

Pearson Correlation ◽

Physiological Responses ◽

Intraclass Correlation ◽

Reliability And Validity ◽

Rank Test ◽

Retest Reliability ◽

Test Retest Reliability

ABSTRACT Objectives The 6-minute stepper test (6MST) is a submaximal test that requires little space to assess exercise capacity compared to the 6-minute walk test (6MWT). The study aims to investigate the test-retest reliability and convergent validity of 6MST and to compare physiological responses, dyspnea, fatigue perception with 6MST and 6MWT in patients with ankylosing spondylitis (AS). Methods To test the convergent validity of 6MST, 65 patients performed both 6MWT and 6MST on the first day and correlation between two tests were assessed with Pearson correlation test. In order to investigate the test-retest reliability of the 6MST, thirty-two of the 65 patients performed 6MST one week later and intraclass correlation coefficients (ICC) were calculated. Dyspnea and fatigue perception were analyzed with using Wilcoxon signed-rank test, physiological responses were analyzed using paired sample t-test. Results Excellent test-retest reliability was observed for 6MST (ICC: 0.988). There was a significant correlation between 6MST and 6MWT (r: 0.725, p<0.001). Dyspnea and leg fatigue perception were significantly higher in 6MST (p<0.05). Physiological responses and fatigue perception were similar in both 6MST and 6MWT (p>0.05). Conclusion This study demonstrated that the 6MST is reliable and valid method to evaluate exercise capacity in patients with AS. 6MST can be used to evaluate exercise capacity of patients with AS.

Download Full-text

Reliability and Validity of the Dyskinesia Impairment Scale in Children and Young Adults with Inherited or Idiopathic Dystonia

Journal of Clinical Medicine ◽

10.3390/jcm9082597 ◽

2020 ◽

Vol 9 (8) ◽

pp. 2597

Author(s):

Annika Danielsson ◽

Inti Vanmechelen ◽

Cecilia Lidbeck ◽

Lena Krumlinde-Sundholm ◽

Els Ortibus ◽

...

Keyword(s):

Young Adults ◽

Rating Scale ◽

Intraclass Correlation ◽

Reliability And Validity ◽

Children And Youth ◽

Rater Reliability ◽

Retest Reliability ◽

Children And Young Adults ◽

Test Retest Reliability ◽

Idiopathic Dystonia

Background: The Dyskinesia Impairment Scale (DIS) is a new assessment scale for dystonia and choreoathetosis in children and youth with dyskinetic cerebral palsy. Today, the Burke–Fahn–Marsden Dystonia Rating Scale (BFM) is mostly used to assess dystonia in children with inherited dystonia. The aim of this study was to assess reliability and validity of the DIS in children and youth with inherited or idiopathic dystonia. Methods: Reliability was measured by (1) the intraclass correlation coefficients (ICCs) for inter-rater and test-retest reliability, as well as (2) standard error of measurement (SEM) and minimal detectable difference (MDD). For concurrent validity of the DIS-dystonia subscale, the BFM was administered. Results: In total, 11 males and 9 females (median age 16 years and 7 months, range 6 to 24 years) were included. For inter-rater reliability, the ICCs for the DIS total score and the dystonia and choreoathetosis subscale scores were 0.83, 0.87, and 0.71, respectively. For test-retest reliability, the ICCs for the DIS total score and the dystonia and choreoathetosis subscale scores were 0.95, 0.88, and 0.93, respectively. The SEM and MDD for the total DIS were 3.98% and 11.04%, respectively. The Spearman correlation coefficient between the dystonia subscale and the BFM was 0.88 (p < 0.01). Conclusions: Good to excellent inter-rater, test-retest reliability, and validity were found for the total DIS and the dystonia subscale. The choreoathetosis subscale showed moderate inter-rater reliability and excellent test-retest reliability. The DIS may be a promising tool to assess dystonia and choreoathetosis in children and young adults with inherited or idiopathic dystonia.

Download Full-text

The Phone-FITT: A Brief Physical Activity Interview for Older Adults

Journal of Aging and Physical Activity ◽

10.1123/japa.16.3.292 ◽

2008 ◽

Vol 16 (3) ◽

pp. 292-315 ◽

Cited By ~ 40

Author(s):

Dawn P. Gill ◽

Gareth R. Jones ◽

GuangYong Zou ◽

Mark Speechley

Keyword(s):

Physical Activity ◽

Older Adults ◽

Intraclass Correlation ◽

Reliability And Validity ◽

Step Test ◽

Exercise Programs ◽

Perfect Agreement ◽

Convenience Sample ◽

Retest Reliability ◽

Test Retest Reliability

The purpose of this study was to develop a brief physical activity interview for older adults (Phone-FITT) and evaluate its test–retest reliability and validity. Summary scores were derived for household, recreational, and total PA. Reliability was evaluated in a convenience sample from a fall-prevention study (N= 43, 79.4 ± 2.9 years, 51% male), and validity, in a random sample of individuals in older adult exercise programs (N= 48, 77.4 ± 4.7 years, 25% male). Mean time to complete the Phone-FITT was 10 min for participants sampled from exercise programs. Evaluation of test–retest reliability indicated substantial to almost perfect agreement for all scores, with intraclass correlation coefficients (95% confidence intervals) ranging from .74 (.58–.85) to .88 (.8–.94). For validity, Spearman’s rho correlations of Phone-FITT scores with accelerometer counts ranged from .29 (.01–.53) to .57 (.34–.73). Correlations of Phone-FITT recreational scores with age and seconds to complete a self-paced step test ranged from –.29 (–.53 to –.01) to –.45 (–.68 to –.14). This study contributes preliminary evidence of the reliability and validity of the Phone-FITT.

Download Full-text

Reliability and Validity of 2 Self-Report Measures to Assess Sedentary Behavior in Older Adults

Journal of Physical Activity and Health ◽

10.1123/jpah.2013-0546 ◽

2015 ◽

Vol 12 (5) ◽

pp. 727-732 ◽

Cited By ~ 22

Author(s):

Keith P. Gennuso ◽

Charles E. Matthews ◽

Lisa H. Colbert

Keyword(s):

Physical Activity ◽

Older Adults ◽

Sedentary Behavior ◽

Linear Trend ◽

Pearson Correlation ◽

Intraclass Correlation ◽

Reliability And Validity ◽

Self Report ◽

Retest Reliability ◽

Test Retest Reliability

Background:The purpose of this study was to examine the reliability and validity of 2 currently available physical activity surveys for assessing time spent in sedentary behavior (SB) in older adults.Methods:Fifty-eight adults (≥65 years) completed the Yale Physical Activity Survey for Older Adults (YPAS) and Community Health Activities Model Program for Seniors (CHAMPS) before and after a 10-day period during which they wore an ActiGraph accelerometer (ACC). Intraclass correlation coefficients (ICC) examined test-retest reliability. Overall percent agreement and a kappa statistic examined YPAS validity. Lin’s concordance correlation, Pearson correlation, and Bland-Altman analysis examined CHAMPS validity.Results:Both surveys had moderate test-retest reliability (ICC: YPAS = 0.59 (P < .001), CHAMPS = 0.64 (P < .001)) and significantly underestimated SB time. Agreement between YPAS and ACC was low (κ = −0.0003); however, there was a linear increase (P < .01) in ACC-derived SB time across YPAS response categories. There was poor agreement between ACC-derived SB and CHAMPS (Lin’s r = .005; 95% CI, −0.010 to 0.020), and no linear trend across CHAMPS quartiles (P = .53).Conclusions:Neither of the surveys should be used as the sole measure of SB in a study; though the YPAS has the ability to rank individuals, providing it with some merit for use in correlational SB research.

Download Full-text

The validity and reliability of a digital Ruff Figural Fluency Test (RFFT)

BMC Psychology ◽

10.1186/s40359-021-00566-x ◽

2021 ◽

Vol 9 (1) ◽

Author(s):

J. Vrijsen ◽

C. L. van Erpecum ◽

S. E. de Rooij ◽

J. Niebuur ◽

N. Smidt

Keyword(s):

Intraclass Correlation ◽

Mean Difference ◽

Validity And Reliability ◽

Retest Reliability ◽

Paper And Pencil ◽

Test Retest Reliability ◽

Ruff Figural Fluency Test ◽

Figural Fluency ◽

Automatic Scoring ◽

Fluency Test

Abstract Background The Ruff Figural Fluency Test (RFFT) is a valid but time-consuming and labour-intensive cognitive paper-and-pencil test. A digital RFFT was developed that can be conducted independently using an iPad and Apple Pencil and RFFT scores are computed automatically. We investigated the validity and reliability of this digital RFFT. Methods We randomly allocated participants to the digital or paper-and-pencil RFFT. After the first test, the other test was performed immediately (cross-over). Participants were invited for a second digital RFFT 1 week later. For the digital RFFT, an (automatic) algorithm and two independent raters (criterion standard) assessed the number of unique designs (UD) and perseverative errors (PE). These raters also assessed the paper-and-pencil RFFT. We used Intraclass correlation coefficients (ICC), sensitivity, specificity, %-agreement, Kappa, and Bland–Altman plots. Results We included 94 participants (mean (SD) age 39.9 (14.8), 73.4% follow-up). Mean (SD) UD and median (IQR) PE of the digital RFFT were 84.2 (26.0) and 4 (2–7.3), respectively. Agreement between manual and automatic scoring of the digital RFFT was high for UD (ICC = 0.99, 95% CI 0.98, 0.99, sensitivity = 0.98; specificity = 0.96) and PE (ICC = 0.99, 95% CI 0.98, 0.99; sensitivity = 0.90, specificity = 1.00), indicating excellent criterion validity. Small but significant differences in UD were found between the automatic and manual scoring (mean difference: − 1.12, 95% CI − 1.92, − 0.33). Digital and paper-and-pencil RFFT had moderate agreement for UD (ICC = 0.73, 95% CI 0.34, 0.87) and poor agreement for PE (ICC = 0.47, 95% CI 0.30, 0.62). Participants had fewer UD on the digital than paper-and-pencil RFFT (mean difference: − 7.09, 95% CI − 11.80, − 2.38). The number of UD on the digital RFFT was associated with higher education (Spearman’s r = 0.43, p < 0.001), and younger age (Pearson’s r = − 0.36, p < 0.001), showing its ability to discriminate between different age categories and levels of education. Test–retest reliability was moderate (ICC = 0.74, 95% CI 0.61, 0.83). Conclusions The automatic scoring of the digital RFFT has good criterion and convergent validity. There was low agreement between the digital RFFT and paper-and-pencil RFFT and moderate test–retest reliability, which can be explained by learning effects. The digital RFFT is a valid and reliable instrument to measure executive cognitive function among the general population and is a feasible alternative to the paper-and-pencil RFFT in large-scale studies. However, its scores cannot be used interchangeably with the paper-and-pencil RFFT scores.

Download Full-text

Arabic Translation of the Weight Self-Stigma Questionnaire: Instrument Validation Study of Factor Structure and Reliability (Preprint)

10.2196/preprints.24169 ◽

2020 ◽

Author(s):

Nasser F BinDhim ◽

Nora A Althumiri ◽

Mada H Basyouni ◽

Omar T Sims ◽

Noara Alhusseini ◽

...

Keyword(s):

Factor Structure ◽

Internal Consistency ◽

Intraclass Correlation ◽

Reliability And Validity ◽

Arabic Version ◽

Cross Sectional ◽

Retest Reliability ◽

Two Factors ◽

Enacted Stigma ◽

Test Retest Reliability

BACKGROUND While it is most often associated with its effects on physical health, obesity is also associated with serious self-stigmatization. The lack of a suitable, validated tool to measure weight-related self-stigma in Arabic countries may be partly responsible for the scarcity of literature about this problem. OBJECTIVE This study investigated the reliability and validity of an Arabic version of the Weight Self-Stigma Questionnaire (WSSQ). METHODS Data on the Arabic-translated version of the 12-item WSSQ were collected using two cross-sectional electronic questionnaires distributed among Saudi nationals through the Sharik Association for Health Research’s database in June 2020. Internal consistency, test-retest reliability, and exploratory factor analysis of the Arabic WSSQ were assessed and compared with the original English version and other translations. RESULTS For reliability analysis, 43 participants completed the Arabic WSSQ during two time periods. Internal consistency was α=.898 for the overall survey, α=.819 for the fear of enacted stigma subscale (factor 1), and α=.847 for the self-devaluation subscale (factor 2). The test-retest reliability of the intraclass correlation coefﬁcient was α=.982. In the factor structure analysis, 295 participants completed the questionnaire. The Arabic WSSQ loading of the items was consistent with the original WSSQ, except for the loading of item 9, which was stronger in factor 2 than in factor 1. The two factors accounted for the observed variances of 47.7% and 10.6%. CONCLUSIONS The Arabic version of the WSSQ has good internal consistency and reliability, and the factorial structure is similar to that of the original WSSQ. The Arabic WSSQ is adaptable for clinicians seeking to assess weight-related self-stigma in Arabic-speaking people.

Download Full-text