Reliability, Validity and Responsiveness of Physical Activity Monitors in Patients with Inflammatory Myopathy

Rheumatology ◽  
2021 ◽  
Author(s):  
Bonny Rockette-Wagner ◽  
Didem Saygin ◽  
Siamak Moghadam-Kia ◽  
Chester Oddis ◽  
Océane Landon-Cardinal ◽  
...  
Keyword(s):  
Physical Activity ◽  
Construct Validity ◽  
Disease Activity ◽  
Retest Reliability ◽  
Activity Monitors ◽  
Muscle Testing ◽  
Patient Reported ◽  
Physical Activity Monitors ◽  
Global Disease Activity ◽  
Test Retest Reliability

Abstract Objective Idiopathic inflammatory myopathies (IIM) cause proximal muscle weakness, which affect activities of daily living. Wearable physical activity monitors (PAMs) objectively assess continuous activity with potential clinical usefulness in IIM assessment. We examined the psychometric characteristics for PAM outcomes in IIM. Methods Adult IIM patients were prospectively evaluated (baseline, 3 and 6-months) in an observational study. A waist-worn PAM (ActiGraph GT3X-BT) assessed average step counts/min, peak 1-min cadence, and vector magnitude/min. Validated myositis core set measures (CSM) including manual muscle testing (MMT), physician global disease activity (MD global), patient global disease activity (Pt global), extra-muscular disease activity (Ex-muscular global), HAQ-DI, muscle enzymes, and patient-reported physical function were evaluated. Test-retest reliability, construct validity, and responsiveness were determined for PAM measures and CSM using Pearson correlations and other appropriate analyses. Results 50 adult IIM patients enrolled [mean (SD) age, 53.6 (±14.6); 60% female, 94% Caucasian]. PAM measures showed strong test-retest reliability, moderate-to-strong correlations at baseline with MD global (r=-0.37- -0.48), Pt-global (r=-0.43- -0.61), HAQ-DI (r=-0.47- -0.59) and MMT (r = 0.37–0.52), and strong discriminant validity for categorical MMT and HAQ-DI. Longitudinal association with MD global (r=-0.38- -0.44), MMT (r = 0.50–0.57), HAQ-DI (r=-0.45- -0.55), and functional tests (r = 0.30–0.65) were moderate-to-strong. PAM measures were responsive to MMT improvement (≥10%) and moderate-to-major improvement on ACR/EULAR myositis response criteria. Peak 1-min cadence had the largest effect size and Standardized Response Means (SRMs). Conclusion PAM measures showed promising construct validity, reliability, and longitudinal responsiveness; especially peak 1-min cadence. PAMs provide valid outcome measures for future use in IIM clinical trials.

Validation of the Beliefs of Physical Activity among Clergy (B-PAC) Instrument

2017 ◽  
Vol 32 (2) ◽  
Author(s):  
Shannon Gwin ◽  
Paul Branscum ◽  
E. Laurette Taylor
Keyword(s):  
Physical Activity ◽  
Factor Analysis ◽  
Construct Validity ◽  
Psychometric Properties ◽  
Internal Consistency ◽  
Internal Consistency Reliability ◽  
Retest Reliability ◽  
Reliable Instrument ◽  
The Stability ◽  
Test Retest Reliability

The purpose of this study was to create a valid and reliable instrument to evaluate theory-basedbeliefs towards physical activity among clergy members. Data were collected from 174 clergy that par-ticipated in a 15-item online and paper-based survey. Psychometric properties of the instrument includedconfirmatory factor analysis (construct validity), and cronbach’s alpha (internal consistency reliability).In addition, the stability (test-retest reliability) of each subscale was evaluated with a sub-sample of 30participants. Results show the instrument was both valid and reliable, and will be useful in future studiestargeting this population. Future implications are discussed.

Psychometric properties of patient reported outcome (PRO) instruments in patients with small cell lung cancer (SCLC) in RESILIENT part 1.

2021 ◽  
Vol 39 (15_suppl) ◽  
pp. e24027-e24027
Author(s):  
Jaba Kokhreidze ◽  
Veleka Allen ◽  
Cristina Ivanescu ◽  
Xiaopan Valerie Yao ◽  
Bin Zhang ◽  
...  
Keyword(s):  
Lung Cancer ◽  
Construct Validity ◽  
Psychometric Properties ◽  
Internal Consistency ◽  
Life Questionnaire ◽  
Retest Reliability ◽  
Patient Reported ◽  
Eortc Qlq ◽  
Test Retest Reliability ◽  
Pro Instruments

e24027 Background: The ongoing two-part phase 2/3 RESILIENT study (NCT03088813) is investigating the efficacy and safety of liposomal irinotecan monotherapy in patients with SCLC who have progressed on or after first line platinum-based chemotherapy. This exploratory analysis from RESILIENT part 1 was conducted to confirm the psychometric properties of established PRO instruments that had not previously been validated in patients with SCLC. Methods: Patients completed the European Organisation for Research and Treatment of Cancer Quality of Life Questionnaire (EORTC QLQ) Core 30 (C30) and the EORTC QLQ Lung Cancer 13 (LC13) before treatment assignment (baseline), every 6 weeks thereafter, at treatment discontinuation and at the 30-day follow-up visit. Psychometric methods included descriptive statistics (items and scales), correlations (item-to-item and item-to-total), internal consistency (Cronbach’s α), test-retest reliability (intraclass correlation coefficient [ICC], two-way random effects model), construct validity and sensitivity to change. The analysis included patients who received at least one dose of study drug and completed at least one PRO assessment. Results: Thirty patients were enrolled in RESILIENT part 1 and included in the analysis. At baseline, 68% of patients reported ‘not severe’ or ‘mild’ symptoms. Floor effects (i.e. more than 25% of responses of ‘not at all’) were observed for several of the functioning/impact and symptom scales of the EORTC QLQ C30 and LC13. Moderate to strong correlations were found among most questionnaire items within their respective scales. Acceptable evidence for internal consistency and good test-retest reliability were observed. Selected results for the EORTC QLQ LC13, including dyspnea scales, are shown in the Table. The magnitude of correlations among PRO instruments supported evidence for convergent validity in this sample. Conclusions: In RESILIENT part 1, patients experienced low and tolerable symptoms at enrollment, limiting the potential for further improvement. Overall, these PRO instruments had acceptable psychometric properties (e.g. construct validity, reliability and ability to detect change) in this sample. However, these analyses should be repeated in a larger sample using data from RESILIENT part 2. Clinical trial information: NCT03088813. [Table: see text]

Adaptation, Test-Retest Reliability, and Construct Validity of the Physical Activity Neighborhood Environment Scale in Nigeria (PANES-N)

2013 ◽  
Vol 10 (8) ◽  
pp. 1079-1090 ◽  
Author(s):  
Adewale L. Oyeyemi ◽  
James F. Sallis ◽  
Adetoyeje Y. Oyeyemi ◽  
Mariam M. Amin ◽  
Ilse De Bourdeaudhuij ◽  
...  
Keyword(s):  
Physical Activity ◽  
Construct Validity ◽  
Intraclass Correlation ◽  
Cognitive Testing ◽  
Neighborhood Environment ◽  
Analysis Of Covariance ◽  
Environmental Perceptions ◽  
Retest Reliability ◽  
Environment Scale ◽  
Test Retest Reliability

Background:This study adapted the Physical Activity Neighborhood Environment Scale (PANES) to the Nigerian context and assessed the test-retest reliability and construct validity of the Nigerian version (PANES-N).Methods:A multidisciplinary panel of experts adapted the original PANES to reflect the built and social environment of Nigeria. The adapted PANES was subjected to cognitive testing and test retest reliability in a diverse sample of Nigerian adults (N = 132) from different neighborhood types. Intraclass Correlation Coefficients (ICC) was used to assess test-retest reliability, and construct validity was investigated with Analysis of Covariance for differences in environmental attributes between neighborhoods.Results:Four of the 17 items on the original PANES were significantly modified, 3 were removed and 2 new items were incorporated into the final version of adapted PANES-N. Test-retest reliability was substantial to almost perfect (ICC = 0.62–1.00) for all items on the PANES-N, and residents of neighborhoods in the inner city reported higher residential density, land use mix and safety, but lower pedestrian facilities and aesthetics than did residents of government reserved area/new layout neighborhoods.Conclusion:The PANES-N appears promising for assessing environmental perceptions related to physical activity in Nigeria, but further testing is required to assess its applicability across Africa.

scholarly journals Validation of the Stanford Brief Activity Survey: Examining Psychological Factors and Physical Activity Levels in Older Adults

2010 ◽  
Vol 7 (1) ◽  
pp. 87-94 ◽  
Author(s):  
Ruth E. Taylor-Piliae ◽  
Joan M. Fair ◽  
William L. Haskell ◽  
Ann N. Varady ◽  
Carlos Iribarren ◽  
...  
Keyword(s):  
Physical Activity ◽  
Older Adults ◽  
Construct Validity ◽  
Psychological Health ◽  
Well Being ◽  
Education Level ◽  
Validity And Reliability ◽  
Retest Reliability ◽  
Test Retest Reliability ◽  
Activity Survey

Background:This study examined the construct validity and reliability of the new 2-item Stanford Brief Activity Survey (SBAS).Methods:Secondary analysis was conducted using data collected from the healthy older controls (n = 1023) enrolled in the Atherosclerotic Disease Vascular Function and Genetic Epidemiology (ADVANCE) study. Construct validity was examined by regression analyses to evaluate significant trends (P ≤ .05) across the SBAS activity categories for the selected psychological health factors measured at baseline and year 2, adjusted for gender, ethnicity and education level. Test-retest reliability was performed using Spearman’s rank correlation.Results:At baseline, subjects were 66 ± 2.8 years old, 38% female, 77% married, 61% retired, 24% college graduate, and 68% Caucasian. At baseline, lower self-reported stress, anxiety, depression, and cynical distrust, and higher self-reported mental and physical well-being were significantly associated with higher levels of physical activity (p trend ≤ 0.01). These associations held at year 2. The test-retest reliability of the SBAS was statistically significant (rs= 0.62, P < .001).Conclusion:These results provide evidence of the construct validity and reliability of the SBAS in older adults. We also found a strong dose-response relationship between regular physical activity and psychological health in older adults, independent of gender, education level and ethnicity.

scholarly journals Patient-reported quality indicators to evaluate physiotherapy care for hip and/or knee osteoarthritis- development and evaluation of the QUIPA tool.

2019 ◽  
Author(s):  
Pek Ling Teo ◽  
Rana S Hinman ◽  
Thorlene Egerton ◽  
Krysia S Dziedzic ◽  
Jess Kasza ◽  
...  
Keyword(s):  
Construct Validity ◽  
Knee Osteoarthritis ◽  
Focus Groups ◽  
Quality Indicator ◽  
Clinical Guideline ◽  
Criterion Validity ◽  
Retest Reliability ◽  
Knee Oa ◽  
Patient Reported ◽  
Test Retest Reliability

Abstract Background: There is no physiotherapy-specific quality indicator tool available to evaluate physiotherapy care for people with hip and/or knee osteoarthritis (OA). This study aimed to develop a patient-reported quality indicator tool (QUIPA) for physiotherapy management of hip and knee OA and to assess its reliability and validity. Methods: To develop the QUIPA tool, quality indicators were initially developed based on clinical guideline recommendations most relevant to physiotherapy practice and those of an existing generic OA quality indicator tool. Draft items were then further refined using patient focus groups. Test-retest reliability, construct validity (hypothesis testing) and criterion validity were then evaluated. Sixty-five people with hip and/or knee OA attended a single physiotherapy consultation and completed the QUIPA tool one, twelve- and thirteen-weeks after. Physiotherapists (n=9) completed the tool post-consultation. Patient test-retest reliability was assessed between weeks twelve and thirteen. Construct validity was assessed with three predefined hypotheses and criterion validity was based on agreement between physiotherapists and participants at week one. Results: A draft list of 23 clinical guideline recommendations most relevant to physiotherapy was developed. Following feedback from three patient focus groups, the final QUIPA tool contained 18 items (three subscales) expressed in lay language. The test-retest reliability estimates (Cohen’s Kappa) for single items ranged from 0.30-0.83 with observed agreement of 64-94%. The intraclass correlation coefficient (ICC) and 95% confidence interval (CI) for the Assessment and Management Planning subscale was 0.70 (0.54, 0.81), Core Recommended Treatments subscale was 0.84 (0.75, 0.90), Adjunctive Treatments subscale was 0.70 (0.39, 0.87) and for the total QUIPA score was 0.80 (0.69, 0.88). All predefined hypotheses regarding construct validity were confirmed. However, agreement between physiotherapists and participants for single items showed large measurement error (Cohen’s Kappa estimates ranged from -0.04-0.59) with the ICC (95% CI) for the total score being 0.11 (-0.14, 0.34). Conclusions: The QUIPA tool showed acceptable test-retest reliability for subscales and total score but inadequate reliability for individual items. Construct validity was confirmed but criterion validity for individual items, subscales and the total score was inadequate. Further research is needed to refine the QUIPA tool to improve its clinimetric properties before implementation.

scholarly journals Comparing the visual analogue scale (VAS) and the numerical rating scale (NRS) in patient reported outcomes in psoriatic arthritis

2020 ◽  
pp. jrheum.200928
Author(s):  
Weiyu Ye ◽  
Simon Hackett ◽  
Claire Vandevelde ◽  
Sarah Twigg ◽  
Philip S. Helliwell ◽  
...  
Keyword(s):  
Disease Activity ◽  
Patient Reported Outcomes ◽  
Rating Scale ◽  
Numerical Rating Scale ◽  
Correlation Coefficients ◽  
Patient Reported ◽  
Life Impact ◽  
Numerical Rating ◽  
Global Disease Activity ◽  
Test Retest Reliability

Objective Patient self-report scales are invaluable in psoriatic arthritis (PsA), as they allow physicians to rapidly assess patient perspectives of disease activity. We aimed to assess the agreement of the visual analogue scale (VAS), a 100 mm horizontal line, and the numerical rating scale (NRS), a 21-point scale ranging from 0 to 10 in increments of 0.5, in patients with PsA. Methods Data were collected prospectively across three UK hospital trusts from 2018-2019. All patients completed the VAS and NRS for pain, arthritis, skin psoriasis, and global disease activity. A subset completed an identical pack one week later. Demographic and clinical data were also collected. Agreement was assessed using medians and the Bland-Altman method. Intraclass correlation coefficients (ICC) were used to assess test-retest reliability. Spearman’s rank correlation coefficients were used to assess dependency between scale scores and clinical parameters. Results 210 patients completed the study; one withdrew consent, thus 209 were analysed. For pain, arthritis, skin psoriasis and global disease activity, the difference between the VAS and NRS mostly lay within 1.96 SD of the mean, suggesting reasonable agreement between the two scales. 64.1% patients preferred the NRS. The ICCs demonstrate excellent test-retest reliability for both VAS and NRS. Higher VAS and NRS scores were associated with increased tender/swollen joint count, poorer functional status and greater life impact. Conclusion The VAS and NRS show reasonable agreement in key patient reported outcomes in PsA. Results from both scales are correlated with disease severity and life impact.

scholarly journals A Short Version of the Physical Activity Enjoyment Scale: Development and Psychometric Properties

2021 ◽  
Vol 18 (21) ◽  
pp. 11035
Author(s):  
Cheng Chen ◽  
Susanne Weyland ◽  
Julian Fritsch ◽  
Alexander Woll ◽  
Claudia Niessner ◽  
...  
Keyword(s):  
Physical Activity ◽  
Factor Analysis ◽  
Construct Validity ◽  
Psychometric Properties ◽  
Internal Consistency ◽  
Concurrent Validity ◽  
Retest Reliability ◽  
Confirmatory Factor ◽  
Test Retest Reliability ◽  
Activity Enjoyment

Objective: The purposes of this paper were to (a) develop a new short, theory-driven, version of the physical activity enjoyment scale (PACES-S) using content analysis; and (b) subsequently to measure the psychometric properties (construct validity, internal consistency, test–retest reliability, and concurrent validity) of the PACES-S for adolescents. Methods: Six experts used a four-point Likert scale to assess the content validity of each of the 16 items of the physical activity enjoyment scale according to a provided definition of physical activity enjoyment. Based on the results, exploratory factor analysis was used to analyze survey data from a longitudinal study of 182 individuals (Measure 1 of Study 1: 15.75 ± 3.39 yrs; 56.6% boys, 43.4% girls), and confirmatory factor analysis (Measure 2 of Study 1: 15.69 ± 3.44 yrs; 56.3% boys, 43.7% girls) was used to analyze the survey data from a cross-sectional study of 3219 individuals (Study 2; 15.99 ± 3.10 yrs; 47.8% boys, 52.2% girls) to assess the construct validity of the new measure. To assess the reliability, test–retest reliability was assessed in Study 1 and internal consistency in Study 1 and 2. For the concurrent validity, correlations with self-reported and device-based physical activity behavior were assessed in both studies. Results: Four out of sixteen items were selected for PACES-S. Exploratory factor analysis and confirmatory factor analyses identified and supported its factorial validity (χ2 = 53.62, df = 2, p < 0.001; RMSEA = 0.073; CFI = 0.99; RFI = 0.96; NFI = 0.99; TLI = 0.96; IFI = 0.99). Results showed good test–retest reliability (r = 0.76) and internal consistency (a = 0.82 to 0.88). Regarding concurrent validity, the results showed positive correlations with a physical activity questionnaire (Study 1: r = 0.36), with a physical activity diary (Study 1: r = 0.44), and with accelerometer-recorded data (Study 1: r = 0.32; Study 2: r = 0.21). Conclusions: The results indicate that PACES-S is a reliable and valid instrument that may be particularly useful to measure physical activity enjoyment in large-scale studies. It shows comparable measurement properties as the long version of PACES.

Consumer-based activity trackers in evaluation of physical activity in myositis patients

Rheumatology ◽  
2021 ◽  
Author(s):  
Didem Saygin ◽  
Bonny Rockette-Wagner ◽  
Chester Oddis ◽  
Nicole Neiman ◽  
Diane Koontz ◽  
...  
Keyword(s):  
Physical Activity ◽  
Disease Activity ◽  
Manual Muscle Testing ◽  
Functional Tests ◽  
Daily Step ◽  
Timed Up And Go ◽  
Step Counts ◽  
Muscle Testing ◽  
Sf 36 ◽  
Global Disease Activity

Abstract Objectives Inflammatory myopathies are characterized by muscle weakness that limits the activities of daily living. Daily step count is an accepted metric of physical activity. Wearable technologies such as Fitbit® enable tracking of daily step counts. We assessed the psychometric properties of Fitbit® and compared the accuracy of Fitbit® step counts to ActiGraph®. Methods This was a pilot, proof of concept, prospective observational study with four visits at 0, 1, 3 and 6 months in PM, DM, necrotizing myopathy (NM) or anti-synthetase syndrome (AS) subjects. Six core set measures (manual muscle testing, physician global disease activity, patient global disease activity, and extra-muscular disease activity, HAQ-Disability Index and creatine kinase), three functional tests (six-min walk, timed up-and-go, sit-to-stand tests) and SF-36 physical function-10 (PF10) were collected at each visit. Patients wore waist-worn Fitbit® One and ActiGraph® T3X-BT concurrently for 7 days/month for 6 months. Results Twenty-four (10 DM, 8 PM/NM, 6 AS) patients (17 females/7 males; 91% Caucasian) were enrolled. Test-retest reliability of daily steps was strong in 1-month follow-up (ICC 0.89). Daily steps and peak 1-min cadence showed moderate-strong correlations with physician global disease activity, patient global disease activity, HAQ-Disability Index, SF-36 PF10 and all three functional tests. Fitbit® and ActiGraph® step counts demonstrated good agreement and strong correlation (ICC 0.96). Conclusion Fitbit® daily steps and peak 1-min cadence are reliable and valid measures of physical activity in a cohort of myositis patients. This pilot data suggests that Fitbit® has a potential for use in clinical practice and trials to monitor physical activity in myositis patients, but larger studies are needed for further validation.

Development and validation of a patient-reported outcome instrument for skin involvement in patients with systemic sclerosis

2017 ◽  
Vol 76 (8) ◽  
pp. 1374-1380 ◽  
Author(s):  
Ada Man ◽  
Jeannette K Correa ◽  
Jessica Ziemek ◽  
Robert W Simms ◽  
David T Felson ◽  
...  
Keyword(s):  
Systemic Sclerosis ◽  
Construct Validity ◽  
Internal Consistency ◽  
Goodness Of Fit ◽  
Patient Reported Outcome ◽  
Skin Involvement ◽  
Retest Reliability ◽  
Outcome Instrument ◽  
Patient Reported ◽  
Test Retest Reliability

ObjectivesWe developed a patient-reported outcome (PRO) instrument to assess the skin-related quality of life in patients with systemic sclerosis (SSc).MethodsParticipants with SSc provided input on skin-related health effects through focus groups. We developed items for scleroderma skin PRO (SSPRO) to encompass these effects. Further consideration from cognitive interviews and an expert panel led to reduction and modification of items. A 22-item SSPRO was field tested. Psychometric analysis included test–retest reliability, internal consistency and exploratory factor analysis (EFA). Construct validity was assessed through correlation with other participant and physician-assessed measures.Results140 participants completed the SSPRO: mean age was 53.4 years, median disease duration was 5 years, 82.1% were female and 32.9% had diffuse cutaneous SSc. EFA supported four factors in SSPRO corresponding to hypothesised constructs: physical effects, physical limitations, emotional effects and social effects. Removal of 4/22 items resulted in acceptable goodness-of-fit statistics. Test–retest reliability (intraclass correlation coefficient=0.61–0.83) was moderate to high and internal consistency (Cronbach's α=0.89–0.96) was high. SSPRO correlated strongly with other participant-reported measures (r=0.59–0.88) suggesting construct validity, and less well with physician-assessed measures (r=0.31–0.40). SSPRO scores were significantly different for each level of participant-reported skin severity, and for limited versus diffuse cutaneous SSc.ConclusionsSSPRO has been developed with extensive patient input and demonstrates evidence for reliability and validity. It is complementary to existing measures of SSc skin involvement with emphasis on the patient's experience. Further research is needed to assess its sensitivity to change.

Sign in / Sign up

Export Citation Format

Share Document