scholarly journals A Revised Motor Activity Log Following Rasch Validation (Rasch-Based MAL-18) and Consensus Methods in Chronic Stroke and Multiple Sclerosis

2019 ◽  
Vol 33 (10) ◽  
pp. 787-791
Author(s):  
Ann Van de Winckel ◽  
Lynne Gauthier
Keyword(s):  
Multiple Sclerosis ◽  
Construct Validity ◽  
Motor Activity ◽  
Upper Extremity ◽  
Community Dwelling ◽  
Consensus Methods ◽  
Retest Reliability ◽  
Local Dependency ◽  
Tests Of Fit ◽  
Test Retest Reliability

Objectives. To derive a shorter version of the Motor Activity Log Quality-of-Movement Scale (MAL-28) with enhanced content and construct validity. Design. Validation cohort. Setting. Outpatient rehabilitation within an academic laboratory. Participants. Retrospective consecutive sample of 149 community-dwelling adults with chronic mild/moderate upper-extremity hemiparesis caused by stroke or multiple sclerosis (MS). Intervention. Not applicable. Methods. Participants received the MAL-28 at baseline and following upper-extremity rehabilitation. Rasch Measurement Theory informed threshold ordering of scoring categories, tests of fit, differential item functioning, targeting, response dependency, local dependency, and reliability (person separation index [PSI]). Seasoned examiners rated the content validity of each item. Test-retest reliability of the revised scale was calculated. Results. We established content and construct validity for 18 items. The resultant 18-item MAL fit the model (χ2 = 77.93; df = 72; P = .30) and targeted the population—that is, minimal floor (12.08%) or ceiling effects (0%), with acceptable reliability (PSI = 0.84) and good test-retest reliability [ICC(1, 1) = 0.86]. The hierarchy of item difficulty was independent of sex, age, affected side, diagnosis, or intervention type used, and there was local dependency in 3 pairs of items. Responses from a subsequent testing session were dependent on the responses from prior testing, indicating response dependency, for which a correction was proposed. Once response dependency was neutralized, there was a 15% greater treatment response. Conclusions. Content and construct validity are established for Rasch-based MAL-18 for chronic stages of stroke and MS. A Rasch-based conversion table enables clinical use of the MAL-18.

scholarly journals Symbol Digit Modalities Test Variant in a Smartphone App for Persons With Multiple Sclerosis: Validation Study (Preprint)

2020 ◽  
Author(s):  
Pim van Oirschot ◽  
Marco Heerings ◽  
Karine Wendrich ◽  
Bram den Teuling ◽  
Marijn B Martens ◽  
...  
Keyword(s):  
Multiple Sclerosis ◽  
Construct Validity ◽  
Validation Study ◽  
Intraclass Correlation ◽  
Study Participant ◽  
Smartphone App ◽  
Retest Reliability ◽  
Matched Group ◽  
Test Retest Reliability ◽  
Study Participants

BACKGROUND The decline of cognitive processing speed (CPS) is a common dysfunction in persons with multiple sclerosis (MS). The Symbol Digit Modalities Test (SDMT) is widely used to formally quantify CPS. We implemented a variant of the SDMT in MS sherpa, a smartphone app for persons with MS. OBJECTIVE The aim of this study was to investigate the construct validity and test-retest reliability of the MS sherpa smartphone variant of the SDMT (sSDMT). METHODS We performed a validation study with 25 persons with relapsing-remitting MS and 79 healthy control (HC) subjects. In the HC group, 21 subjects were matched to the persons with MS with regard to age, gender, and education and they followed the same assessment schedule as the persons with MS (the “HC matched” group) and 58 subjects had a less intense assessment schedule to determine reference values (the “HC normative” group). Intraclass correlation coefficients (ICCs) were determined between the paper-and-pencil SDMT and its smartphone variant (sSDMT) on 2 occasions, 4 weeks apart. Other ICCs were determined for test-retest reliability, which were derived from 10 smartphone tests per study participant, with 3 days in between each test. Seven study participants with MS were interviewed regarding their experiences with the sSDMT. RESULTS The SDMT scores were on average 12.06% higher than the sSDMT scores, with a standard deviation of 10.68%. An ICC of 0.838 was found for the construct validity of the sSDMT in the combined analysis of persons with MS and HC subjects. Average ICCs for test-retest reliability of the sSDMT for persons with MS, the HC matched group, and the HC normative group were 0.874, 0.857, and 0.867, respectively. The practice effect was significant between the first and the second test of the persons with MS and the HC matched group and trivial for all other test-retests. The interviewed study participants expressed a positive attitude toward the sSDMT, but they also discussed the importance of adapting a smartphone cognition test in accordance with the needs of the individual persons with MS. CONCLUSIONS The high correlation between sSDMT and the conventional SDMT scores indicates a very good construct validity. Similarly, high correlations underpin a very good test-retest reliability of the sSDMT. We conclude that the sSDMT has the potential to be used as a tool to monitor CPS in persons with MS, both in clinical studies and in clinical practice.

scholarly journals Nutrition Literacy and Healthy Diet: Findings from the Validation of a Short Seniors-Oriented Screening Tool, the Spanish Myths-NL

2021 ◽  
Vol 18 (22) ◽  
pp. 12107
Author(s):  
Elena Lobo ◽  
María Tamayo ◽  
Teresa Sanclemente
Keyword(s):  
Construct Validity ◽  
Convergent Validity ◽  
Screening Tool ◽  
Cross Sectional Study ◽  
Community Dwelling ◽  
Healthy Diet ◽  
Face Validity ◽  
Cross Sectional ◽  
Retest Reliability ◽  
Test Retest Reliability

A good level of nutrition literacy (NL) is proposed as a determinant factor for following a healthy diet. Improving seniors’ NL might be particularly pertinent to enhance the quality of their diets. This study aimed to systematically design and validate a short seniors-oriented questionnaire as a screening tool to evaluate NL. We developed the Myths-NL questionnaire, composed of 10 widespread nutrition myths, and checked for its content and face validity. An observational cross-sectional study was conducted to explore the validity and the test–retest reliability, involving a community-dwelling group of 316 individuals aged 65 years and over. Construct validity was proved by establishing both discriminant and convergent validity. Cronbach α = 0.61 and Spearman r = 0.79 (p = 0.02) demonstrated internal consistency and test–retest reliability. Participants who had secondary/university studies scored significantly higher compared with those with primary (p < 0.001), and a significant linear relationship (R2 = 0.044, p = 0.001) with a positive slope (β = 0.209) between Mediterranean Diet Adherence Screener (MEDAS) and Myths-NL scores was observed, proving construct validity. In conclusion, the Myths-NL questionnaire is a valid and reliable tool to screen NL in Spanish seniors and it might be useful as an assessment NL tool for designing and implementing lifestyle interventions to promote healthy eating.

scholarly journals Test-retest reliability, internal consistency, construct validity and factor structure of a falls risk perception questionnaire in older adults with type 2 diabetes mellitus: a prospective cohort study

2019 ◽  
Vol 9 (1) ◽  
Author(s):  
Janelle Gravesande ◽  
Julie Richardson ◽  
Lauren Griffith ◽  
Fran Scott
Keyword(s):  
Type 2 Diabetes ◽  
Older Adults ◽  
Construct Validity ◽  
Internal Consistency ◽  
Perceived Risk ◽  
Community Dwelling ◽  
Risk Of Falling ◽  
Retest Reliability ◽  
Test Retest Reliability

Abstract Background Older adults with type 2 diabetes (DM2) are at increased risk of falling due to complications including: diabetic peripheral neuropathy, diabetic retinopathy, autonomic neuropathy and diabetic foot ulcers. The purpose of this study was to determine the test-retest reliability, internal consistency, construct validity and to perform factor analysis of a new falls Risk Perception Questionnaire (RPQ) in older community-dwelling adults with DM2. Methods A prospective cohort of 30 community-dwelling older adults, ≥ 55 years, with DM2 was assembled. At baseline, perceived risk of falling, fear of falling and physical activity were measured. At time 2 (T2), at least 2 days later, perceived risk of falling was assessed again to determine the test-retest reliability of the RPQ. At time 3 (T3), approximately six weeks later, and time 4 (T4), at least 2 days after T3, perceived risk of falling was assessed by phone to determine the test-retest reliability of the RPQ when administered by phone. Results The RPQ demonstrated excellent test-retest reliability when delivered in person (ICC = 0.78, 95% Confidence Interval, CI: 0.59–0.89) and by phone (ICC = 0.82, 95% CI: 0.65–0.91), good internal consistency (α = 0.78) and adequate construct validity (r = 0.52, 95% CI: 0.20–0.74, p = 0.003) in older adults with DM2. Conclusion Given the good psychometric properties in this sample of persons with Diabetes, the RPQ has the potential to be used in clinical practice as a risk assessment and fall prevention tool. However, further testing needs to be done using a larger sample.

scholarly journals Symbol Digit Modalities Test Variant in a Smartphone App for Persons With Multiple Sclerosis: Validation Study

10.2196/18160 ◽  
2020 ◽  
Vol 8 (10) ◽  
pp. e18160
Author(s):  
Pim van Oirschot ◽  
Marco Heerings ◽  
Karine Wendrich ◽  
Bram den Teuling ◽  
Marijn B Martens ◽  
...  
Keyword(s):  
Multiple Sclerosis ◽  
Construct Validity ◽  
Validation Study ◽  
Intraclass Correlation ◽  
Study Participant ◽  
Smartphone App ◽  
Retest Reliability ◽  
Matched Group ◽  
Test Retest Reliability ◽  
Study Participants

Background The decline of cognitive processing speed (CPS) is a common dysfunction in persons with multiple sclerosis (MS). The Symbol Digit Modalities Test (SDMT) is widely used to formally quantify CPS. We implemented a variant of the SDMT in MS sherpa, a smartphone app for persons with MS. Objective The aim of this study was to investigate the construct validity and test-retest reliability of the MS sherpa smartphone variant of the SDMT (sSDMT). Methods We performed a validation study with 25 persons with relapsing-remitting MS and 79 healthy control (HC) subjects. In the HC group, 21 subjects were matched to the persons with MS with regard to age, gender, and education and they followed the same assessment schedule as the persons with MS (the “HC matched” group) and 58 subjects had a less intense assessment schedule to determine reference values (the “HC normative” group). Intraclass correlation coefficients (ICCs) were determined between the paper-and-pencil SDMT and its smartphone variant (sSDMT) on 2 occasions, 4 weeks apart. Other ICCs were determined for test-retest reliability, which were derived from 10 smartphone tests per study participant, with 3 days in between each test. Seven study participants with MS were interviewed regarding their experiences with the sSDMT. Results The SDMT scores were on average 12.06% higher than the sSDMT scores, with a standard deviation of 10.68%. An ICC of 0.838 was found for the construct validity of the sSDMT in the combined analysis of persons with MS and HC subjects. Average ICCs for test-retest reliability of the sSDMT for persons with MS, the HC matched group, and the HC normative group were 0.874, 0.857, and 0.867, respectively. The practice effect was significant between the first and the second test of the persons with MS and the HC matched group and trivial for all other test-retests. The interviewed study participants expressed a positive attitude toward the sSDMT, but they also discussed the importance of adapting a smartphone cognition test in accordance with the needs of the individual persons with MS. Conclusions The high correlation between sSDMT and the conventional SDMT scores indicates a very good construct validity. Similarly, high correlations underpin a very good test-retest reliability of the sSDMT. We conclude that the sSDMT has the potential to be used as a tool to monitor CPS in persons with MS, both in clinical studies and in clinical practice.

Validation of the Brief International Cognitive Assessment for Multiple Sclerosis (BICAMS) in the Russian Population

2021 ◽  
pp. 1-8
Author(s):  
Evgeniy Evdoshenko ◽  
Kristina Laskova ◽  
Maria Shumilina ◽  
Ekaterina Nekrashevich ◽  
Maria Andreeva ◽  
...  
Keyword(s):  
Multiple Sclerosis ◽  
Cognitive Assessment ◽  
Verbal Learning ◽  
Cognitive Status ◽  
Russian Population ◽  
Cognitive Domain ◽  
Control Group ◽  
Retest Reliability ◽  
Valid Instrument ◽  
Test Retest Reliability

Abstract Objective: Cognitive dysfunction is common in multiple sclerosis (MS). The Brief International Cognitive Assessment for MS (BICAMS) battery of tests has been suggested as a measure for the evaluation of the cognitive status of MS patients. This study aims to validate the BICAMS battery in the Russian population of MS patients. Methods: Age- and sex-matched MS patients (n = 98) and healthy individuals (n = 86) were included in the study. Symbol Digit Modalities Test (SDMT), California Verbal Learning Test, 2nd edition (CVLT-II) and the Brief Visuospatial Memory Test – Revised (BVMT-R) were administered to all participants. The battery was readministered 1 month later to 44 MS patients to investigate the test–retest reliability. Results: MS patients exhibited a significantly lower performance in testing with BICAMS than the control group in all three neuropsychological tests. Test–retest reliability was good for SDMT and CVLT-II (r = .82 and r = .85, respectively) and adequate for BVMT-R (r = .70). Based on the proposed criterion for impairment as z score below 1.5 SD the mean of the control group, we found that 34/98 (35%) of MS patients were found impaired at least in one cognitive domain. Patients with Expanded Disability Status Scale score ≥3.5 performed significantly worse than controls (SDMT, p < .0001; CVLT–II, p = .03; BVMT-R, p = .0004), while those with ≤3.0 scores did not. Conclusion: This study demonstrates that the BICAMS battery is a valid instrument to identify cognitive impairment in MS patients and it can be recommended for routine use in the Russian Federation.

Reliability, Validity and Responsiveness of Physical Activity Monitors in Patients with Inflammatory Myopathy

Rheumatology ◽  
2021 ◽  
Author(s):  
Bonny Rockette-Wagner ◽  
Didem Saygin ◽  
Siamak Moghadam-Kia ◽  
Chester Oddis ◽  
Océane Landon-Cardinal ◽  
...  
Keyword(s):  
Physical Activity ◽  
Construct Validity ◽  
Disease Activity ◽  
Retest Reliability ◽  
Activity Monitors ◽  
Muscle Testing ◽  
Patient Reported ◽  
Physical Activity Monitors ◽  
Global Disease Activity ◽  
Test Retest Reliability

Abstract Objective Idiopathic inflammatory myopathies (IIM) cause proximal muscle weakness, which affect activities of daily living. Wearable physical activity monitors (PAMs) objectively assess continuous activity with potential clinical usefulness in IIM assessment. We examined the psychometric characteristics for PAM outcomes in IIM. Methods Adult IIM patients were prospectively evaluated (baseline, 3 and 6-months) in an observational study. A waist-worn PAM (ActiGraph GT3X-BT) assessed average step counts/min, peak 1-min cadence, and vector magnitude/min. Validated myositis core set measures (CSM) including manual muscle testing (MMT), physician global disease activity (MD global), patient global disease activity (Pt global), extra-muscular disease activity (Ex-muscular global), HAQ-DI, muscle enzymes, and patient-reported physical function were evaluated. Test-retest reliability, construct validity, and responsiveness were determined for PAM measures and CSM using Pearson correlations and other appropriate analyses. Results 50 adult IIM patients enrolled [mean (SD) age, 53.6 (±14.6); 60% female, 94% Caucasian]. PAM measures showed strong test-retest reliability, moderate-to-strong correlations at baseline with MD global (r=-0.37- -0.48), Pt-global (r=-0.43- -0.61), HAQ-DI (r=-0.47- -0.59) and MMT (r = 0.37–0.52), and strong discriminant validity for categorical MMT and HAQ-DI. Longitudinal association with MD global (r=-0.38- -0.44), MMT (r = 0.50–0.57), HAQ-DI (r=-0.45- -0.55), and functional tests (r = 0.30–0.65) were moderate-to-strong. PAM measures were responsive to MMT improvement (≥10%) and moderate-to-major improvement on ACR/EULAR myositis response criteria. Peak 1-min cadence had the largest effect size and Standardized Response Means (SRMs). Conclusion PAM measures showed promising construct validity, reliability, and longitudinal responsiveness; especially peak 1-min cadence. PAMs provide valid outcome measures for future use in IIM clinical trials.

scholarly journals Cross-cultural adaptation, reliability and validity of the Fremantle Knee Awareness Questionnaire in Italian subjects with painful knee osteoarthritis

2021 ◽  
Vol 19 (1) ◽  
Author(s):  
Marco Monticone ◽  
Cristiano Sconza ◽  
Igor Portoghese ◽  
Tomohiko Nishigami ◽  
Benedict M. Wand ◽  
...  
Keyword(s):  
Construct Validity ◽  
Knee Osteoarthritis ◽  
Pain Intensity ◽  
Internal Consistency ◽  
Structural Validity ◽  
Retest Reliability ◽  
Knee Oa ◽  
Pain Catastrophising ◽  
Test Retest Reliability ◽  
Painful Knee

Abstract Background and aim Growing attention is being given to utilising physical function measures to better understand and manage knee osteoarthritis (OA). The Fremantle Knee Awareness Questionnaire (FreKAQ), a self-reported measure of body-perception specific to the knee, has never been validated in Italian patients. The aims of this study were to culturally adapt and validate the Italian version of the FreKAQ (FreKAQ-I), to allow for its use with Italian-speaking patients with painful knee OA. Methods The FreKAQ-I was developed by means of forward–backward translation, a final review by an expert committee and a test of the pre-final version to evaluate its comprehensibility. The psychometric testing included: internal structural validity by Rasch analysis; construct validity by assessing hypotheses of FreKAQ correlations with the knee injury and osteoarthritis outcome score (KOOS), a pain intensity numerical rating scale (PI-NRS), the pain catastrophising scale (PCS), and the Hospital anxiety and depression score (HADS) (Pearson’s correlations); known-group validity by evaluating the ability of FreKAQ scores to discriminate between two groups of participants with different clinical profiles (Mann–Whitney U test); reliability by internal consistency (Cronbach’s alpha) and test–retest reliability (intraclass correlation coefficient, ICC2.1); and measurement error by calculating the minimum detectable change (MDC). Results It took one month to develop a consensus-based version of the FreKAQ-I. The questionnaire was administered to 102 subjects with painful knee OA and was well accepted. Internal structural validity confirmed the substantial unidimensionality of the FreKAQ-I: variance explained was 53.3%, the unexplained variance in the first contrast showed an eigenvalue of 1.8, and no local dependence was detected. Construct validity was good as all of the hypotheses were met; correlations: KOOS (rho = 0.38–0.51), PI-NRS (rho = 0.35–0.37), PCS (rho = 0.47) and HADS (Anxiety rho = 0.36; Depression rho = 0.43). Regarding known-groups validity, FreKAQ scores were significantly different between groups of participants demonstrating high and low levels of pain intensity, pain catastrophising, anxiety, depression and the four KOOS subscales (p ≤ 0.004). Internal consistency was acceptable (α = 0.74) and test–retest reliability was excellent (ICC = 0.92, CI 0.87–0.94). The MDC95 was 5.22 scale points. Conclusion The FreKAQ-I is unidimensional, reliable and valid in Italian patients with painful knee OA. Its use is recommended for clinical and research purposes.

scholarly journals The Brief International Cognitive Assessment in Multiple Sclerosis (BICAMS): Validation in Arabic and Lebanese Normative Values

2021 ◽  
pp. 1-10
Author(s):  
Hala Darwish ◽  
Pia Zeinoun ◽  
Natali Farran ◽  
Husam Ghusn ◽  
Bassem Yamout ◽  
...  
Keyword(s):  
Multiple Sclerosis ◽  
Psychometric Properties ◽  
Cognitive Assessment ◽  
Healthy Subjects ◽  
Good Evidence ◽  
Normative Values ◽  
Arabic Version ◽  
Retest Reliability ◽  
Test Retest Reliability ◽  
Healthy Participants

Abstract Objective: Multiple sclerosis (MS) is often associated with cognitive deficits. Accurate evaluation of the MS patients’ cognitive performance is essential for diagnosis and treatment recommendation. The Brief International Cognitive Assessment in Multiple Sclerosis (BICAMS), widely used cognitive testing battery, examines processing speed, verbal and visuospatial learning, and memory. Our study aims to examine the psychometric properties of an Arabic version of the BICAMS and to provide normative values in a Lebanese sample. Method: The BICAMS, comprised of the Symbol Digit Modalities Test (SDMT), Brief Visuospatial Memory Test-Revised (BVMT-R), and a newly developed verbal learning/memory test, the Verbal Memory Arabic Test (VMAT), were administered on healthy subjects and MS patients. The sample consisted of 180 healthy individuals, of whom 63 were retested after 2–3 weeks. Forty-three MS patients matched with 43 healthy subjects based on age, sex, and years of education were assessed. A sample of 10 MS patients was also examined on two occasions. Test–retest reliability and criterion-related validity were examined, and regression-based norms were derived. Results: The test–retest correlations showed good evidence of reliability with coefficients ranging between 0.64 and 0.73 in the healthy sample, and between 0.43 and 0.92 in the MS sample. The BICAMS was able to discriminate between MS patients and matched healthy participants on the SDMT and BVMT-R. Normative data were comparable to other studies. Conclusions: This new Arabic version of the BICAMS shows initial good psychometric properties. While good evidence of VMAT’s reliability was shown in the healthy participants, less test–retest reliability in this tool was seen in the MS group, and partial criterion-related validity was evident. This renders further examination of the VMAT. We provide regression-based norms for a Lebanese sample and encourage the use of this battery in both research and clinical settings.

Sign in / Sign up

Export Citation Format

Share Document