Test-Retest Reliability and Convergent Validity of the Fatigue Impact Scale for Persons With Multiple Sclerosis

The North American Research Committee on Multiple Sclerosis (NARCOMS) Registry is a multiple sclerosis (MS) self-report registry with more than 24 000 participants. Participants report disability status upon enrolment, and semi-annually using Performance Scales (PS), Patient Determined Disease Steps (PDDS) and a pain question. In November 2000 and 2001, we also collected the Pain Effects Scale (PES). Our aim was to validate the NARCOMS pain question using the PES as our criterion measure. We measured correlations between the pain question and age, disease duration, various PS subscales and PDDS to assess construct validity. We correlated pain question responses in participants who reported no change in PDSS or the PS subscales between questionnaires to determine test—retest reliability. We measured responsiveness in participants who reported a substantial change in the sensory, spasticity PS subscales. The correlation between the pain question and PES was r=0.61 in November 2000, and r=0.64 in November 2001 (both P<0.0001). Correlations between the pain question and age, and disease duration were low, indicating divergent validity. Correlations between the pain question and spasticity, sensory PS subscales and PDSS were moderate, indicating convergent validity. Test—retest reliability was r=0.84 (P<0.0001). Responsiveness was 70.7%. The pain question is a valid self-report measure of pain in MS.

Download Full-text

A self-administered, artificial intelligence (AI) platform for cognitive assessment in multiple sclerosis (MS)

10.21203/rs.2.10768/v5 ◽

2020 ◽

Cited By ~ 1

Author(s):

Seyed-Mahdi Khaligh-Razavi ◽

Maryam Sadeghi ◽

Mahdiyeh Khanbagi ◽

Chris Kalafatis ◽

Seyed Massood Nabavi

Keyword(s):

Multiple Sclerosis ◽

Cognitive Impairment ◽

Cognitive Dysfunction ◽

Cognitive Assessment ◽

Cognitive Rehabilitation ◽

Convergent Validity ◽

Strong Association ◽

Therapeutic Interventions ◽

Retest Reliability ◽

Test Retest Reliability

Abstract Background Cognitive impairment is common in patients with multiple sclerosis (MS). Accurate and repeatable measures of cognition have the potential to be used as markers of disease activity. Methods We developed a 5-minute computerized test to measure cognitive dysfunction in patients with MS. The proposed test – named the Integrated Cognitive Assessment (ICA) – is self-administered and language-independent. 91 MS patients and 83 healthy controls (HC) took part in Substudy 1, in which each participant took the ICA test and the Brief International Cognitive Assessment for MS (BICAMS). We assessed ICA’s test-retest reliability, its correlation with BICAMS, its sensitivity to discriminate patients with MS from the HC group, and its accuracy in detecting cognitive dysfunction. In Substudy 2, we recruited 48 MS patients, 38 of which had received an 8-week physical and cognitive rehabilitation programme and 10 MS patients who did not. We examined the association between the level of serum neurofilament light (NfL) in these patients and their ICA scores and Symbol Digit Modalities Test (SDMT) scores pre- and post-rehabilitation. Results The ICA demonstrated excellent test-retest reliability (r=0.94), with no learning bias, and showed a high level of convergent validity with BICAMS. The ICA was sensitive in discriminating the MS patients from the HC group, and demonstrated high accuracy (AUC = 95%) in discriminating cognitively normal from cognitively impaired participants. Additionally, we found a strong association (r=-0.79) between ICA score and the level of NfL in MS patients before and after rehabilitation. Conclusions The ICA has the potential to be used as a digital marker of cognitive impairment and to monitor response to therapeutic interventions. In comparison to standard cognitive tools for MS, the ICA is shorter in duration, does not show a learning bias, and is independent of language.

Download Full-text

A self-administered, artificial intelligence (AI) platform for cognitive assessment in multiple sclerosis (MS)

10.21203/rs.2.10768/v4 ◽

2020 ◽

Author(s):

Seyed-Mahdi Khaligh-Razavi ◽

Maryam Sadeghi ◽

Mahdiyeh Khanbagi ◽

Chris Kalafatis ◽

Seyed Massood Nabavi

Keyword(s):

Multiple Sclerosis ◽

Cognitive Impairment ◽

Cognitive Dysfunction ◽

Cognitive Assessment ◽

Cognitive Rehabilitation ◽

Convergent Validity ◽

Strong Association ◽

Therapeutic Interventions ◽

Retest Reliability ◽

Test Retest Reliability

Abstract Background Cognitive impairment is common in patients with multiple sclerosis (MS). Accurate and repeatable measures of cognition have the potential to be used as markers of disease activity. Methods We developed a 5-minute computerized test to measure cognitive dysfunction in patients with MS. The proposed test – named the Integrated Cognitive Assessment (ICA) – is self-administered and language-independent. 91 MS patients and 83 healthy controls (HC) took part in Substudy 1, in which each participant took the ICA test and the Brief International Cognitive Assessment for MS (BICAMS). We assessed ICA’s test-retest reliability, its correlation with BICAMS, its sensitivity to discriminate patients with MS from the HC group, and its accuracy in detecting cognitive dysfunction. In Substudy 2, we recruited 48 MS patients, 38 of which had received an 8-week physical and cognitive rehabilitation programme and 10 MS patients who did not. We examined the association between the level of serum neurofilament light (NfL) in these patients and their ICA scores and Symbol Digit Modalities Test (SDMT) scores pre- and post-rehabilitation. Results The ICA demonstrated excellent test-retest reliability (r=0.94), with no learning bias, and showed a high level of convergent validity with BICAMS. The ICA was sensitive in discriminating the MS patients from the HC group, and demonstrated high accuracy (AUC = 95%) in discriminating cognitively normal from cognitively impaired participants. Additionally, we found a strong association (r=-0.79) between ICA score and the level of NfL in MS patients before and after rehabilitation. Conclusions The ICA has the potential to be used as a digital marker of cognitive impairment and to monitor response to therapeutic interventions. In comparison to standard cognitive tools for MS, the ICA is shorter in duration, does not show a learning bias, and is independent of language.

Download Full-text

FRI0583 VALIDATION OF THE MODIFIED FATIGUE IMPACT SCALE IN DANISH PATIENTS WITH SYSTEMIC LUPUS ERYTHEMATOSUS

Annals of the Rheumatic Diseases ◽

10.1136/annrheumdis-2020-eular.1293 ◽

2020 ◽

Vol 79 (Suppl 1) ◽

pp. 895.1-896

Author(s):

C. I. Junker ◽

K. Duch ◽

L. Dreyer ◽

J. W. Gregersen ◽

S. Kristensen

Keyword(s):

Construct Validity ◽

Correlation Coefficient ◽

Internal Consistency ◽

Lupus Erythematosus ◽

Short Form ◽

Retest Reliability ◽

Short Form 36 ◽

Impact Scale ◽

Fatigue Impact Scale ◽

Test Retest Reliability

Background:Patients with systemic lupus erythematosus (SLE) experience significant fatigue, a debilitating symptom associated with reduced quality of life. A simple, reliable multidimensional method for assessing fatigue has not yet been validated for Danish patients with SLE.Objectives:The primary objective was to study the internal consistency, test-retest reliability, and construct validity (convergent and discriminant validity) of the multidimensional Modified Fatigue Impact Scale (MFIS) in patients with SLE. The secondary objective was to investigate the contribution of disease activity and organ damage to fatigue.Methods:Data from the ”Bio and Genome Bank Study in Centre for SLE and Vasculitis” obtained through routine visits were used. Fatigue was assessed using the MFIS and Short Form 36 (SF36). Internal consistency of the MFIS was assessed with Cronbach’s alpha (α). Test-retest reliability was evaluated using the intraclass correlation coefficient (ICC). Construct validity was studied using Spearman’s rank correlation coefficient (rs) and Principal Component Analysis (PCA) between MFIS and SF36 vitality (VT-SF36) and mental health (MH-SF36) subscales. Association between MFIS and disease activity and organ damage was estimated with Spearman’s rank correlation coefficient.Results:The study included 30 patients with SLE. Internal consistency of the MFIS was excellent with Cronbach’s α = 0.97 for the complete scale. Excellent test-retest reliability was found with ICC = 0.95 (95% confidence interval: 0.88-0.98, p < 0.05). Construct validity was confirmed by Spearman’s correlation (VT-SF36: rs= −0.73, p < 0.001 (Fig. 1). MH-SF36: rs= −0.74, p < 0.001 (Fig. 2)) and PCA with explained variance from the first two principal components (PC) (VT-SF36: PC1 = 60.2%, PC2 = 8.5%. MH-SF36: PC1 = 58.5%, PC2 = 7.4%). No significant correlation was found between the MFIS and SLEDAI (rs= 0.04, p = 0.84) or SLICC Damage Index (rs= 0.32, p = 0.08).Figure 1.Scatter plot of the Modified Fatigue Impact Scale (MFIS) and the Short Form 36 vitality (VT-SF36) subscale.Figure 2.Scatter plot of the Modified Fatigue Impact Scale (MFIS) and the Short Form 36 mental health (MH-SF36) subscale.Conclusion:The present study found the multidimensional assessment of fatigue with MFIS to be a reliable and valid instrument in SLE. The MFIS might provide more detailed information about fatigue in future studies. In agreement with some previous studies we found no association between fatigue and SLEDAI or SLICC which raises questions about the cause of this symptom. Further and larger studies are needed to investigate if any association between fatigue and disease components exist.Disclosure of Interests:None declared

Download Full-text

Impact of fatigue in multiple sclerosis: the Fatigue Impact Scale for Daily Use (D-FIS)

Multiple Sclerosis Journal ◽

10.1177/1352458506073528 ◽

2007 ◽

Vol 13 (5) ◽

pp. 645-651 ◽

Cited By ~ 37

Author(s):

J. Benito-León ◽

P. Martínez-Martín ◽

B. Frades ◽

M.L. Martínez-Ginés ◽

C. de Andrés ◽

...

Keyword(s):

Multiple Sclerosis ◽

Convergent Validity ◽

Rating Scale ◽

Strong Association ◽

Metric Properties ◽

Impact Scale ◽

Related Quality ◽

Valid Instrument ◽

Fatigue Impact Scale ◽

Descriptive Scale

Objective The Fatigue Impact Scale for Daily Use (D-FIS) is an eight-item instrument designed to measure subjective daily experience of fatigue. This study sought to determine the metric properties of the D-FIS in multiple sclerosis (MS) patients. Methods Sixty-eight patients with operationally-defined MS and fatigue (54.8% of the sample) underwent the D-FIS. Usual clinical measures for MS, the Montgomery-Asberg Depression Rating Scale (MADRS) and the Functional Assessment of Multiple Sclerosis (FAMS) were also applied. In addition, patients with fatigue completed the Fatigue Descriptive Scale, the Multidimensional Fatigue Inventory (MFI), a Visual Analogue Scale for Fatigue (VAS-F), and a Global Perception of Fatigue Scale (GPF). Results Full computable data, 95.6%; both floor and ceiling effect=1.54%; item-total correlation =0.62 (item 1) to 0.84 (item 6); Cronbach's alpha =0.91; item homogeneity =0.55; standard error of measurement =3.18; convergent validity with other fatigue measures = -0.57 (VAS-F); 0.52 (GPF); and 0.46 (MFI-general fatigue). Test-retest reliability (ICC) =0.81. There was a strong association between health-related quality of life (HRQoL) (FAMS) and D-FIS (rS=0.70). Conclusions In this study, D-FIS proved to be a feasible and valid instrument for measuring MSrelated fatigue, a frequent symptom associated with deterioration of patients' HRQoL. Multiple Sclerosis 2007; 13: 645-651. http://msj.sagepub.com

Download Full-text

Translation and validation of the Persian version of Godin Leisure-Time Exercise Questionnaire in patients with multiple sclerosis

BMC Neurology ◽

10.1186/s12883-021-02465-5 ◽

2021 ◽

Vol 21 (1) ◽

Author(s):

Mohammad-Reza Fattahi ◽

Pardis Noormohammadpour ◽

Meysam Ramezani ◽

Mohammad Ali Sahraian ◽

Mohammad Ali Mansournia ◽

...

Keyword(s):

Physical Activity ◽

Multiple Sclerosis ◽

Content Validity ◽

Convergent Validity ◽

Retest Reliability ◽

Physical Activity Questionnaire ◽

Final Version ◽

Persian Version ◽

Test Retest Reliability ◽

Activity Questionnaire

Abstract Study Design Psychometric study. Objective The purpose of this study is to translate, culturally adapt and evaluate the validity and reliability of the Persian (Farsi) version of GLTEQ in patients with multiple sclerosis. Methods This study had three phases, including translation of the questionnaire into Persian and making cultural adaptation, evaluation of pre-final version of questionnaire’s comprehensibility in a pilot study, and investigation of reliability and validity of the final version of the translated questionnaire. Content validity, and convergent validity (correlations among the Persian version of GLTEQ and Global physical activity questionnaire (GPAQ), and international physical activity questionnaire (IPAQ)) and after all test-retest reliability were studied. Results The subjects were 87 MS patients. The Persian version demonstrated moderate to good convergent validity; the correlation coefficient between the Persian version and GPAQ was r=0.64 (p<0.001), and between the Persian version and IPAQ was r=0.59 (p<0.001). The test-retest reliability was strong (Intra-class Correlation (ICC) value ranged between 0.908 and 0.992). Besides, its face validity and content validity were acceptable. Conclusions The Persian version of GLTEQ is a valid and reliable instrument to assess physical activity in patients with MS. This questionnaire can be a step toward standardization of physical activity measurement in patients with MS. Also, in research, it provides the possibilities to carry on a comparative study across cultures using the same outcome measure.

Download Full-text

Validation of the Brief International Cognitive Assessment for Multiple Sclerosis (BICAMS) in the Russian Population

Journal of the International Neuropsychological Society ◽

10.1017/s1355617721000722 ◽

2021 ◽

pp. 1-8

Author(s):

Evgeniy Evdoshenko ◽

Kristina Laskova ◽

Maria Shumilina ◽

Ekaterina Nekrashevich ◽

Maria Andreeva ◽

...

Keyword(s):

Multiple Sclerosis ◽

Cognitive Assessment ◽

Verbal Learning ◽

Cognitive Status ◽

Russian Population ◽

Cognitive Domain ◽

Control Group ◽

Retest Reliability ◽

Valid Instrument ◽

Test Retest Reliability

Abstract Objective: Cognitive dysfunction is common in multiple sclerosis (MS). The Brief International Cognitive Assessment for MS (BICAMS) battery of tests has been suggested as a measure for the evaluation of the cognitive status of MS patients. This study aims to validate the BICAMS battery in the Russian population of MS patients. Methods: Age- and sex-matched MS patients (n = 98) and healthy individuals (n = 86) were included in the study. Symbol Digit Modalities Test (SDMT), California Verbal Learning Test, 2nd edition (CVLT-II) and the Brief Visuospatial Memory Test – Revised (BVMT-R) were administered to all participants. The battery was readministered 1 month later to 44 MS patients to investigate the test–retest reliability. Results: MS patients exhibited a significantly lower performance in testing with BICAMS than the control group in all three neuropsychological tests. Test–retest reliability was good for SDMT and CVLT-II (r = .82 and r = .85, respectively) and adequate for BVMT-R (r = .70). Based on the proposed criterion for impairment as z score below 1.5 SD the mean of the control group, we found that 34/98 (35%) of MS patients were found impaired at least in one cognitive domain. Patients with Expanded Disability Status Scale score ≥3.5 performed significantly worse than controls (SDMT, p < .0001; CVLT–II, p = .03; BVMT-R, p = .0004), while those with ≤3.0 scores did not. Conclusion: This study demonstrates that the BICAMS battery is a valid instrument to identify cognitive impairment in MS patients and it can be recommended for routine use in the Russian Federation.

Download Full-text

Test–retest reliability and convergent validity of the test of nonverbal intelligence-fourth edition in patients with schizophrenia

BMC Psychiatry ◽

10.1186/s12888-021-03041-4 ◽

2021 ◽

Vol 21 (1) ◽

Author(s):

Kuan-Wei Chen ◽

Ya-Chen Lee ◽

Tzu-Ying Yu ◽

Li-Jung Cheng ◽

Chien-Yu Chao ◽

...

Keyword(s):

Convergent Validity ◽

Fluid Intelligence ◽

Stable Condition ◽

Practice Effect ◽

Minimal Detectable Change ◽

Nonverbal Intelligence ◽

Fourth Edition ◽

Random Measurement Error ◽

Retest Reliability ◽

Test Retest Reliability

Abstract Background Fluid intelligence deficits affect executive functioning and social behaviors in patients with schizophrenia. To help clinicians manage fluid intelligence deficits, a psychometrically sound measure is needed. The purposes of this study were to examine the test–retest reliability and convergent validity of the Test of Nonverbal Intelligence-Fourth Edition (TONI-4) assessing fluid intelligence in patients with schizophrenia. Methods A total of 103 patients with stable condition were assessed with the TONI-4 twice with a 4-week interval to examine the test–retest reliability. We further used the Montreal Cognitive Assessment (MoCA) and the Tablet-Based Symbol Digit Modalities Test (T-SDMT) to examine the convergent validity of the TONI-4. Results The intra-class correlation coefficient was 0.73 for the TONI-4. The percentages of standard error of measurement and minimal detectable change for the TONI-4 were 5.1 and 14.2%, respectively. The practice effect of the TONI-4 was small (Cohen’s d = − 0.03). Convergent validity showed small to moderate significant correlations between the TONI-4 and the MoCA as well as the T-SDMT (r = 0.35, p = .011 with the T-SDMT and r = 0.61, p < .001 with the MoCA). The results demonstrated that the TONI-4 had good test–retest reliability, limited random measurement error, and a trivial practice effect. The convergent validity of the TONI-4 was good. Conclusions These findings indicate that the TONI-4 has potential to be a reliable and valid assessment of fluid intelligence in patients with schizophrenia.

Download Full-text

Validity and reliability of the Mandarin version of the Treatment Burden Questionnaire among stroke patients in Mainland China

Family Practice ◽

10.1093/fampra/cmab004 ◽

2021 ◽

Author(s):

Qi Zhang ◽

Ke Zhang ◽

Miao Li ◽

Jiaxin Gu ◽

Xintong Li ◽

...

Keyword(s):

Internal Consistency ◽

Convergent Validity ◽

Intraclass Correlation ◽

Reliability And Validity ◽

Therapeutic Interventions ◽

Treatment Burden ◽

Validity And Reliability ◽

Stroke Patients ◽

Retest Reliability ◽

Test Retest Reliability

Abstract Objectives To examine the validity and reliability of the Mandarin version of the Treatment Burden Questionnaire (TBQ) among stroke patients. Background Stroke patients need long-term management of symptoms and life situation, and treatment burden has recently emerged as a new concept that can influence the health outcomes during the rehabilitation process. Methods The convenience sampling method was used to recruit 187 cases of stroke patients in a tertiary grade hospital in Tianjin for a formal investigation. Item analysis, reliability and validity tests were carried out. The reliability test included internal consistency and test–retest reliability. And as well as content, structure and convergent validity were performed for the validity test. Results Of the 187 completed questionnaires, only 180 (96.3%) were suitable for analysis. According to the experts’ evaluation, the I-CVI of each item was from 0.833 to 1.000, and the S-CVI was 0.967. The exploratory factor analysis yielded three-factor components with a cumulative variation of 53.054%. Convergent validity was demonstrated using measures of Morisky’s Medication Adherence Scale 8 (r = –0.450, P < 0.01). All correlations between items and global scores ranged from 0.403 to 0.638. Internal consistency reliability and test–retest reliability were found to be acceptable, as indicated by a Cronbach’s α of 0.824 and an intraclass correlation coefficient of 0.846, respectively. Conclusions The Mandarin TBQ had acceptable validity and reliability. The use of TBQ in the assessment of treatment burden of stroke survivor may benefit health resources allocation and provide tailor therapeutic interventions to construct minimally disruptive care.

Download Full-text

Psychometric properties of the short form of the Stroke Impact Scale in German-speaking stroke survivors

Health and Quality of Life Outcomes ◽

10.1186/s12955-021-01826-5 ◽

2021 ◽

Vol 19 (1) ◽

Author(s):

Anna Coppers ◽

Jens Carsten Möller ◽

Detlef Marks

Keyword(s):

Factor Analysis ◽

Psychometric Properties ◽

Short Form ◽

Trial Registration ◽

Cognitive Domain ◽

Retest Reliability ◽

Stroke Impact Scale ◽

Impact Scale ◽

German Speaking ◽

Test Retest Reliability

Abstract Background The short form of the Stroke Impact Scale (SF-SIS) consists of eight questions and provides an overall index of health-related quality of life after stroke. The goal of the study was the evaluation of construct validity, reliability and responsiveness of the SF-SIS for the use in German-speaking stroke patients in rehabilitation. Methods The SF-SIS, the Stroke Impact Scale 2.0 (SIS 2.0), EQ-5D-5L, National Institutes of Health Stroke Scale (NIHSS) and de Morton Mobility Index were assessed in 150 inpatients after stroke, with a second measurement two weeks later for the analyses of responsiveness. In 55 participants, the test–retest-reliability was assessed one week after the first measurement. The study was designed following the recommendations of the COSMIN initiative. Results The correlations of the SF-SIS with the SIS 2.0 (ρ = 0.90), as well as the EQ-5D-5L (ρ = 0.79) were high, as expected. There was adequate discriminatory ability of the SF-SIS index between patients who were less and more severely affected by stroke, as assessed by the NIHSS. Exploratory factor analysis indicated a two-factor structure of the SF-SIS explaining 59.9% of the total variance, providing better model fit in the confirmatory factor analysis than the one-factorial structure. Analyses of test–retest-reliability showed an intraclass correlation coefficient of 0.88 (95% CI 0.75–0.94). Hypotheses concerning responsiveness were not confirmed due to lower correlations between the assessments change scores. Conclusion Results of this analysis of the SF-SIS’s psychometric properties are matching with the validity analysis of the English original version, confirming the high correlations with the Stroke Impact Scale and the EQ-5D-5L. Examination of structural validity did not confirm the presumed unidimensionality of the scale and found evidence of an underlying two-factor solution with a physical and cognitive domain. Sufficient test–retest reliability and internal consistency were found. In addition, this study provides first results for the responsiveness of the German version. Trial registration The study was registered at the German Clinical Trials Register. Trial registration number: DRKS00011933, date of registration: 07.04.2017

Download Full-text