Reliable screening for neuropsychological impairment in multiple sclerosis

2004 ◽  
Vol 10 (6) ◽  
pp. 675-678 ◽  
Author(s):  
Ralph HB Benedict ◽  
Darcy Cox ◽  
Laetitia L Thompson ◽  
Fred Foley ◽  
Bianca Weinstock-Guttman ◽  
...  
Keyword(s):  
Multiple Sclerosis ◽  
Cognitive Impairment ◽  
Bayesian Statistics ◽  
Cognitive Performance ◽  
Predictive Validity ◽  
Self Report ◽  
Retest Reliability ◽  
Informant Report ◽  
Test Retest Reliability ◽  
Normal Controls

In an earlier study, we developed the Multiple Sclerosis Neuropsychological Screening Questionnaire (MSNQ) to assist in the screening for neuropsychological (NP) impairments. Self-report MSNQ scores correlated significantly with measures of depression, whereas informant-report MSNQ scores correlated with cognitive performance, but not depression. This study was criticized for use of a small sample and lack of data regarding normal performance and test -retest reliability. The present study was designed to replicate the earlier work with a larger sample of patients and normal controls obtained from multiple sites. We also evaluated the test -retest reliability and predictive validity of the MSNQ. The sample included 85 multiple sclerosis (MS) patients and 40 normal controls, matched on demographic variables. All participants completed the MSNQ and underwent NP testing. Thirty-four patients were re-examined at one week. Pearson and ANOVA techniques were utilized for univariate comparisons. Bayesian statistics were calculated to assess predictive validity. Patient self- and informant-report MSNQ scores differed from normal and test -retest reliability indices were high. Both self- and informant-reports were correlated with cognitive dysfunction and depression scales. Self-report MSNQ scores correlated more strongly with depression than cognitive performance, whereas the opposite pattern was observed with informant-report scores. Bayesian statistics showed that informant-report MSNQ scores predict cognitive impairment and patient self-report scores identify patients with cognitive impairment or depression. It is concluded that the MSNQ is useful, although patient self-reports may be exaggerated in depressed patients or reduced in patients with severe cognitive impairment.

Validation of the NARCOMS Registry: pain assessment

2005 ◽  
Vol 11 (3) ◽  
pp. 338-342 ◽  
Author(s):  
Ruth Ann Marrie ◽  
Gary Cutter ◽  
Tuula Tyry ◽  
Olympia Hadjimichael ◽  
Timothy Vollmer
Keyword(s):  
Multiple Sclerosis ◽  
Convergent Validity ◽  
Disease Duration ◽  
Self Report ◽  
Research Committee ◽  
Retest Reliability ◽  
The North ◽  
Disability Status ◽  
Pain Question ◽  
Test Retest Reliability

The North American Research Committee on Multiple Sclerosis (NARCOMS) Registry is a multiple sclerosis (MS) self-report registry with more than 24 000 participants. Participants report disability status upon enrolment, and semi-annually using Performance Scales (PS), Patient Determined Disease Steps (PDDS) and a pain question. In November 2000 and 2001, we also collected the Pain Effects Scale (PES). Our aim was to validate the NARCOMS pain question using the PES as our criterion measure. We measured correlations between the pain question and age, disease duration, various PS subscales and PDDS to assess construct validity. We correlated pain question responses in participants who reported no change in PDSS or the PS subscales between questionnaires to determine test—retest reliability. We measured responsiveness in participants who reported a substantial change in the sensory, spasticity PS subscales. The correlation between the pain question and PES was r=0.61 in November 2000, and r=0.64 in November 2001 (both P<0.0001). Correlations between the pain question and age, and disease duration were low, indicating divergent validity. Correlations between the pain question and spasticity, sensory PS subscales and PDSS were moderate, indicating convergent validity. Test—retest reliability was r=0.84 (P<0.0001). Responsiveness was 70.7%. The pain question is a valid self-report measure of pain in MS.

scholarly journals Validity and Reliability of Brief International Cognitive Assessment for Multiple Sclerosis (BICAMS) in Indonesia and the Correlation with Quality of Life

2019 ◽  
Vol 2019 ◽  
pp. 1-7
Author(s):  
Riwanti Estiasari ◽  
Yuhyi Fajrina ◽  
Diatri Nari Lastri ◽  
Syarli Melani ◽  
Kartika Maharani ◽  
...  
Keyword(s):  
Quality Of Life ◽  
Multiple Sclerosis ◽  
Cognitive Impairment ◽  
Cognitive Function ◽  
Cognitive Assessment ◽  
Verbal Learning ◽  
Retest Reliability ◽  
Cognitive Evaluation ◽  
Test Retest Reliability

Introduction. Multiple Sclerosis (MS) can affect cognitive function that might interfere with quality of life. Processing speed and memory are the most common area of cognitive impairment. Cognitive evaluation in daily practice is often difficult to be performed since it needs neuropsychological expert and is time-consuming. Brief International Cognitive Assessment for MS (BICAMS) is valid and practical for cognitive evaluation. This study aims to validate BICAMS in Indonesian MS patients and healthy controls (HC) and to analyse the effect of cognitive impairment on quality of life. Methods. BICAMS, which composes Symbol Digits Modalities Test (SDMT), California Verbal Learning Test-Second Edition (CVLT-II), and Brief Visuospatial Memory Test-Revised (BVMT-R), was translated and cross-culturally adapted to Indonesian from the original BICAMS and then administered to 40 Indonesian MS patients and 66 HC matched by sex, age, and education. Test-retest reliability was performed on 16-MS patients and 42 HC. Quality of life was measured using Multiple Sclerosis Quality of Life (MSQOL-54) instrument. Results. The SDMT, CVLT-II, and BVMT-R score in MS patients were significantly lower than those in HC (effect size, r: 0.61, 0.36, and 0.47, respectively). Test-retest reliability for all tests was satisfactory with correlation coefficient for SDMT, CVLT-II, and BVMT-R in MS subjects 0.86, 0.81, and 0.83, respectively. Using 5th percentile of HC score as cut-off, 15% MS subjects had impairment in one test, 27.5% in two tests, and 40% in three tests. BICAMS was moderately correlated with EDSS but was not correlated with disease duration and relapse rate. SDMT score correlated with physical function and physical and mental role limitation. Conclusion. BICAMS is valid and reliable for assessing cognitive function of Indonesia MS patients.

scholarly journals An Empirical Comparison of Four Generalized Trust Scales: Test–Retest Reliability, Measurement Invariance, Predictive Validity, and Replicability

2021 ◽  
pp. 004912412110557
Author(s):  
Blaine G. Robbins
Keyword(s):  
Measurement Invariance ◽  
Predictive Validity ◽  
Social Trust ◽  
Self Report ◽  
Generalized Trust ◽  
Retest Reliability ◽  
Measurement Validation ◽  
Test Retest Reliability ◽  
Trust Scale ◽  
Reliability Measurement

The Stranger Face Trust scale (SFT) and Imaginary Stranger Trust scale (IST) are two new self-report measures of generalized trust that assess trust in strangers—both real and imaginary—across four trust domains. Prior research has established the reliability and validity of SFT and IST, but a number of measurement validation tests remain. Across three separate studies, I assess the test–retest reliability, measurement invariance, predictive validity, and replicability of SFT and IST, with the misanthropy scale (MST) and generalized social trust scale (GST) serving as benchmarks. First, tests of internal consistency, test–retest reliability, and longitudinal measurement invariance established that all four generalized trust scales were acceptably reliable, with SFT and IST yielding greater overall reliability than MST and GST. Second, tests of multiple group measurement invariance revealed that SFT and IST were equivalent across gender, race, education, and age groups, while MST and GST were non-equivalent across the same sociodemographic groups. Third, an investment game established the predictive validity of SFT and MST, with IST and GST yielding poor predictive validity. Fourth, tests of factor structure and measurement invariance indicated that all four generalized trust scales replicated across samples. The present findings bolster the validity, reliability, and measurement equivalence of SFT and IST, while illustrating the compromised validity and measurement non-equivalence of MST and GST. Implications for the measurement of generalized trust are discussed.

scholarly journals A self-administered, artificial intelligence (AI) platform for cognitive assessment in multiple sclerosis (MS)

2020 ◽  
Author(s):  
Seyed-Mahdi Khaligh-Razavi ◽  
Maryam Sadeghi ◽  
Mahdiyeh Khanbagi ◽  
Chris Kalafatis ◽  
Seyed Massood Nabavi
Keyword(s):  
Multiple Sclerosis ◽  
Cognitive Impairment ◽  
Cognitive Dysfunction ◽  
Cognitive Assessment ◽  
Cognitive Rehabilitation ◽  
Convergent Validity ◽  
Strong Association ◽  
Therapeutic Interventions ◽  
Retest Reliability ◽  
Test Retest Reliability

Abstract Background Cognitive impairment is common in patients with multiple sclerosis (MS). Accurate and repeatable measures of cognition have the potential to be used as markers of disease activity. Methods We developed a 5-minute computerized test to measure cognitive dysfunction in patients with MS. The proposed test – named the Integrated Cognitive Assessment (ICA) – is self-administered and language-independent. 91 MS patients and 83 healthy controls (HC) took part in Substudy 1, in which each participant took the ICA test and the Brief International Cognitive Assessment for MS (BICAMS). We assessed ICA’s test-retest reliability, its correlation with BICAMS, its sensitivity to discriminate patients with MS from the HC group, and its accuracy in detecting cognitive dysfunction. In Substudy 2, we recruited 48 MS patients, 38 of which had received an 8-week physical and cognitive rehabilitation programme and 10 MS patients who did not. We examined the association between the level of serum neurofilament light (NfL) in these patients and their ICA scores and Symbol Digit Modalities Test (SDMT) scores pre- and post-rehabilitation. Results The ICA demonstrated excellent test-retest reliability (r=0.94), with no learning bias, and showed a high level of convergent validity with BICAMS. The ICA was sensitive in discriminating the MS patients from the HC group, and demonstrated high accuracy (AUC = 95%) in discriminating cognitively normal from cognitively impaired participants. Additionally, we found a strong association (r=-0.79) between ICA score and the level of NfL in MS patients before and after rehabilitation. Conclusions The ICA has the potential to be used as a digital marker of cognitive impairment and to monitor response to therapeutic interventions. In comparison to standard cognitive tools for MS, the ICA is shorter in duration, does not show a learning bias, and is independent of language.

scholarly journals A self-administered, artificial intelligence (AI) platform for cognitive assessment in multiple sclerosis (MS)

2020 ◽  
Author(s):  
Seyed-Mahdi Khaligh-Razavi ◽  
Maryam Sadeghi ◽  
Mahdiyeh Khanbagi ◽  
Chris Kalafatis ◽  
Seyed Massood Nabavi
Keyword(s):  
Multiple Sclerosis ◽  
Cognitive Impairment ◽  
Cognitive Dysfunction ◽  
Cognitive Assessment ◽  
Cognitive Rehabilitation ◽  
Convergent Validity ◽  
Strong Association ◽  
Therapeutic Interventions ◽  
Retest Reliability ◽  
Test Retest Reliability

Abstract Background Cognitive impairment is common in patients with multiple sclerosis (MS). Accurate and repeatable measures of cognition have the potential to be used as markers of disease activity. Methods We developed a 5-minute computerized test to measure cognitive dysfunction in patients with MS. The proposed test – named the Integrated Cognitive Assessment (ICA) – is self-administered and language-independent. 91 MS patients and 83 healthy controls (HC) took part in Substudy 1, in which each participant took the ICA test and the Brief International Cognitive Assessment for MS (BICAMS). We assessed ICA’s test-retest reliability, its correlation with BICAMS, its sensitivity to discriminate patients with MS from the HC group, and its accuracy in detecting cognitive dysfunction. In Substudy 2, we recruited 48 MS patients, 38 of which had received an 8-week physical and cognitive rehabilitation programme and 10 MS patients who did not. We examined the association between the level of serum neurofilament light (NfL) in these patients and their ICA scores and Symbol Digit Modalities Test (SDMT) scores pre- and post-rehabilitation. Results The ICA demonstrated excellent test-retest reliability (r=0.94), with no learning bias, and showed a high level of convergent validity with BICAMS. The ICA was sensitive in discriminating the MS patients from the HC group, and demonstrated high accuracy (AUC = 95%) in discriminating cognitively normal from cognitively impaired participants. Additionally, we found a strong association (r=-0.79) between ICA score and the level of NfL in MS patients before and after rehabilitation. Conclusions The ICA has the potential to be used as a digital marker of cognitive impairment and to monitor response to therapeutic interventions. In comparison to standard cognitive tools for MS, the ICA is shorter in duration, does not show a learning bias, and is independent of language.

Validity and reliability of Persian version of the Arm Function in Multiple Sclerosis Questionnaire

2021 ◽  
pp. 030802262110087
Author(s):  
Sara Afshar ◽  
Nazila Akbarfahimi ◽  
Mehdi Rassafiani ◽  
Mohsen Vahedi ◽  
Mojtaba Azimian ◽  
...  
Keyword(s):  
Multiple Sclerosis ◽  
Internal Consistency ◽  
Functional Independence Measure ◽  
Functional Independence ◽  
Self Report ◽  
Validity And Reliability ◽  
Retest Reliability ◽  
Persian Version ◽  
Arm Function ◽  
Test Retest Reliability

Introduction This study aimed to determine the validity and reliability of the Persian version of the Arm Function in Multiple Sclerosis Questionnaire which is a self-report questionnaire for persons with multiple sclerosis (MS). Method This methodological study was performed in the following stages: translation, validity, internal consistency, and test–retest reliability of Persian-AMSQ. The Nine-Hole Peg Test (9HPT), Coin Rotation Task (CRT), and Functional Independence Measure (FIM) for construct validity were used. Psychometric testing was done to ascertain the validity and reliability of the questionnaire. Results In this study, 155 people with MS participated. There were no major linguistic or cultural difficulties in the translation of AMSQ. Face and content validity confirmed by experts and people with MS. The internal consistency was high (Cronbach’s α = 0.99). Test–retest reliability, as measured with intra-class coefficient, was 0.98. Correlations with 9HPT (r = 0.54), CRT (r = 0.16), and FIM (r = −0.54) were significant ( p < 0.05). Conclusion The Persian-AMSQ appears to be a valid and reliable questionnaire for measuring upper extremity dysfunction in MS.

scholarly journals An Empirical Comparison of Four Generalized Trust Scales: Tests-Retest Reliability, Measurement Invariance, Predictive Validity, and Replicability

2020 ◽  
Author(s):  
Blaine G Robbins
Keyword(s):  
Measurement Invariance ◽  
Predictive Validity ◽  
Social Trust ◽  
Self Report ◽  
Generalized Trust ◽  
Retest Reliability ◽  
Measurement Validation ◽  
Test Retest Reliability ◽  
Trust Scale ◽  
Reliability Measurement

The Stranger Face Trust scale (SFT) and Imaginary Stranger Trust scale (IST) are two new self-report measures of generalized trust that assess trust in strangers—both real and imaginary—across four trust domains. Prior research has established the reliability and validity of SFT and IST, but a number of measurement validation tests remain. Across three separate studies, I assess the test-retest reliability, measurement invariance, predictive validity, and replicability of SFT and IST, with the misanthropy scale (MST) and generalized social trust scale (GST) serving as benchmarks. First, tests of internal consistency, test-retest reliability, and longitudinal measurement invariance established that all four generalized trust scales were acceptably reliable, with SFT and IST yielding greater overall reliability than MST and GST. Second, tests of multiple group measurement invariance revealed that SFT and IST were invariant across gender, race, education, and age-groups, while MST and GST were nonequivalent across the same sociodemographic groups. Third, an investment game established the predictive validity of SFT and—to a lesser extent—MST, with IST and GST yielding poor predictive validity. Fourth, tests of factor structure and measurement invariance indicated that all four generalized trust scales replicated across samples. The present findings bolster the validity, reliability, and measurement invariance of SFT and IST, while illustrating the compromised validity and measurement invariance of MST and GST. Implications for the measurement of generalized trust are discussed.

scholarly journals Self-report Pain Scale Reliability in Veterans and Service Members With Traumatic Brain Injuries Undergoing Inpatient Rehabilitation

2019 ◽  
Vol 185 (3-4) ◽  
pp. 370-376 ◽  
Author(s):  
Michelle R Hoot ◽  
Bilal Khokhar ◽  
William C Walker
Keyword(s):  
Cognitive Impairment ◽  
Pain Assessment ◽  
Inpatient Rehabilitation ◽  
Pain Scale ◽  
Self Report ◽  
Retest Reliability ◽  
Scale Reliability ◽  
Test Retest Reliability ◽  
Very High ◽  
High Test

Abstract Introduction Pain in trauma patients with traumatic brain injury (TBI) may heighten cognitive-behavioral impairment and impede rehabilitation efforts. Multiple self-report pain assessment tools have been shown reliable in cognitively intact adults and children but are understudied in the cognitively impaired, particularly in persons with TBI. The objective of this study was to assess the utility and reliability of four pain assessment instruments among TBI patients during inpatient rehabilitation and the influence of cognitive impairment. Methods Participants self-completed four pain intensity measures, the Verbal Descriptor Scale, Faces Pain Scale (Faces), Numerical Rating Scale (NRS), and Color-Enhanced Visual Analog Scale (CAS), during five study visits over a 2-week period. Data were collected on time to completion and most preferred pain measure. To assess scale reliability, participants re-rated their current pain. To assess scale responsiveness, standard mean response was measured across time and a worst past pain experience was rated. Cognitive impairment was assessed with the Memory, Orientation, and Amnesia Test. Results The NRS was the most preferred measure by participants at every time point in the study. Mean pain measure completion time for all measures was under 11 seconds and did not significantly change during the study period. All scales showed very high test-retest reliability, with very strong correlations. Standard mean response from day 0 to 14 ranged from 0.387 to 0.532 across the scales. When stratified by cognitive impairment, the mean scores were consistently nominally higher for impaired participants, reaching statistical significance only for the CAS and Faces at baseline. In the cognitive impaired group, reliability for the Faces showed some weakening, as did the VAS to a milder degree. Conclusions All four pain measures demonstrated good utility, very high test-retest reliability, and satisfactory responsiveness. Greater cognitive impairment was associated with elevated pain ratings, especially in the Faces and CAS. The NRS was the most preferred by patients, regardless of cognitive impairment level.

scholarly journals Validity and Reliability of the Georgian-language Brief International Cognitive Assessment for Multiple Sclerosis (BICAMS) 

2021 ◽  
Author(s):  
Nazibrola Botchorishvili ◽  
Nino Shiukashvili ◽  
Nina Mikeladze ◽  
Ann Dzagnidze ◽  
Nino Miqava ◽  
...  
Keyword(s):  
Multiple Sclerosis ◽  
Cognitive Impairment ◽  
Cognitive Assessment ◽  
Expert Committee ◽  
Healthy Controls ◽  
Validity And Reliability ◽  
Retest Reliability ◽  
High Prevalence ◽  
Assessment And Monitoring ◽  
Test Retest Reliability

Abstract Background: Cognitive impairment is one of the common features of multiple sclerosis (MS). Despite high prevalence, cognitive decline is often overlooked by neurologists. The Brief International Cognitive Assessment for MS (BICAMS) was therefore introduced by the international expert committee as a brief and effective tool for the assessment and monitoring of cognitive functions in patients with MS. The validity and reliability of BICAMS have been demonstrated in many countries. Our aim was to validate the BICAMS in Georgian patients with MS.Methods: A total of 68 patients with MS and 68 matched controls were assessed by the Georgian-language BICAMS. All healthy controls and seven patients were re-evaluated with identical tests to assess retest reliability. Results: In comparison to healthy controls, patients with MS performed significantly worse on all tests in the assessment battery. Test-retest reliability measures were good for all tests. The prevalence of cognitive impairment in patients with MS was 43%. Conclusion: The Georgian-language BICAMS is a reliable and valid battery for the assessment of cognitive function in patients with MS.

scholarly journals Validity and reliability of the Georgian-language brief international cognitive assessment for multiple sclerosis (BICAMS)

BMC Neurology ◽  
2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Nazibrola Botchorishvili ◽  
Nino Shiukashvili ◽  
Nina Mikeladze ◽  
Ann Dzagnidze ◽  
Nino Mikava ◽  
...  
Keyword(s):  
Multiple Sclerosis ◽  
Cognitive Impairment ◽  
Cognitive Assessment ◽  
Expert Committee ◽  
Healthy Controls ◽  
Validity And Reliability ◽  
Retest Reliability ◽  
High Prevalence ◽  
Assessment And Monitoring ◽  
Test Retest Reliability

Abstract Background Cognitive impairment is one of the common features of multiple sclerosis (MS). Despite high prevalence, cognitive decline is often overlooked by neurologists. The Brief International Cognitive Assessment for MS (BICAMS) was therefore introduced by the international expert committee as a brief and effective tool for the assessment and monitoring of cognitive functions in patients with MS. The validity and reliability of BICAMS have been demonstrated in many countries. Our aim was to validate the BICAMS in Georgian patients with MS. Methods A total of 68 patients with MS and 68 matched controls were assessed by the Georgian-language BICAMS. All healthy controls and seven patients were re-evaluated with identical tests to assess retest reliability. Results In comparison to healthy controls, patients with MS performed significantly worse on all tests in the assessment battery. Test–retest reliability measures were good for all tests. The prevalence of cognitive impairment in patients with MS was 43%. Conclusion The Georgian-language BICAMS is a reliable and valid battery for the assessment of cognitive function in patients with MS.

Sign in / Sign up

Export Citation Format

Share Document