scholarly journals A self-administered, artificial intelligence (AI) platform for cognitive assessment in multiple sclerosis (MS)

2020 ◽  
Author(s):  
Seyed-Mahdi Khaligh-Razavi ◽  
Maryam Sadeghi ◽  
Mahdiyeh Khanbagi ◽  
Chris Kalafatis ◽  
Seyed Massood Nabavi
Keyword(s):  
Multiple Sclerosis ◽  
Cognitive Impairment ◽  
Cognitive Dysfunction ◽  
Cognitive Assessment ◽  
Cognitive Rehabilitation ◽  
Convergent Validity ◽  
Strong Association ◽  
Therapeutic Interventions ◽  
Retest Reliability ◽  
Test Retest Reliability

Abstract Background Cognitive impairment is common in patients with multiple sclerosis (MS). Accurate and repeatable measures of cognition have the potential to be used as markers of disease activity. Methods We developed a 5-minute computerized test to measure cognitive dysfunction in patients with MS. The proposed test – named the Integrated Cognitive Assessment (ICA) – is self-administered and language-independent. 91 MS patients and 83 healthy controls (HC) took part in Substudy 1, in which each participant took the ICA test and the Brief International Cognitive Assessment for MS (BICAMS). We assessed ICA’s test-retest reliability, its correlation with BICAMS, its sensitivity to discriminate patients with MS from the HC group, and its accuracy in detecting cognitive dysfunction. In Substudy 2, we recruited 48 MS patients, 38 of which had received an 8-week physical and cognitive rehabilitation programme and 10 MS patients who did not. We examined the association between the level of serum neurofilament light (NfL) in these patients and their ICA scores and Symbol Digit Modalities Test (SDMT) scores pre- and post-rehabilitation. Results The ICA demonstrated excellent test-retest reliability (r=0.94), with no learning bias, and showed a high level of convergent validity with BICAMS. The ICA was sensitive in discriminating the MS patients from the HC group, and demonstrated high accuracy (AUC = 95%) in discriminating cognitively normal from cognitively impaired participants. Additionally, we found a strong association (r=-0.79) between ICA score and the level of NfL in MS patients before and after rehabilitation. Conclusions The ICA has the potential to be used as a digital marker of cognitive impairment and to monitor response to therapeutic interventions. In comparison to standard cognitive tools for MS, the ICA is shorter in duration, does not show a learning bias, and is independent of language.

scholarly journals A self-administered, artificial intelligence (AI) platform for cognitive assessment in multiple sclerosis (MS)

2020 ◽  
Author(s):  
Seyed-Mahdi Khaligh-Razavi ◽  
Maryam Sadeghi ◽  
Mahdiyeh Khanbagi ◽  
Chris Kalafatis ◽  
Seyed Massood Nabavi
Keyword(s):  
Multiple Sclerosis ◽  
Cognitive Impairment ◽  
Cognitive Dysfunction ◽  
Cognitive Assessment ◽  
Cognitive Rehabilitation ◽  
Convergent Validity ◽  
Strong Association ◽  
Therapeutic Interventions ◽  
Retest Reliability ◽  
Test Retest Reliability

Abstract Background Cognitive impairment is common in patients with multiple sclerosis (MS). Accurate and repeatable measures of cognition have the potential to be used as markers of disease activity. Methods We developed a 5-minute computerized test to measure cognitive dysfunction in patients with MS. The proposed test – named the Integrated Cognitive Assessment (ICA) – is self-administered and language-independent. 91 MS patients and 83 healthy controls (HC) took part in Substudy 1, in which each participant took the ICA test and the Brief International Cognitive Assessment for MS (BICAMS). We assessed ICA’s test-retest reliability, its correlation with BICAMS, its sensitivity to discriminate patients with MS from the HC group, and its accuracy in detecting cognitive dysfunction. In Substudy 2, we recruited 48 MS patients, 38 of which had received an 8-week physical and cognitive rehabilitation programme and 10 MS patients who did not. We examined the association between the level of serum neurofilament light (NfL) in these patients and their ICA scores and Symbol Digit Modalities Test (SDMT) scores pre- and post-rehabilitation. Results The ICA demonstrated excellent test-retest reliability (r=0.94), with no learning bias, and showed a high level of convergent validity with BICAMS. The ICA was sensitive in discriminating the MS patients from the HC group, and demonstrated high accuracy (AUC = 95%) in discriminating cognitively normal from cognitively impaired participants. Additionally, we found a strong association (r=-0.79) between ICA score and the level of NfL in MS patients before and after rehabilitation. Conclusions The ICA has the potential to be used as a digital marker of cognitive impairment and to monitor response to therapeutic interventions. In comparison to standard cognitive tools for MS, the ICA is shorter in duration, does not show a learning bias, and is independent of language.

scholarly journals A self-administered, artificial intelligence (AI) platform for cognitive assessment in multiple sclerosis (MS)

2020 ◽  
Author(s):  
Seyed-Mahdi Khaligh-Razavi ◽  
Maryam Sadeghi ◽  
Mahdiyeh Khanbagi ◽  
Chris Kalafatis ◽  
Seyed Massood Nabavi
Keyword(s):  
Cognitive Impairment ◽  
Cognitive Dysfunction ◽  
Cognitive Assessment ◽  
Cognitive Rehabilitation ◽  
Convergent Validity ◽  
Strong Association ◽  
Therapeutic Interventions ◽  
Neurofilament Light ◽  
Retest Reliability ◽  
Test Retest Reliability

Abstract Background Cognitive impairment is common in patients with MS. Accurate and repeatable measures of cognition have the potential to be used as markers of disease activity. Methods We developed a 5-minute computerized test to measure cognitive dysfunction in patients with MS. The proposed test – named the Integrated Cognitive Assessment (ICA) – is self-administered and language-independent. 91 MS patients and 83 healthy controls (HC) took part in Substudy 1, in which each participant took the ICA test and the Brief International Cognitive Assessment for MS (BICAMS). We assessed ICA’s test-retest reliability, its correlation with BICAMS, its sensitivity to discriminate patients with MS from the HC group, and its accuracy in detecting cognitive dysfunction. In Substudy 2, we recruited 48 MS patients, 38 of which had received an 8-week physical and cognitive rehabilitation programme and 10 MS patients who did not. We examined the association between the level of serum neurofilament light (NfL) in these patients and their ICA scores and SDMT scores pre- and post-rehabilitation. Results The ICA demonstrated excellent test-retest reliability (r=0.94), with no learning bias, and showed a high level of convergent validity with BICAMS. The ICA was sensitive in discriminating the MS patients from the HC group, and demonstrated high accuracy (AUC = 95%) in discriminating cognitively normal from cognitively impaired participants. Additionally, we found a strong association (r=-0.79) between ICA score and the level of NfL in MS patients before and after rehabilitation. Conclusions The ICA has the potential to be used as a digital marker of cognitive impairment and to monitor response to therapeutic interventions. In comparison to standard cognitive tools for MS, the ICA is shorter in duration, does not show a learning bias, and is independent of language.

scholarly journals A self-administered, artificial intelligence (AI) platform for cognitive assessment in multiple sclerosis (MS)

2019 ◽  
Author(s):  
Seyed-Mahdi Khaligh-Razavi ◽  
Maryam Sadeghi ◽  
Mahdiyeh Khanbagi ◽  
Chris Kalafatis ◽  
Seyed Massood Nabavi
Keyword(s):  
Artificial Intelligence ◽  
Cognitive Performance ◽  
Cognitive Dysfunction ◽  
Cognitive Assessment ◽  
Convergent Validity ◽  
Strong Association ◽  
Cognitive Status ◽  
Research Database ◽  
Retest Reliability ◽  
Test Retest Reliability

AbstractBackgroundCognitive impairment is common in patients with MS. Accurate and repeatable measures of cognition have the potential to be used as a marker of disease activity. We developed a 5-minute computerized test to measure cognitive dysfunction in patients with MS. The proposed test –named Integrated Cognitive Assessment (ICA)– is self-administered and language-independent.ObjectiveTo determine ICA’s validity as a digital biomarker for assessing cognitive performance in MS.Methods91 MS patients and 83 healthy controls (HC) took part in substudy 1, in which each participant took the ICA test and the Brief International Cognitive Assessment for MS (BICAMS). We assessed ICA’s test-retest reliability, its correlation with BICAMS, its sensitivity to discriminate patients with MS from the HC group, and its accuracy in detecting cognitive dysfunction. In substudy 2, we recruited 48 MS patients, and examined the association between the level of serum neurofilament light (NfL) in these patients and their ICA scores.ResultsICA demonstrated excellent test-retest reliability (r=0.94), with no learning bias (i.e. no significant practice effect); and had high level of convergent validity with BICAMS. ICA was sensitive in discriminating the MS patients from the HC group, and demonstrated a high accuracy (AUC = 95%) in discriminating cognitively normal from cognitively impaired participants. Additionally, we found a strong association (r=-0.79) between ICA score and the level of NfL in MS patients.ConclusionsICA can be used as a digital biomarker for assessment and monitoring of cognitive performance in MS patients. In comparison to standard cognitive tools for MS (e.g. BICAMS), ICA is shorter in duration, does not show a learning bias, is independent of language, and takes advantage of artificial intelligence (AI) to identify cognitive status of patients more accurately. Being a digital test, it further has the potential for easier electronic health record or research database integration.

scholarly journals A self-administered, artificial intelligence (AI) platform for cognitive assessment in multiple sclerosis (MS)

2019 ◽  
Author(s):  
Seyed-Mahdi Khaligh-Razavi ◽  
Maryam Sadeghi ◽  
Mahdiyeh Khanbagi ◽  
Chris Kalafatis ◽  
Seyed Massood Nabavi
Keyword(s):  
Artificial Intelligence ◽  
Cognitive Dysfunction ◽  
Cognitive Assessment ◽  
Convergent Validity ◽  
Strong Association ◽  
Cognitive Status ◽  
Database Integration ◽  
Research Database ◽  
Retest Reliability ◽  
Test Retest Reliability

Abstract Background Cognitive impairment is common in patients with MS. Accurate and repeatable measures of cognition have the potential to be used as a marker of disease activity. Methods We developed a 5-minute computerized test to measure cognitive dysfunction in patients with MS. The proposed test –named Integrated Cognitive Assessment (ICA)– is self-administered and language-independent. 91 MS patients and 83 healthy controls (HC) took part in substudy 1, in which each participant took the ICA test and the Brief International Cognitive Assessment for MS (BICAMS). We assessed ICA’s test-retest reliability, its correlation with BICAMS, its sensitivity to discriminate patients with MS from the HC group, and its accuracy in detecting cognitive dysfunction. In substudy 2, we recruited 48 MS patients, and examined the association between the level of serum neurofilament light (NfL) in these patients and their ICA scores. Results ICA demonstrated excellent test-retest reliability (r=0.94), with no learning bias (i.e. no significant practice effect); and had high level of convergent validity with BICAMS. ICA was sensitive in discriminating the MS patients from the HC group, and demonstrated a high accuracy (AUC = 95%) in discriminating cognitively normal from cognitively impaired participants. Additionally, we found a strong association (r=-0.79) between ICA score and the level of NfL in MS patients. Conclusions ICA has the potential to be used as a digital biomarker for assessment and monitoring of cognitive performance in MS patients. In comparison to standard cognitive tools for MS (e.g. BICAMS), ICA is shorter in duration, does not show a learning bias, is independent of language, and takes advantage of artificial intelligence (AI) to identify cognitive status of patients more accurately. Being a digital test, it further has the potential for easier electronic health record or research database integration.

scholarly journals A self-administered, artificial intelligence (AI) platform for cognitive assessment in multiple sclerosis (MS)

2019 ◽  
Author(s):  
Seyed-Mahdi Khaligh-Razavi ◽  
Maryam Sadeghi ◽  
Mahdiyeh Khanbagi ◽  
Chris Kalafatis ◽  
Seyed Massood Nabavi
Keyword(s):  
Artificial Intelligence ◽  
Cognitive Dysfunction ◽  
Cognitive Assessment ◽  
Convergent Validity ◽  
Strong Association ◽  
Cognitive Status ◽  
Database Integration ◽  
Research Database ◽  
Retest Reliability ◽  
Test Retest Reliability

Abstract Background Cognitive impairment is common in patients with MS. Accurate and repeatable measures of cognition have the potential to be used as a marker of disease activity. Methods We developed a 5-minute computerized test to measure cognitive dysfunction in patients with MS. The proposed test –named Integrated Cognitive Assessment (ICA)– is self-administered and language-independent. 91 MS patients and 83 healthy controls (HC) took part in substudy 1, in which each participant took the ICA test and the Brief International Cognitive Assessment for MS (BICAMS). We assessed ICA’s test-retest reliability, its correlation with BICAMS, its sensitivity to discriminate patients with MS from the HC group, and its accuracy in detecting cognitive dysfunction. In substudy 2, we recruited 48 MS patients, and examined the association between the level of serum neurofilament light (NfL) in these patients and their ICA scores. Results ICA demonstrated excellent test-retest reliability (r=0.94), with no learning bias (i.e. no significant practice effect); and had high level of convergent validity with BICAMS. ICA was sensitive in discriminating the MS patients from the HC group, and demonstrated a high accuracy (AUC = 95%) in discriminating cognitively normal from cognitively impaired participants. Additionally, we found a strong association (r=-0.79) between ICA score and the level of NfL in MS patients. Conclusions ICA has the potential to be used as a digital biomarker for assessment and monitoring of cognitive performance in MS patients. In comparison to standard cognitive tools for MS (e.g. BICAMS), ICA is shorter in duration, does not show a learning bias, is independent of language, and takes advantage of artificial intelligence (AI) to identify cognitive status of patients more accurately. Being a digital test, it further has the potential for easier electronic health record or research database integration.

scholarly journals Validity and Reliability of Brief International Cognitive Assessment for Multiple Sclerosis (BICAMS) in Indonesia and the Correlation with Quality of Life

2019 ◽  
Vol 2019 ◽  
pp. 1-7
Author(s):  
Riwanti Estiasari ◽  
Yuhyi Fajrina ◽  
Diatri Nari Lastri ◽  
Syarli Melani ◽  
Kartika Maharani ◽  
...  
Keyword(s):  
Quality Of Life ◽  
Multiple Sclerosis ◽  
Cognitive Impairment ◽  
Cognitive Function ◽  
Cognitive Assessment ◽  
Verbal Learning ◽  
Retest Reliability ◽  
Cognitive Evaluation ◽  
Test Retest Reliability

Introduction. Multiple Sclerosis (MS) can affect cognitive function that might interfere with quality of life. Processing speed and memory are the most common area of cognitive impairment. Cognitive evaluation in daily practice is often difficult to be performed since it needs neuropsychological expert and is time-consuming. Brief International Cognitive Assessment for MS (BICAMS) is valid and practical for cognitive evaluation. This study aims to validate BICAMS in Indonesian MS patients and healthy controls (HC) and to analyse the effect of cognitive impairment on quality of life. Methods. BICAMS, which composes Symbol Digits Modalities Test (SDMT), California Verbal Learning Test-Second Edition (CVLT-II), and Brief Visuospatial Memory Test-Revised (BVMT-R), was translated and cross-culturally adapted to Indonesian from the original BICAMS and then administered to 40 Indonesian MS patients and 66 HC matched by sex, age, and education. Test-retest reliability was performed on 16-MS patients and 42 HC. Quality of life was measured using Multiple Sclerosis Quality of Life (MSQOL-54) instrument. Results. The SDMT, CVLT-II, and BVMT-R score in MS patients were significantly lower than those in HC (effect size, r: 0.61, 0.36, and 0.47, respectively). Test-retest reliability for all tests was satisfactory with correlation coefficient for SDMT, CVLT-II, and BVMT-R in MS subjects 0.86, 0.81, and 0.83, respectively. Using 5th percentile of HC score as cut-off, 15% MS subjects had impairment in one test, 27.5% in two tests, and 40% in three tests. BICAMS was moderately correlated with EDSS but was not correlated with disease duration and relapse rate. SDMT score correlated with physical function and physical and mental role limitation. Conclusion. BICAMS is valid and reliable for assessing cognitive function of Indonesia MS patients.

scholarly journals Validity and Reliability of the Georgian-language Brief International Cognitive Assessment for Multiple Sclerosis (BICAMS) 

2021 ◽  
Author(s):  
Nazibrola Botchorishvili ◽  
Nino Shiukashvili ◽  
Nina Mikeladze ◽  
Ann Dzagnidze ◽  
Nino Miqava ◽  
...  
Keyword(s):  
Multiple Sclerosis ◽  
Cognitive Impairment ◽  
Cognitive Assessment ◽  
Expert Committee ◽  
Healthy Controls ◽  
Validity And Reliability ◽  
Retest Reliability ◽  
High Prevalence ◽  
Assessment And Monitoring ◽  
Test Retest Reliability

Abstract Background: Cognitive impairment is one of the common features of multiple sclerosis (MS). Despite high prevalence, cognitive decline is often overlooked by neurologists. The Brief International Cognitive Assessment for MS (BICAMS) was therefore introduced by the international expert committee as a brief and effective tool for the assessment and monitoring of cognitive functions in patients with MS. The validity and reliability of BICAMS have been demonstrated in many countries. Our aim was to validate the BICAMS in Georgian patients with MS.Methods: A total of 68 patients with MS and 68 matched controls were assessed by the Georgian-language BICAMS. All healthy controls and seven patients were re-evaluated with identical tests to assess retest reliability. Results: In comparison to healthy controls, patients with MS performed significantly worse on all tests in the assessment battery. Test-retest reliability measures were good for all tests. The prevalence of cognitive impairment in patients with MS was 43%. Conclusion: The Georgian-language BICAMS is a reliable and valid battery for the assessment of cognitive function in patients with MS.

scholarly journals Validity and reliability of the Georgian-language brief international cognitive assessment for multiple sclerosis (BICAMS)

BMC Neurology ◽  
2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Nazibrola Botchorishvili ◽  
Nino Shiukashvili ◽  
Nina Mikeladze ◽  
Ann Dzagnidze ◽  
Nino Mikava ◽  
...  
Keyword(s):  
Multiple Sclerosis ◽  
Cognitive Impairment ◽  
Cognitive Assessment ◽  
Expert Committee ◽  
Healthy Controls ◽  
Validity And Reliability ◽  
Retest Reliability ◽  
High Prevalence ◽  
Assessment And Monitoring ◽  
Test Retest Reliability

Abstract Background Cognitive impairment is one of the common features of multiple sclerosis (MS). Despite high prevalence, cognitive decline is often overlooked by neurologists. The Brief International Cognitive Assessment for MS (BICAMS) was therefore introduced by the international expert committee as a brief and effective tool for the assessment and monitoring of cognitive functions in patients with MS. The validity and reliability of BICAMS have been demonstrated in many countries. Our aim was to validate the BICAMS in Georgian patients with MS. Methods A total of 68 patients with MS and 68 matched controls were assessed by the Georgian-language BICAMS. All healthy controls and seven patients were re-evaluated with identical tests to assess retest reliability. Results In comparison to healthy controls, patients with MS performed significantly worse on all tests in the assessment battery. Test–retest reliability measures were good for all tests. The prevalence of cognitive impairment in patients with MS was 43%. Conclusion The Georgian-language BICAMS is a reliable and valid battery for the assessment of cognitive function in patients with MS.

Validation of the Brief International Cognitive Assessment for Multiple Sclerosis (BICAMS) in the Russian Population

2021 ◽  
pp. 1-8
Author(s):  
Evgeniy Evdoshenko ◽  
Kristina Laskova ◽  
Maria Shumilina ◽  
Ekaterina Nekrashevich ◽  
Maria Andreeva ◽  
...  
Keyword(s):  
Multiple Sclerosis ◽  
Cognitive Assessment ◽  
Verbal Learning ◽  
Cognitive Status ◽  
Russian Population ◽  
Cognitive Domain ◽  
Control Group ◽  
Retest Reliability ◽  
Valid Instrument ◽  
Test Retest Reliability

Abstract Objective: Cognitive dysfunction is common in multiple sclerosis (MS). The Brief International Cognitive Assessment for MS (BICAMS) battery of tests has been suggested as a measure for the evaluation of the cognitive status of MS patients. This study aims to validate the BICAMS battery in the Russian population of MS patients. Methods: Age- and sex-matched MS patients (n = 98) and healthy individuals (n = 86) were included in the study. Symbol Digit Modalities Test (SDMT), California Verbal Learning Test, 2nd edition (CVLT-II) and the Brief Visuospatial Memory Test – Revised (BVMT-R) were administered to all participants. The battery was readministered 1 month later to 44 MS patients to investigate the test–retest reliability. Results: MS patients exhibited a significantly lower performance in testing with BICAMS than the control group in all three neuropsychological tests. Test–retest reliability was good for SDMT and CVLT-II (r = .82 and r = .85, respectively) and adequate for BVMT-R (r = .70). Based on the proposed criterion for impairment as z score below 1.5 SD the mean of the control group, we found that 34/98 (35%) of MS patients were found impaired at least in one cognitive domain. Patients with Expanded Disability Status Scale score ≥3.5 performed significantly worse than controls (SDMT, p < .0001; CVLT–II, p = .03; BVMT-R, p = .0004), while those with ≤3.0 scores did not. Conclusion: This study demonstrates that the BICAMS battery is a valid instrument to identify cognitive impairment in MS patients and it can be recommended for routine use in the Russian Federation.

Validity and reliability of the Mandarin version of the Treatment Burden Questionnaire among stroke patients in Mainland China

2021 ◽  
Author(s):  
Qi Zhang ◽  
Ke Zhang ◽  
Miao Li ◽  
Jiaxin Gu ◽  
Xintong Li ◽  
...  
Keyword(s):  
Internal Consistency ◽  
Convergent Validity ◽  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Therapeutic Interventions ◽  
Treatment Burden ◽  
Validity And Reliability ◽  
Stroke Patients ◽  
Retest Reliability ◽  
Test Retest Reliability

Abstract Objectives To examine the validity and reliability of the Mandarin version of the Treatment Burden Questionnaire (TBQ) among stroke patients. Background Stroke patients need long-term management of symptoms and life situation, and treatment burden has recently emerged as a new concept that can influence the health outcomes during the rehabilitation process. Methods The convenience sampling method was used to recruit 187 cases of stroke patients in a tertiary grade hospital in Tianjin for a formal investigation. Item analysis, reliability and validity tests were carried out. The reliability test included internal consistency and test–retest reliability. And as well as content, structure and convergent validity were performed for the validity test. Results Of the 187 completed questionnaires, only 180 (96.3%) were suitable for analysis. According to the experts’ evaluation, the I-CVI of each item was from 0.833 to 1.000, and the S-CVI was 0.967. The exploratory factor analysis yielded three-factor components with a cumulative variation of 53.054%. Convergent validity was demonstrated using measures of Morisky’s Medication Adherence Scale 8 (r = –0.450, P &lt; 0.01). All correlations between items and global scores ranged from 0.403 to 0.638. Internal consistency reliability and test–retest reliability were found to be acceptable, as indicated by a Cronbach’s α of 0.824 and an intraclass correlation coefficient of 0.846, respectively. Conclusions The Mandarin TBQ had acceptable validity and reliability. The use of TBQ in the assessment of treatment burden of stroke survivor may benefit health resources allocation and provide tailor therapeutic interventions to construct minimally disruptive care.

Sign in / Sign up

Export Citation Format

Share Document