Construct validity of the Visual Cognitive Assessment Test (VCAT)—a cross-cultural language-neutral cognitive screening tool

2019 ◽  
Vol 32 (1) ◽  
pp. 141-149 ◽  
Author(s):  
Audrey Low ◽  
Levinia Lim ◽  
Linda Lim ◽  
Benjamin Wong ◽  
Eveline Silva ◽  
...  

ABSTRACTBackground:The Visual Cognitive Assessment Test (VCAT) is a language-neutral cognitive screening tool designed for use in culturally diverse populations without the need for translations or adaptations. While it has been established to be language-neutral, the VCAT’s construct validity has not been investigated.Methods:471 participants were recruited, comprising 233 healthy comparisons, 117 mild cognitive impairment (MCI), and 121 mild Alzheimer’s disease (AD) patients. VCAT and domain-specific neuropsychological tests were administered in the same sitting. Construct validity was assessed by analyzing domain-specific associations between the VCAT and well-established cognitive assessments. Reliability (internal consistency) was measured by Cronbach’s alpha. Diagnostic ability (area under the curve) and recommended cutoffs were determined by receiver operating characteristic (ROC) analysis.Results:The VCAT and its subdomains demonstrated good construct validity in terms of both convergent and divergent validity and good internal consistency (α = .74). ROC analysis found that the VCAT was on par with the Mini Mental State Examination (MMSE) and Montreal Cognitive Assessment (MoCA) at distinguishing between healthy comparisons, MCI, and mild AD. Consistent with previous studies, VCAT scores were not affected by language of administration or ethnicity in our cohort. Findings suggest the following cutoffs: Dementia 0–19, MCI 20–24, Normal 25–30.Conclusion:This study established the construct validity of the VCAT, which is vital to ensure its subdomains effectively measure the cognitive processes they were designed to. The VCAT is capable of detecting early cognitive impairments and allows for meaningful cross-cultural comparisons, especially useful for international collaborations and clinical trials, and for clinical use in diverse multiethnic populations.

2006 ◽  
Vol 14 (7S_Part_24) ◽  
pp. P1299-P1300
Author(s):  
Audrey Low ◽  
Levinia Lim ◽  
Linda Lay Hoon Lim ◽  
Benjamin Wong ◽  
Eveline Silva ◽  
...  

2019 ◽  
Author(s):  
Ashita S. Gurnani ◽  
Shayne S.-H. Lin ◽  
Brandon E Gavett

Objective: The Colorado Cognitive Assessment (CoCA) was designed to improve upon existing screening tests in a number of ways, including enhanced psychometric properties and minimization of bias across diverse groups. This paper describes the initial validation study of the CoCA, which seeks to describe the test; demonstrate its construct validity; measurement invariance to age, education, sex, and mood symptoms; and compare it to the Montreal Cognitive Assessment (MoCA). Method: Participants included 151 older adults (MAge = 71.21, SD = 8.05) who were administered the CoCA, MoCA, Judgment test from the Neuropsychological Assessment Battery (NAB), 15-item version of the Geriatric Depression Scale (GDS-15), and 10-item version of the Geriatric Anxiety Scale (GAS-10). Results: A single factor confirmatory factor analysis model of the CoCA fit the data well, CFI = 0.955; RMSEA = 0.033. The CoCA’s internal consistency reliability was .84, compared to .74 for the MoCA. The CoCA had stronger disattenuated correlations with the MoCA (r = .79) and NAB Judgment (r = .47) and weaker correlations with the GDS-15 (r = -.36) and GAS-10 (r = -.15), supporting its construct validity. Finally, when analyzed using multiple indicators, multiple causes (MIMIC) modeling, the CoCA showed no evidence of measurement non-invariance, unlike the MoCA. Conclusions: These results provide initial evidence to suggest that the CoCA is a valid cognitive screening tool that offers numerous advantages over the MoCA, including superior psychometric properties and measurement non-invariance. Additional validation and normative studies are warranted.


2021 ◽  
Author(s):  
M Abdulkarim ◽  
J Venkatachalam

Background: The Montreal Cognitive Assessment (MoCA) is a neuropsychological cognitive tool developed and adapted widely in various languages for screening mild cognitive impairment (MCI). Objectives: The present study aimed to evaluate the psychometric properties of the Tamil (India) Version of MoCA (T-MoCA) and further examine the construct validity of the tool.Method: The authors conducted internal consistency, test-retest, sensitivity-specificity, and construct validity using 233 Tamil-speaking elderly participants. The inclusion criteria of the study participants were 0.5 or less than 0.5 scores in the Clinical Dementia Rating scale (CDR). Further, T-MoCA was used to screen MCI. Results: The result showed that the T-MoCA had high internal consistency (0.83) and high test-retest reliability (0.92). Receiver operating characteristic (ROC) analyses showed an area under the curve (AUC) of 0.91 (95% CI 0.87-0.94) for detecting MCI. Furthermore, the optimal cut-off score to detect MCI was 24, accommodated a sensitivity and specificity of 88.4% and 77.9%, respectively. Conclusions: The Tamil (India) version of the MoCA maintained its core diagnostic properties, furnishing it a valid and reliable tool for the screening of MCI. Also, its latent dimensions help to understand the elders’ cognitive function in a better way.


2019 ◽  
Vol 35 (2) ◽  
pp. 176-187
Author(s):  
Ashita S Gurnani ◽  
Shayne S-H Lin ◽  
Brandon E Gavett

Abstract Objective The Colorado Cognitive Assessment (CoCA) was designed to improve upon existing screening tests in a number of ways, including enhanced psychometric properties and minimization of bias across diverse groups. This paper describes the initial validation study of the CoCA, which seeks to describe the test; demonstrate its construct validity; measurement invariance to age, education, sex, and mood symptoms; and compare it to the Montreal Cognitive Assessment (MoCA). Method Participants included 151 older adults (MAge = 71.21, SD = 8.05) who were administered the CoCA, MoCA, Judgment test from the Neuropsychological Assessment Battery (NAB), 15-item version of the Geriatric Depression Scale (GDS-15), and 10-item version of the Geriatric Anxiety Scale (GAS-10). Results A single-factor confirmatory factor analysis model of the CoCA fit the data well, CFI = 0.955; RMSEA = 0.033. The CoCA factor score reliability was .84, compared to .74 for the MoCA. The CoCA had stronger disattenuated correlations with the MoCA (r = .79) and NAB Judgment (r = .47) and weaker correlations with the GDS-15 (r = −.36) and GAS-10 (r = −.15), supporting its construct validity. Finally, when analyzed using multiple-indicators, multiple-causes (MIMIC) modeling, the CoCA showed no evidence of measurement noninvariance, unlike the MoCA. Conclusions These results provide initial evidence to suggest that the CoCA is a valid cognitive screening tool that offers numerous advantages over the MoCA, including superior psychometric properties and measurement noninvariance. Additional validation and normative studies are warranted.


Psych ◽  
2022 ◽  
Vol 4 (1) ◽  
pp. 38-48
Author(s):  
Li Yun Ng ◽  
Chen Joo Chin ◽  
Monica Danial ◽  
Stephenie Ann Albart ◽  
Purnima Devi Suppiah ◽  
...  

As Malaysia undergoes a demographic transformation of population aging, the prevalence of dementia is expected to rise, posing a major public health threat issue. Early screening to detect cognitive impairment is important to implement appropriate clinical interventions. The Visual Cognitive Assessment Test (VCAT) is a language-neutral cognitive assessment screening tool suitable for multilingual populations. This study was aimed to validate the VCAT screening tool for the detection of cognitive impairment amongst the population of Malaysia. A total of 184 participants were recruited, comprising 79 cognitively healthy participants (CHP), 46 mild cognitive impairment (MCI) patients, and 59 mild dementia (Alzheimer’s disease and Vascular Dementia) patients from five hospitals between May 2018 and December 2019 to determine the usefulness of VCAT. Diagnostic performance was assessed using area under the curve (AUC), and receiver operating characteristic (ROC) analysies was performed to determine the recommended cutoff scores. ROC analyses for the VCAT was comparable with that of MoCA (Montreal Cognitive Assessment) in differentiating between CHP, MCI, and mild dementia (AD and VaD) participants. The findings of this study suggest the following optimal cutoff score for VCAT: Dementia 0–19, MCI 20–23, Normal 24–30. The mean ± SD time to complete the VCAT was 10.0 ± 2.75 min in the CHP group and 15.4 ± 4.52 min in the CI group. Results showed that 76.0% of subjects thought that the instructions in VCAT were similar or easier to understand compared with MoCA. This study showed that the VCAT is a valid and useful screening tool for patients with cognitive impairment in Malaysia and is feasible to be used in the clinical settings.


2016 ◽  
Vol 56 (3) ◽  
pp. 149
Author(s):  
Ferriandis Harsono ◽  
Purboyo Solek ◽  
Kusnandi Rusmil

Background Developmental and behavioral problems are among the most common conditions of childhood. These problems affect 12−16% of children in the United States and 13−18% of children in Indonesia. Early detection of developmental deficits among children requires clinicians to screen with accurate tools. Cognitive function screening in children has been increasingly used in many clinical and educational settings. The School-Years Screening Test for Evaluation of Mental Status-Revised (SYSTEMS-R) is becoming a widely-used, reliable, and valid cognitive screening tool for children aged 4−15 years. Prior to our study, there was no Indonesian language version of the SYSTEMS-R.Objective To determine the reliability of the Indonesian translation of the SYSTEMS-R.Methods A cross-sectional study was conducted in children aged 4−15 years who understood the Indonesian language and did not have neurologic or communication impairments. Data were analysed to determine reliability (internal consistency and inter-rater reliability) of the Indonesian version of SYSTEMS-R. Internal consistency was determined using Cronbach’s alpha formula. Internal consistency is a reflection of inter-item correlation and item-to-total correlation. Inter-rater reliability was determined using the Bland-Altman method.Results This study was conducted on 133 children aged 4−15 years in a kindergarten, elementary, junior high, and senior high school in Bandung. The Indonesian version of SYSTEMS-R had significant internal consistency (Cron bach’s alpha 0.936−0.941), and the scores obtained by two raters had good agreement (difference within mean + 1.96 SD).Conclusion The Indonesian version of SYSTEMS-R is reliable for use as a cognitive screening tool for Indonesian children. [Paediatr Indones. 2016;56:149-54.].


2021 ◽  
Vol 9 (9) ◽  
pp. 232596712110383
Author(s):  
Romy Deviandri ◽  
Hugo C. van der Veen ◽  
Andri M.T. Lubis ◽  
Maarten J. Postma ◽  
Inge van den Akker-Scheek

Background: No questionnaire is currently available for use in patients with anterior cruciate ligament (ACL) injuries in an Indonesian population. The most-used questionnaire in clinical research for these patients is the International Knee Documentation Committee (IKDC) Subjective Knee Form, as its psychometric properties are considered to be excellent. Purpose: To translate the IKDC into Indonesian and assess its validity for use in Indonesian-speaking patients with ACL injuries. Study Design: Cohort study (diagnosis); Level of evidence, 2. Methods: After a forward-and-backward translation procedure and cross-cultural adaptation, the validity and reliability of the questionnaire were investigated. The responses of ACL injury patients on 3 questionnaires, the Indonesian-IKDC (I-IKDC), 36-Item Short Form Health Survey, and Kujala Anterior Knee Pain Scale, were compared. Following consensus-based standards for the selection of health measurement instruments guidelines, construct validity, test-retest reliability, internal consistency, floor and ceiling effects, and measurement error were determined. The Bland-Altman method was used to explore absolute agreement. Results: Of 253 ACL injury patients, 106 (42%) responded to the invitation. Construct validity was considered good, as all predefined hypotheses on correlations between the I-IKDC and other scores were confirmed. Reliability proved excellent, with a high test-retest correlation (intraclass correlation coefficient = 0.99). Bland-Altman analyses showed no systematic bias between test and retest. Internal consistency was good (Cronbach α = .90). There were no floor or ceiling effects. Standard error of measurement was 2.1, and the minimal detectable change was 5.8 at the individual level and 0.7 at the group level. Conclusion: The I-IKDC, as developed, appeared to be a good evaluation instrument for Indonesian patients with ACL injuries.


2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Tolulope Adeniji ◽  
Adetoyeje Y. Oyeyemi

Purpose This study aims at translating and adapting a common and widely used proxy rated cognitive screening tool – Informant Questionnaire on Cognitive Decline in the Elderly (IQCODE) into Hausa language and also to evaluate the instrument’s psychometric properties. Design/methodology/approach IQCODE was translated and adapted using a qualitative process involving experts and the adapted version was then evaluated against a gold standard (Diagnostic and Statistical Manual of Mental Disorder V criteria for neurocognitive disorders) with older adults subjects (N = 100), while its reliability (internal consistency) was also evaluated. Descriptive statistics of mean and frequencies, and inferential statistic of receiver operating curve analysis and Cronbach’s alpha coefficient were used for data analysis at an alpha level set at 0.05. Findings The Hausa IQCODE has a sensitivity value of 73.3%, specificity value of 71.8% and optimal cut-off values of between 3.2 and 3.3. For his adapted instrument the area under the Curve (AUC) curve is 0.79 (95% CI: 0.663–0.919; std. err: 0.066; P = 0.000), and Cronbach’s alpha value of 0.819 was obtained indicating that the adapted instrument has good internal consistency. Research limitations/implications The adapted IQCODE is a valid and reliable proxy based cognitive screening tool for the older adult Hausa speakers in Maiduguri. However, clinician and researcher might want to consider different optimal cut-off points when using this tool to screen or to monitor cognitive changes among older adults. Originality/value This research paper translated and adapted Hausa IQCODE into Hausa language. And it gives information on the validity and reliability of the adapted tool alongside with new optimal cut-off for cognitive screening by proxy among older adult patients in Nigeria.


2020 ◽  
Vol 30 (Supplement_2) ◽  
Author(s):  
M Paço ◽  
A Rodrigues ◽  
C Oliveira ◽  
D Carvalho ◽  
J Ferreira ◽  
...  

Abstract Introduction Achilles tendinopathy is considered one of the most frequent injuries in individuals who practice regular physical activity, thus the existence of an instrument that allows the evaluation of the degree of severity of the lesion is important. The VISA-A was developed for English-speaking population to evaluate patients with this condition, and there is a need to adapt this tool to Portuguese (Portugal). Objectives To cross-cultural adapt and validate the VISA-A questionnaire for Portuguese-speaking (Portugal) Achilles tendinopathy patients. Methodology The VISA-A questionnaire was translated and cross-culturally adapted into Portuguese (VISA-A-Por) according to specific guidelines, using six steps: Translation, synthesis, back translation, expert committee review, pretesting (n = 10), and appraisal of the adaptation process. The resulting VISA-A-Por was then subjected to an analysis of the psychometric properties (construct validity, reproducibility [agreement and reliability], internal consistency and floor and ceiling effects) in 57 Achilles tendinopathy patients and 58 asymptomatic people. Participants completed the questionnaire at baseline and after a minimum interval of 48 hours. Results The Visa-A-Por semantic and content validity was considered good by the expert committee and has construct validity shown by the differences between groups (p < 0,001). The questionnaire presented good internal consistency, with a Cronbach α of 0,88. Concerning reproducibility, agreement levels were considered optimal which can be verified in the Bland Altman graph, the standard error measurement (6,49) and the minimally important change (17,99 points), as well as the excellent ICC value (0,88). No ceiling-floor effect was found. Conclusion The VISA-A-Por questionnaire has been shown to be equivalent to the original questionnaire, which indicates that it is a valid and reliable measure for the evaluation of the severity and functional impact of patellar tendinopathy in Portuguese-speaking (Portugal) patients.


Sign in / Sign up

Export Citation Format

Share Document