scholarly journals Automated scoring of the Rey-Osterrieth Complex Figure Test using a deep-learning algorithm

2019 ◽  
Vol 34 (6) ◽  
pp. 836-836 ◽  
Author(s):  
J Vogt ◽  
H Kloosterman ◽  
S Vermeent ◽  
G Van Elswijk ◽  
R Dotsch ◽  
...  

Abstract Objective To validate a fully automated scoring algorithm for the Rey-Osterrieth Complex Figure Test (ROCFT) by comparing the scoring results of the algorithm to the results of human raters. Method The algorithm consisted of a cascade of deep neural networks which were trained on human rater scores to extract the 18 segments of the figure, and to quantify the patient’s performance. Algorithm results were compared to six expert raters for 303 drawings. We tested whether the average correlation between algorithm scores and scores by all human raters was equivalent to the average inter-rater correlation (with equality bound Δr < .05). The immediate and delayed recall trial were used; the copy trial showed a strong ceiling effect. Results The mean Pearson correlation between raters was .94 (SD = 0.01). The correlation between to algorithm and the raters was .88 (SD = 0.02). A two-one-sided t-tests (TOST) equivalence test showed that these correlations were not strictly equivalent, t(5) = 4.02, p = .995, 95% CI [0.35, 0.52]. Conclusions Although not strictly equivalent to human ratings, the algorithm’s performance is high, approaching a level of reliability found among human raters. We expect that improved individual segment detection will bring the algorithm scoring accuracy on par with that of human raters. Algorithmic scoring of the ROCFT will likely save valuable time and lead to higher levels of standardization in clinical practice.

2020 ◽  
Vol 10 (2) ◽  
pp. 25 ◽  
Author(s):  
Agostino Chiaravalloti ◽  
Maria Ricci ◽  
Daniele Di Biagio ◽  
Luca Filippi ◽  
Alessandro Martorana ◽  
...  

Background: The study aimed to investigate the relationships between F-18 fluorodeoxyglucose (18F)FDG uptake and neuropsychological assessment in Alzheimer’s disease (AD). Methods: We evaluated 116 subjects with AD according to the NINCDS-ADRDA criteria. All the subjects underwent a brain PET/CT with (18F)FDG, cerebrospinal fluid (CSF) assay, mini-mental state examination (MMSE) and further neuropsychological tests: Rey auditory verbal learning test, immediate recall (RAVLT immediate); Rey auditory verbal learning test, delayed recall (RAVLT, delayed); Rey complex figure test, copy (RCFT, copy); Rey complex figure test, delayed recall (RCFT, delayed); Raven’s colored progressive matrices (RCPM); phonological word fluency test (PWF) and Stroop test. We performed the statistical analysis by using statistical parametric mapping (SPM12; Wellcome Department of Cognitive Neurology, London, UK). Results: A significant relationship has been reported between (18F)FDG uptake and RAVLT immediate test in Brodmann area (BA)37 and BA22 and with RCFT, copy in BA40, and BA7. We did not find any significant relationships with other tests. Conclusion: In the AD population, brain (18F)FDG uptake is moderately related to the neuropsychological assessment, suggesting a limited impact on statistical data analysis of glucose brain metabolism.


Author(s):  
Selene G Vicente ◽  
Daniela Ramos-Usuga ◽  
Fernando Barbosa ◽  
Nuno Gaspar ◽  
Artemisa R Dores ◽  
...  

Abstract Objective The principal goal of this study was to produce adjusted normative data for European Portuguese native speakers from Portugal on 2 neuropsychological tests widely used to assess learning and memory: the Hopkins Verbal Learning Test-Revised (HVLT-R) and the Rey–Osterrieth Complex Figure Test (ROCF). Method The study included 300 individuals aged 18–92 years (M = 50.4, SD = 21.2), who had educational backgrounds ranging from 3 to 25 years (M = 10.4, SD = 5.2). Results Age, education, and sex were significantly associated with HVLT-R and ROCF performance. These demographic variables accounted for 61% of the variance in HVLT-R total recall, 54% in HVLT-R delayed recall, 18% in HVLT-R recognition, 55% in ROCF copy, and 39% in ROCF immediate recall. Conclusions The normative data are presented as regression-based algorithms to adjust direct and derived test scores for age, education, and sex. This study provides a calculator of normative data derived from the results of the regression models.


2020 ◽  
Vol 35 (6) ◽  
pp. 833-833
Author(s):  
Kiselev S

Abstract Objectives It was known that children with attention deficit (AD) have also weakness in working memory. In our previous research we have revealed that ADHD children have deficit in visual and verbal memory in delayed recall condition in comparison to immediate condition (Kiselev, 2018). The goal of this research was to examine the hypothesis that preschool children with AD have a deficit in reproducing the Rey-Osterrieth Complex Figure in delayed recall condition. Methods The experimental group included 13 children with AD at the age of 5-6 years. The control group included 13 typically developing children. The children from groups were matched for IQ, gender and age. Children from both groups were assessed with Rey–Osterrieth complex figure test (ROCF). This test is designed to assess reproducing the complex figure in immediate and delayed recall conditions. ANOVA with repeated measures was used to reveal group differences in reproducing the figure in two conditions. Results We have not revealed significant differences between children from experimental and control group in reproducing the figure in immediate condition. However, the interaction of condition type and group was significant (p &lt; .05). Children with AD had weakness in the accurate reproduction and placement of specific design elements of Rey-Osterieth Complex Figure in Delayed Recall condition. Conclusions In view of our previously received results in children with attention deficit, we can propose that deficit in memory in delayed recall condition can be one of the key symptoms in this disorder.


Author(s):  
Eva Calderón-Rubio ◽  
Javier Oltra-Cucarella ◽  
Beatriz Bonete-López ◽  
Clara Iñesta ◽  
Esther Sitges-Maciá

The aim of this work was to develop normative data for neuropsychological tests for the assessment of independent and cognitively active Spanish older adults over 55 years of age. Methods: regression-based normative data were calculated from a sample of 103 nondepressed independent community-dwelling adults aged 55 or older (66% women). The raw data for the Free and Cued Selective Reminding Test (FCSRT), the Rey–Osterrieth Complex Figure Test (ROCF) and the Judgement of Line Orientation Test (JLO) were regressed on age, sex and education. The model predicting the FCSRT delayed-recall (FCSRT-Del) scores also included the FCSRT immediate-recall (FCSRT-Imm) scores. The model predicting the ROCF immediate-recall (ROCF-Imm) scores included the ROCF copy-trial (ROCF-C) scores, and the model predicting the ROCF delayed-recall (ROCF-Del) scores included both the ROCF-C and the ROCF-Imm scores. In order to identify low scores, z-scores were used to determine the discrepancy between the observed and the predicted scores. The base rates of the low scores for both the SABIEX normative data and the published normative data obtained from the general population were compared. Results: the effects of the different sociodemographic variables (age, sex and education) varied throughout the neuropsychological measures. Despite finding similar proportions of low scores between the normative data sets, the agreement was irrelevant or only fair-to-good. Conclusions: the normative data obtained from the general population might not be sensitive enough to identify low scores in cognitively active older adults, incorrectly classifying them as cognitively normal compared to the less active population.


2009 ◽  
Vol 3 (1) ◽  
pp. 27-33 ◽  
Author(s):  
Jesângeli Sousa Dias ◽  
Amanda M. Lacerda ◽  
Rodrigo M. Vieira-de-Melo ◽  
Leila C. Viana ◽  
Pedro A.P. Jesus ◽  
...  

Abstract Chagas disease (CD) remains a major cause of stroke in developing countries, but cognitive repercussion of CD has not been well studied. Objective: To compare the frequency and pattern of cognitive dysfunction in patients with CD cardiomyopathy (CDC) and other cardiomyopathies (OC). Methods: We studied 37 patients with CDC and 42 patients with OC with similar age, educational level and cardiac systolic function. Cognitive tests were applied to both groups by a single examiner blinded to CD status. Logistic regression multivariable models were constructed to ascertain predictors of cognitive dysfunction for each test. Results: Cognitive dysfunction was detected in 9 (24%) CDC patients and 6 (14%) OC patients by Mini Mental State Exam (MMSE) corrected for educational level. Independent predictors of abnormal MMSE (p <0.05) included stroke history (OR=5.51; 95% CI=1.27-24.01) and digoxin use (OR=0.23, 95% CI=0.06-0.89), while CD showed a trend toward statistical significance (OR=4.63; 95% CI=0.87-24.73, p =0.07). Delayed recall of Rey's Complex Figure Test was significantly worse in CD patients, where this remained a significant predictor in the multivariable analysis (OR=4.67; 95% CI=1.23-17.68). Conclusions: Cognitive dysfunction is frequent in Chagas disease and should be considered as an outcome measure in Chagas disease studies.


2021 ◽  
Vol 15 (4) ◽  
pp. 5-14
Author(s):  
Dmitry Yu. Lagoda ◽  
Larisa A. Dobrynina ◽  
Natalya A. Suponeva ◽  
Ilya S. Bakulin ◽  
Alexandra G. Poydasheva ◽  
...  

Introduction. Mild cognitive impairment (MCI) negatively affects patients quality of life and is a risk factor for dementia. One of the main causes of MCI is cerebral small vessel disease (CSVD). The previously established link between decreased activity in the supplementary motor area (SMA) and cognitive impairment in patients with CSVD makes it possible to consider repetitive transcranial magnetic stimulation (rTMS) of the SMA with functional magnetic resonance imaging (fMRI)-assisted positioning as a promising method for treating MCI caused by CSVD. The aim of the study was to evaluate the efficacy and tolerability of fMRI-guided rTMS of the SMA in patients with MCI caused by CSVD. Materials and methods. Twenty patients were randomly assigned to the intervention (SMA stimulation; n = 10) and the control (vertex stimulation; n = 10) groups. All patients underwent 10 sessions of high-frequency rTMS. The MoCA scale, trail making test, Tower of London test, and copying and delayed recall in the ReyOsterrieth complex figure test were used to assess treatment effect. Testing was conducted before, immediately after and 3 months post rTMS. Results. The intervention group demonstrated a significant improvement in the MoCA, the Tower of London test and delayed recall in the ReyOsterrieth complex figure test immediately after rTMS. Statistically significant improvement in the MoCA and the Tower of London test results was maintained after 3 months. No statistically significant improvements were found in the control group. Groups were comparable in the incidence of headache during and in the 24-hour period after the stimulation session, and in unpleasant sensations during the session. Conclusion. fMRI-guided rTMS of the SMA is an effective and promising treatment method for MCI caused by CSVD, with effects lasting three or more months, and good tolerability.


2004 ◽  
Vol 15 (2) ◽  
pp. 81-90 ◽  
Author(s):  
Thomas Merten ◽  
Matthias Henry ◽  
Robin Hilsabeck

Zusammenfassung: In der neuropsychologischen Diagnostik, mehr noch aber in der Begutachtung gewinnen Symptomvalidierungstests (SVT) zur Untersuchung der Leistungsmotivation zunehmend an Bedeutung. In einer Analogstudie wurde die Güte zweier international bekannter Verfahren (Word Memory Test; Amsterdam Short Term Memory Test) sowie einer Neuentwicklung (Word Completion Memory Test) untersucht. Zusätzlich wurden Leistungstests eingesetzt: der Trail Making Test (TMT), der Complex Figure Test sowie die Standard Progressive Matrices (SPM). Eine Gruppe von 10 experimentellen Simulanten wurde spezifisch auf die Vortäuschung von Gedächtnisstörungen vorbereitet, während eine Kontrollgruppe (n = 10) optimale Testanstrengung zeigen sollte. Alle SVT führten im Gegensatz zu den Simulationsmarkern des TMT und der SPM zu einer ausgezeichneten Klassifikationsgüte (95-100 %). Die neuropsychologischen Leistungsmaße wiesen zwar signifikante Gruppenunterschiede aus, zeigten aber auch eine nicht unbedeutende Überlappung der Verteilungen. Mehr Studien sind notwendig, um den SVT in den deutschsprachigen Ländern den Platz zu sichern, den sie international aktuell in der klinisch-neuropsychologischen Forschung und Praxis einnehmen.


Sign in / Sign up

Export Citation Format

Share Document