Automated scoring of a neuropsychological test: the Rey Osterrieth complex figure

Author(s):  
R.O. Canham ◽  
S.L. Smith ◽  
A.M. Tyrrell
2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Marco A. Petilli ◽  
Roberta Daini ◽  
Francesca Lea Saibene ◽  
Marco Rabuffetti

AbstractAccuracy in copying a figure is one of the most sensitive measures of visuo-constructional ability. However, drawing tasks also involve other cognitive and motor abilities, which may influence the final graphic produced. Nevertheless, these aspects are not taken into account in conventional scoring methodologies. In this study, we have implemented a novel Tablet-based assessment, acquiring data and information for the entire execution of the Rey Complex Figure copy task (T-RCF). This system extracts 12 indices capturing various dimensions of drawing abilities. We have also analysed the structure of relationships between these indices and provided insights into the constructs that they capture. 102 healthy adults completed the T-RCF. A subgroup of 35 participants also completed a paper-and-pencil drawing battery from which constructional, procedural, and motor measures were obtained. Principal component analysis of the T-RCF indices was performed, identifying spatial, procedural and kinematic components as distinct dimensions of drawing execution. Accordingly, a composite score for each dimension was determined. Correlational analyses provided indications of their validity by showing that spatial, procedural, and kinematic scores were associated with constructional, organisational and motor measures of drawing, respectively. Importantly, final copy accuracy was found to be associated with all of these aspects of drawing. In conclusion, copying complex figures entails an interplay of multiple functions. T-RCF provides a unique opportunity to analyse the entire drawing process and to extract scores for three critical dimensions of drawing execution.


Author(s):  
Jacob Stålhammar ◽  
Per Hellström ◽  
Carl Eckerström ◽  
Anders Wallin

Abstract Objective We aimed to study second language effects on neuropsychological (NP) test performance. Method We administered an NP test battery in Swedish to 322 healthy community dwelling participants, recruited through the Gothenburg Pilot phase of the Swedish CArdioPulmonary BioImage Study (SCAPIS Pilot). All participants were conversationally fluent Swedish speakers (237 native, 85 non-native, mean age 61.1 years). We compared the NP scores of native and non-native participants. We also investigated the influence of (a) age of arrival to Sweden, (b) majority language family of the birth country, and (c) proficiency in Swedish as assessed with a 30 item Boston naming test (BNT). Results Native speakers obtained better results on all NP tasks with a verbal component, whereas no significant differences were seen on completely nonverbal tasks (Rey complex figure). For non-native speakers, lower age at arrival to Sweden, arrival from a country where Swedish was also spoken, or arrival from a country with a majority language closer to Swedish, were all linked to better NP scores. Dichotomizing by BNT showed that normally-to-highly proficient non-native speakers obtained better scores. Conclusions Second language effects may contribute to misclassification of non-native speakers. Assumptions of fluency based on short conversations may be misleading. A proficiency assessment with BNT may improve NP score interpretation among non-native speakers.


2019 ◽  
Vol 34 (6) ◽  
pp. 836-836 ◽  
Author(s):  
J Vogt ◽  
H Kloosterman ◽  
S Vermeent ◽  
G Van Elswijk ◽  
R Dotsch ◽  
...  

Abstract Objective To validate a fully automated scoring algorithm for the Rey-Osterrieth Complex Figure Test (ROCFT) by comparing the scoring results of the algorithm to the results of human raters. Method The algorithm consisted of a cascade of deep neural networks which were trained on human rater scores to extract the 18 segments of the figure, and to quantify the patient’s performance. Algorithm results were compared to six expert raters for 303 drawings. We tested whether the average correlation between algorithm scores and scores by all human raters was equivalent to the average inter-rater correlation (with equality bound Δr < .05). The immediate and delayed recall trial were used; the copy trial showed a strong ceiling effect. Results The mean Pearson correlation between raters was .94 (SD = 0.01). The correlation between to algorithm and the raters was .88 (SD = 0.02). A two-one-sided t-tests (TOST) equivalence test showed that these correlations were not strictly equivalent, t(5) = 4.02, p = .995, 95% CI [0.35, 0.52]. Conclusions Although not strictly equivalent to human ratings, the algorithm’s performance is high, approaching a level of reliability found among human raters. We expect that improved individual segment detection will bring the algorithm scoring accuracy on par with that of human raters. Algorithmic scoring of the ROCFT will likely save valuable time and lead to higher levels of standardization in clinical practice.


2021 ◽  
Author(s):  
Sam S. Webb ◽  
Margaret Jane Moore ◽  
Anna Yamshchikova ◽  
Valeska Kozik ◽  
Mihaela D. Duta ◽  
...  

2020 ◽  
Author(s):  
Young Chul Youn ◽  
Jung-Min Pyun ◽  
Nayoung Ryu ◽  
Min Jae Baek ◽  
Jae-Won Jang ◽  
...  

Abstract Background: The Clock Drawing Test (CDT) and Rey–Osterrieth Complex Figure Test (RCFT) are widely used as a part of neuropsychological test batteries to assess cognitive function. Our objective was to confirm the prediction accuracies of the RCFT-copy and CDT for cognitive impairment (CI) using the convolutional neural network (CNN) algorithm as a screening tool. Methods: The CDT and RCFT-copy data were obtained from patients aged 60 to 80 years who had more than 6 years of education. In total, 747 CDT and 980 RCFT-copy figures were utilized. CNN algorithms using TensorFlow (ver. 2.3.0) on the Colab cloud platform (www.colab.research.google.com) were used for preprocessing and modeling. We measured the prediction accuracy of each drawing test 10 times using this dataset: normal cognition (NC) vs. mild impairment of cognition (MI), NC vs. severely impaired cognition (SI), and NC vs. CI (MI +SI). Results: The accuracy of the CDT was better for differentiating MI (CDT: 78.04±2.75, RCFT-copy: not being trained) and SI from NC (CDT: 91.45±0.83, RCFT-copy: 90.27±1.52); however, the RCFT-copy was better at predicting CI (CDT: 77.37±1.77, RCFT: 83.52±1.41). The accuracy for 3-way classification (NC vs. MI vs. SI) was approximately 71% for both tests; no significant difference was found.Conclusions: The two drawing tests showed good performance for predicting severe impairment of cognition; however, a drawing test alone is not enough to predict overall CI. There are some limitations to our study: the sample size was small, all participants did not perform both the CDT and RCFT-copy, and only the copy condition of the RCFT was used. Algorithms involving memory performance and longitudinal changes are worth future exploration. These results may contribute to improved home-based healthcare delivery.


Author(s):  
S. J. Pennycook

Using a high-angle annular detector on a high-resolution STEM it is possible to form incoherent images of a crystal lattice characterized by strong atomic number or Z contrast. Figure 1 shows an epitaxial Ge film on Si(100) grown by oxidation of Ge-implanted Si. The image was obtained using a VG Microscopes' HB501 STEM equipped with an ultrahigh resolution polepiece (Cs ∽1.2 mm, demonstrated probe FWHM intensity ∽0.22 nm). In both crystals the lattice is resolved but that of Ge shows much brighter allowing the interface to be located exactly and interface steps to be resolved (arrowed). The interface was indistinguishable in the phase-contrast STEM image from the same region, and even at higher resolution the location of the interface is complex. Figure 2 shows a thin region of an MBE-grown ultrathin super-lattice (Si8Ge2)100. The expected compositional modulation would show as one bright row of dots from the 2 Ge monolayers separated by 4 rows of lighter Si columns. The image shows clearly that strain-induced interdiffusion has occurred on the monolayer scale.


2016 ◽  
Vol 27 (4) ◽  
pp. 257-264 ◽  
Author(s):  
Johannes H. Scheidemann ◽  
Franz Petermann ◽  
Marc Schipper

Abstract. We investigated theory of mind (ToM) deficits in Alzheimer‘s disease (AD) and its possible connection to autobiographical memory (ABM). Patients and matched controls were evaluated and compared using a video-based ToM test, an autobiographical fluency task, and a neuropsychological test battery. We found that ToM deficits were positively associated with semantic ABM in the clinical group, whereas a positive relationship appeared between ToM and episodic ABM in controls. We hypothesize that this reflects the course of the disease as well as that semantic ABM is used for ToM processing, being still accessible in AD. Furthermore, we assume that it is also less efficient, which in turn leads to a specific deficit profile of social cognition.


2015 ◽  
Vol 26 (1) ◽  
pp. 35-50 ◽  
Author(s):  
Sara C. Schroeder ◽  
Ronald M. Ruff ◽  
Lutz Jäncke

The aim of this study was to examine the effect of posttraumatic stress disorder (PTSD) on (a) neuropsychological test performance and (b) self-reported emotional complaints within individuals suffering from postconcussional disorder (PCD) after a mild traumatic brain injury (MTBI). A two-group comparative research design was employed. Two MTBI samples with and without PTSD were assessed with a neuropsychological test battery and the Ruff Neurobehavioral Inventory (RNBI). On the neurocognitive test performances no significant between group differences were found, but the MTBI group with PTSD endorsed a significantly greater number of emotional complaints, especially in the RNBI subscales of anxiety and depression. The patients with PTSD also endorsed a significantly greater number of premorbid sequelae in the RNBI emotional composite scale as well as the RNBI premorbid subscales of pain, anxiety and abuse. In sum, PTSD has a negative impact on emotional but not cognitive functioning within individuals suffering from PCD after a mild TBI.


2004 ◽  
Vol 15 (2) ◽  
pp. 81-90 ◽  
Author(s):  
Thomas Merten ◽  
Matthias Henry ◽  
Robin Hilsabeck

Zusammenfassung: In der neuropsychologischen Diagnostik, mehr noch aber in der Begutachtung gewinnen Symptomvalidierungstests (SVT) zur Untersuchung der Leistungsmotivation zunehmend an Bedeutung. In einer Analogstudie wurde die Güte zweier international bekannter Verfahren (Word Memory Test; Amsterdam Short Term Memory Test) sowie einer Neuentwicklung (Word Completion Memory Test) untersucht. Zusätzlich wurden Leistungstests eingesetzt: der Trail Making Test (TMT), der Complex Figure Test sowie die Standard Progressive Matrices (SPM). Eine Gruppe von 10 experimentellen Simulanten wurde spezifisch auf die Vortäuschung von Gedächtnisstörungen vorbereitet, während eine Kontrollgruppe (n = 10) optimale Testanstrengung zeigen sollte. Alle SVT führten im Gegensatz zu den Simulationsmarkern des TMT und der SPM zu einer ausgezeichneten Klassifikationsgüte (95-100 %). Die neuropsychologischen Leistungsmaße wiesen zwar signifikante Gruppenunterschiede aus, zeigten aber auch eine nicht unbedeutende Überlappung der Verteilungen. Mehr Studien sind notwendig, um den SVT in den deutschsprachigen Ländern den Platz zu sichern, den sie international aktuell in der klinisch-neuropsychologischen Forschung und Praxis einnehmen.


Sign in / Sign up

Export Citation Format

Share Document