scholarly journals Automatic detection of mild cognitive impairment from spontaneous speech using ASR

Author(s):  
László Tóth ◽  
Gábor Gosztolya ◽  
Veronika Vincze ◽  
Ildikó Hoffmann ◽  
Gréta Szatlóczki ◽  
...  
2018 ◽  
Vol 15 (2) ◽  
pp. 130-138 ◽  
Author(s):  
Laszlo Toth ◽  
Ildiko Hoffmann ◽  
Gabor Gosztolya ◽  
Veronika Vincze ◽  
Greta Szatloczki ◽  
...  

Background: Even today the reliable diagnosis of the prodromal stages of Alzheimer's disease (AD) remains a great challenge. Our research focuses on the earliest detectable indicators of cognitive decline in mild cognitive impairment (MCI). Since the presence of language impairment has been reported even in the mild stage of AD, the aim of this study is to develop a sensitive neuropsychological screening method which is based on the analysis of spontaneous speech production during performing a memory task. In the future, this can form the basis of an Internet-based interactive screening software for the recognition of MCI. Methods: Participants were 38 healthy controls and 48 clinically diagnosed MCI patients. The provoked spontaneous speech by asking the patients to recall the content of 2 short black and white films (one direct, one delayed), and by answering one question. Acoustic parameters (hesitation ratio, speech tempo, length and number of silent and filled pauses, length of utterance) were extracted from the recorded speech signals, first manually (using the Praat software), and then automatically, with an automatic speech recognition (ASR) based tool. First, the extracted parameters were statistically analyzed. Then we applied machine learning algorithms to see whether the MCI and the control group can be discriminated automatically based on the acoustic features. Results: The statistical analysis showed significant differences for most of the acoustic parameters (speech tempo, articulation rate, silent pause, hesitation ratio, length of utterance, pause-per-utterance ratio). The most significant differences between the two groups were found in the speech tempo in the delayed recall task, and in the number of pauses for the question-answering task. The fully automated version of the analysis process – that is, using the ASR-based features in combination with machine learning - was able to separate the two classes with an F1-score of 78.8%. Conclusion: The temporal analysis of spontaneous speech can be exploited in implementing a new, automatic detection-based tool for screening MCI for the community.


2019 ◽  
Vol 53 ◽  
pp. 181-197 ◽  
Author(s):  
Gábor Gosztolya ◽  
Veronika Vincze ◽  
László Tóth ◽  
Magdolna Pákáski ◽  
János Kálmán ◽  
...  

2021 ◽  
pp. 1-34
Author(s):  
Veronika Vincze ◽  
Martina Katalin Szabó ◽  
Ildikó Hoffmann ◽  
László Tóth ◽  
Magdolna Pákáski ◽  
...  

Abstract In this paper, we seek to automatically identify Hungarian patients suffering from mild cognitive impairment (MCI) or mild Alzheimer’s Disease (mAD) based on their speech transcripts, focusing only on linguistic features. In addition to the features examined in our earlier study, we introduce syntactic, semantic and pragmatic features of spontaneous speech that might affect the detection of dementia. In order to ascertain the most useful features for distinguishing healthy controls, MCI patients and mAD patients, we will carry out a statistical analysis of the data and investigate the significance level of the extracted features among various speaker group pairs and for various speaking tasks. In the second part of the paper, we use this rich feature set as a basis for an effective discrimination among the three speaker groups. In our machine learning experiments, we will analyze the efficacy of each feature group separately. Our model which uses all the features achieves competitive scores, either with or without demographic information (3-class accuracy values: 68–70%, 2-class accuracy values: 77.3–80%). We also analyze how different data recording scenarios affect linguistic features and how they can be productively used when distinguishing MCI patients from healthy controls.


Author(s):  
Gábor Gosztolya ◽  
László Tóth ◽  
Tamás Grósz ◽  
Veronika Vincze ◽  
Ildikó Hoffmann ◽  
...  

2016 ◽  
Vol 8 (4) ◽  
pp. 437-451 ◽  
Author(s):  
Ahmad Akl ◽  
Belkacem Chikhaoui ◽  
Nora Mattek ◽  
Jeffrey Kaye ◽  
Daniel Austin ◽  
...  

Sign in / Sign up

Export Citation Format

Share Document