scholarly journals Automatic Diagnosis of Alzheimer’s Disease Using Neural Network Language Models

2019 ◽  
Author(s):  
Julian Fritsch ◽  
Sebastian Wankerl ◽  
Elmar Noth
Keyword(s):  
Neural Network ◽  
Alzheimer’S Disease ◽  
Alzheimer's Disease ◽  
Language Models ◽  
Automatic Diagnosis ◽  
Network Language

scholarly journals Transformer-based deep neural network language models for Alzheimer’s disease detection from targeted speech

2020 ◽  
Author(s):  
Alireza Roshanzamir ◽  
Hamid Aghajan ◽  
Mahdieh Soleymani Baghshah
Keyword(s):  
Alzheimer’S Disease ◽  
Alzheimer's Disease ◽  
Natural Language ◽  
Language Processing ◽  
Language Model ◽  
Large Datasets ◽  
Language Models ◽  
Classification Model ◽  
Picture Description ◽  
Network Language

Abstract Background: We developed transformer-based deep learning models based on natural language processing for early diagnosis of Alzheimer’s disease from the picture description test.Methods: The lack of large datasets poses the most important limitation for using complex models that do not require feature engineering. Transformer-based pre-trained deep language models have recently made a large leap in NLP research and application. These models are pre-trained on available large datasets to understand natural language texts appropriately, and are shown to subsequently perform well on classification tasks with small training sets. The overall classification model is a simple classifier on top of the pre-trained deep language model.Results: The models are evaluated on picture description test transcripts of the Pitt corpus, which contains data of 170 AD patients with 257 interviews and 99 healthy controls with 243 interviews. The large bidirectional encoder representations from transformers (BERTLarge) embedding with logistic regression classifier achieves classification accuracy of 88.08%, which improves thestate-of-the-art by 2.48%.Conclusions: Using pre-trained language models can improve AD prediction. This not only solves the problem of lack of sufficiently large datasets, but also reduces the need for expert-defined features.

scholarly journals Transformer-Based Deep Neural Network Language Models for Alzheimer's Disease Detection from Targeted Speech

2020 ◽  
Author(s):  
Alireza Roshanzamir ◽  
Hamid Aghajan ◽  
Mahdieh Soleymani Baghshah
Keyword(s):  
Alzheimer’S Disease ◽  
Alzheimer's Disease ◽  
Natural Language ◽  
Language Processing ◽  
Large Datasets ◽  
Language Models ◽  
Classification Model ◽  
Complex Models ◽  
Picture Description ◽  
Network Language

Abstract Background: We developed transformer-based deep learning models based on natural language processing for early diagnosis of Alzheimer’s disease from the picture description test.Methods: The lack of large datasets poses the most important limitation for using complex models that do not require feature engineering. Transformer-based pre-trained deep language models have recently made a large leap in NLP research and application. These models are pre-trained on available large datasets to understand natural language texts appropriately, and are shown to subsequently perform well on classification tasks with small training sets. The overall classification model is a simple classifier on top of the pre-trained deep language model.Results: The models are evaluated on picture description test transcripts of the Pitt corpus, which contains data of 170 AD patients with 257 interviews and 99 healthy controls with 243 interviews. The large bidirectional encoder representations from transformers (BERTLarge) embedding with logistic regression classifier achieves classification accuracy of 88.08%, which improves the state-of-the-art by 2.48%.Conclusions: Using pre-trained language models can improve AD prediction. This not only solves the problem of lack of sufficiently large datasets, but also reduces the need for expert-defined features.

scholarly journals Early Detection of Alzheimer’s Disease Using Polar Harmonic Transforms and Optimized Wavelet Neural Network

2021 ◽  
Vol 11 (4) ◽  
pp. 1574
Author(s):  
Shabana Urooj ◽  
Satya P. Singh ◽  
Areej Malibari ◽  
Fadwa Alrowais ◽  
Shaeen Kalathil
Keyword(s):  
Neural Network ◽  
Alzheimer’S Disease ◽  
Alzheimer's Disease ◽  
Early Detection ◽  
Differential Evolution ◽  
Early Stage ◽  
Selection Process ◽  
Parameter Tuning ◽  
Wavelet Neural Network ◽  
Tuning Parameter

Effective and accurate diagnosis of Alzheimer’s disease (AD), as well as early-stage detection, has gained more and more attention in recent years. For AD classification, we propose a new hybrid method for early detection of Alzheimer’s disease (AD) using Polar Harmonic Transforms (PHT) and Self-adaptive Differential Evolution Wavelet Neural Network (SaDE-WNN). The orthogonal moments are used for feature extraction from the grey matter tissues of structural Magnetic Resonance Imaging (MRI) data. Irrelevant features are removed by the feature selection process through evaluating the in-class and among-class variance. In recent years, WNNs have gained attention in classification tasks; however, they suffer from the problem of initial parameter tuning, parameter setting. We proposed a WNN with the self-adaptation technique for controlling the Differential Evolution (DE) parameters, i.e., the mutation scale factor (F) and the cross-over rate (CR). Experimental results on the Alzheimer’s disease Neuroimaging Initiative (ADNI) database indicate that the proposed method yields the best overall classification results between AD and mild cognitive impairment (MCI) (93.7% accuracy, 86.0% sensitivity, 98.0% specificity, and 0.97 area under the curve (AUC)), MCI and healthy control (HC) (92.9% accuracy, 95.2% sensitivity, 88.9% specificity, and 0.98 AUC), and AD and HC (94.4% accuracy, 88.7% sensitivity, 98.9% specificity and 0.99 AUC).

scholarly journals Efficient Embedded Decoding of Neural Network Language Models in a Machine Translation System

2018 ◽  
Vol 28 (09) ◽  
pp. 1850007
Author(s):  
Francisco Zamora-Martinez ◽  
Maria Jose Castro-Bleda
Keyword(s):  
Neural Network ◽  
Machine Translation ◽  
Language Processing ◽  
Traditional Approach ◽  
Computational Cost ◽  
Integrated Approach ◽  
Language Models ◽  
Translation System ◽  
Neural Net ◽  
Network Language

Neural Network Language Models (NNLMs) are a successful approach to Natural Language Processing tasks, such as Machine Translation. We introduce in this work a Statistical Machine Translation (SMT) system which fully integrates NNLMs in the decoding stage, breaking the traditional approach based on [Formula: see text]-best list rescoring. The neural net models (both language models (LMs) and translation models) are fully coupled in the decoding stage, allowing to more strongly influence the translation quality. Computational issues were solved by using a novel idea based on memorization and smoothing of the softmax constants to avoid their computation, which introduces a trade-off between LM quality and computational cost. These ideas were studied in a machine translation task with different combinations of neural networks used both as translation models and as target LMs, comparing phrase-based and [Formula: see text]-gram-based systems, showing that the integrated approach seems more promising for [Formula: see text]-gram-based systems, even with nonfull-quality NNLMs.

Sign in / Sign up

Export Citation Format

Share Document