205. Deep Learning Approaches to Unimodal and Multimodal Analysis of Brain Imaging Data With Applications to Mental Illness

2018 ◽  
Vol 83 (9) ◽  
pp. S82-S83
Author(s):  
Vince Calhoun ◽  
Sergey Plis
Keyword(s):  
Mental Illness ◽  
Deep Learning ◽  
Brain Imaging ◽  
Learning Approaches ◽  
Imaging Data ◽  
Multimodal Analysis ◽  
Brain Imaging Data

scholarly journals Visual Explanation for Identification of the Brain Bases for Developmental Dyslexia on fMRI Data

2021 ◽  
Vol 15 ◽  
Author(s):  
Laura Tomaz Da Silva ◽  
Nathalia Bianchini Esper ◽  
Duncan D. Ruiz ◽  
Felipe Meneguzzi ◽  
Augusto Buchweitz
Keyword(s):  
Deep Learning ◽  
Brain Imaging ◽  
Developmental Dyslexia ◽  
Brain Regions ◽  
Data Sets ◽  
Learning Approaches ◽  
Imaging Data ◽  
Learning Techniques ◽  
Brain Imaging Data

Problem: Brain imaging studies of mental health and neurodevelopmental disorders have recently included machine learning approaches to identify patients based solely on their brain activation. The goal is to identify brain-related features that generalize from smaller samples of data to larger ones; in the case of neurodevelopmental disorders, finding these patterns can help understand differences in brain function and development that underpin early signs of risk for developmental dyslexia. The success of machine learning classification algorithms on neurofunctional data has been limited to typically homogeneous data sets of few dozens of participants. More recently, larger brain imaging data sets have allowed for deep learning techniques to classify brain states and clinical groups solely from neurofunctional features. Indeed, deep learning techniques can provide helpful tools for classification in healthcare applications, including classification of structural 3D brain images. The adoption of deep learning approaches allows for incremental improvements in classification performance of larger functional brain imaging data sets, but still lacks diagnostic insights about the underlying brain mechanisms associated with disorders; moreover, a related challenge involves providing more clinically-relevant explanations from the neural features that inform classification.Methods: We target this challenge by leveraging two network visualization techniques in convolutional neural network layers responsible for learning high-level features. Using such techniques, we are able to provide meaningful images for expert-backed insights into the condition being classified. We address this challenge using a dataset that includes children diagnosed with developmental dyslexia, and typical reader children.Results: Our results show accurate classification of developmental dyslexia (94.8%) from the brain imaging alone, while providing automatic visualizations of the features involved that match contemporary neuroscientific knowledge (brain regions involved in the reading process for the dyslexic reader group and brain regions associated with strategic control and attention processes for the typical reader group).Conclusions: Our visual explanations of deep learning models turn the accurate yet opaque conclusions from the models into evidence to the condition being studied.

scholarly journals Hype versus hope: Deep learning encodes more predictive and robust brain imaging representations than standard machine learning

2020 ◽  
Author(s):  
Anees Abrol ◽  
Zening Fu ◽  
Mustafa Salman ◽  
Rogers Silva ◽  
Yuhui Du ◽  
...  
Keyword(s):  
Machine Learning ◽  
Deep Learning ◽  
Brain Imaging ◽  
Large Scale ◽  
Representation Learning ◽  
Training Sample ◽  
Superior Performance ◽  
Computational Time ◽  
Imaging Data ◽  
Brain Imaging Data

AbstractPrevious successes of deep learning (DL) approaches on several complex tasks have hugely inflated expectations of their power to learn subtle properties of complex brain imaging data, and scale to large datasets. Perhaps as a reaction to this inflation, recent critical commentaries unfavorably compare DL with standard machine learning (SML) approaches for the analysis of brain imaging data. Yet, their conclusions are based on pre-engineered features which deprives DL of its main advantage: representation learning. Here we evaluate this and show the importance of representation learning for DL performance on brain imaging data. We report our findings from a large-scale systematic comparison of SML approaches versus DL profiled in a ten-way age and gender-based classification task on 12,314 structural MRI images. Results show that DL methods, if implemented and trained following the prevalent DL practices, have the potential to substantially improve compared to SML approaches. We also show that DL approaches scale particularly well presenting a lower asymptotic complexity in relative computational time, despite being more complex. Our analysis reveals that the performance improvement saturates as the training sample size grows, but shows significantly higher performance throughout. We also show evidence that the superior performance of DL is primarily due to the excellent representation learning capabilities and that SML methods can perform equally well when operating on representations produced by the trained DL models. Finally, we demonstrate that DL embeddings span a comprehensible projection spectrum and that DL consistently localizes discriminative brain biomarkers, providing an example of the robustness of prediction relevance estimates. Our findings highlight the presence of non-linearities in brain imaging data that DL frameworks can exploit to generate superior predictive representations for characterizing the human brain, even with currently available data sizes.

scholarly journals The Open Brain Consent : Informing research participants and obtaining consent to share brain imaging data

2021 ◽  
Author(s):  
Elise Bannier ◽  
Gareth Barker ◽  
Valentina Borghesani ◽  
Nils Broeckx ◽  
Patricia Clement ◽  
...  
Keyword(s):  
Brain Imaging ◽  
Imaging Data ◽  
Research Participants ◽  
Brain Imaging Data

Learning from Enhanced Contextual Similarity in Brain Imaging Data for Classification of Schizophrenia

2017 ◽  
pp. 265-275 ◽  
Author(s):  
Tewodros Mulugeta Dagnew ◽  
Letizia Squarcina ◽  
Massimo W. Rivolta ◽  
Paolo Brambilla ◽  
Roberto Sassi
Keyword(s):  
Brain Imaging ◽  
Imaging Data ◽  
Brain Imaging Data

scholarly journals Chronic subdural hematomas: challenges and solutions. Part I. Clinical variants and diagnosis

2021 ◽  
Vol 2 (2) ◽  
pp. 21-27
Author(s):  
Leonid B. Likhterman ◽  
◽  
Aleksandr D. Kravchuk ◽  
Vladimir A. Okhlopkov ◽  
◽  
...  
Keyword(s):  
Brain Imaging ◽  
Intracranial Hemorrhage ◽  
Subdural Hematoma ◽  
Clinical Course ◽  
Chronic Subdural Hematoma ◽  
Imaging Data ◽  
Clinical Variants ◽  
Brain Compression ◽  
Brain Imaging Data ◽  
Ct And Mri

Chronic subdural hematoma (cSDH) is a multifactorial extensive intracranial hemorrhage, causing the local and/or general brain compression. Hematoma has a delimiting capsule, which defines all pathophysiological features, clinical course and treatment tactics. The paper reports contemporary views on ethiology and clinical course of cSDH. Emphasis is placed on the diagnosis. Based on the analysis of 558 verified cSDH observations, the phasal course and brain imaging data are reported. CT and MRI signs of cSDH are defined.

scholarly journals Deep learning classifiers for near infrared spectral imaging: a tutorial

2020 ◽  
Author(s):  
Jun-Li Xu ◽  
Cecilia Riccioli ◽  
Ana Herrero-Langreo ◽  
Aoife Gowen
Keyword(s):  
Deep Learning ◽  
Visual Recognition ◽  
Near Infrared ◽  
Three Dimensional ◽  
Spectral Imaging ◽  
Learning Approaches ◽  
Imaging Data ◽  
Spectral Image ◽  
Background Removal ◽  
Wide Range

Deep learning (DL) has recently achieved considerable successes in a wide range of applications, such as speech recognition, machine translation and visual recognition. This tutorial provides guidelines and useful strategies to apply DL techniques to address pixel-wise classification of spectral images. A one-dimensional convolutional neural network (1-D CNN) is used to extract features from the spectral domain, which are subsequently used for classification. In contrast to conventional classification methods for spectral images that examine primarily the spectral context, a three-dimensional (3-D) CNN is applied to simultaneously extract spatial and spectral features to enhance classificationaccuracy. This tutorial paper explains, in a stepwise manner, how to develop 1-D CNN and 3-D CNN models to discriminate spectral imaging data in a food authenticity context. The example image data provided consists of three varieties of puffed cereals imaged in the NIR range (943–1643 nm). The tutorial is presented in the MATLAB environment and scripts and dataset used are provided. Starting from spectral image pre-processing (background removal and spectral pre-treatment), the typical steps encountered in development of CNN models are presented. The example dataset provided demonstrates that deep learning approaches can increase classification accuracy compared to conventional approaches, increasing the accuracy of the model tested on an independent image from 92.33 % using partial least squares-discriminant analysis to 99.4 % using 3-CNN model at pixel level. The paper concludes with a discussion on the challenges and suggestions in the application of DL techniques for spectral image classification.

Sign in / Sign up

Export Citation Format

Share Document