Automatic detection of anteriorly displaced temporomandibular joint discs on magnetic resonance images using a deep learning algorithm

2021 ◽  
Author(s):  
Bolun Lin ◽  
Mosha Cheng ◽  
Shuze Wang ◽  
Fulong Li ◽  
Qing Zhou
Keyword(s):  
Deep Learning ◽  
Magnetic Resonance ◽  
Temporomandibular Joint ◽  
Diagnostic Criteria ◽  
Orthodontic Treatment ◽  
Data Augmentation ◽  
Learning Algorithm ◽  
Area Under The Curve ◽  
Magnetic Resonance Images ◽  
Learning Models

Objectives: This study aimed to develop models that can automatically detect anterior disc displacement (ADD) of the temporomandibular joint (TMJ) on magnetic resonance images (MRI) before orthodontic treatment to reduce the risk of developing serious complications after treatment. Methods: We used 9009 sagittal MRI of the TMJ as input and constructed three sets of deep learning models to detect ADD automatically. Deep learning models were developed using a convolutional neural network (CNN) based on the ResNet architecture and the “Imagenet” database. Five-fold cross-validation, over sampling, and data augmentation techniques were applied to reduce the risk of overfitting the model. The accuracy and area under the curve (AUC) of the three models were compared. Results: The performance of the maximum open mouth position model was excellent with accuracy and AUC of 0.970 (±0.007) and 0.990 (±0.005), respectively. For closed mouth position models the accuracy and AUC of diagnostic criteria One were 0.863 (±0.008) and 0.922 (±0.009), respectively significantly higher than that of diagnostic criteria two with an 0.839 (±0.013) (p = 0.009) and AUC of 0.885 (±0.018) (p = 0.003). The classification activation heat map also improved our understanding of the models and visually displayed the areas that play a key role in the model recognition process. Conclusion: Our CNN model resulted in high accuracy and AUC in detecting ADD and can therefore potentially be used by clinicians to assess ADD before orthodontic treatment and hence improve treatment outcomes.

scholarly journals Automated segmentation of articular disc of the temporomandibular joint on magnetic resonance images using deep learning

2022 ◽  
Vol 12 (1) ◽  
Author(s):  
Shota Ito ◽  
Yuichi Mine ◽  
Yuki Yoshimi ◽  
Saori Takeda ◽  
Akari Tanaka ◽  
...  
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Magnetic Resonance ◽  
Convolutional Neural Network ◽  
Temporomandibular Joint ◽  
Temporomandibular Disorders ◽  
Temporomandibular Disorder ◽  
Semantic Segmentation ◽  
Magnetic Resonance Images ◽  
Articular Disc

AbstractTemporomandibular disorders are typically accompanied by a number of clinical manifestations that involve pain and dysfunction of the masticatory muscles and temporomandibular joint. The most important subgroup of articular abnormalities in patients with temporomandibular disorders includes patients with different forms of articular disc displacement and deformation. Here, we propose a fully automated articular disc detection and segmentation system to support the diagnosis of temporomandibular disorder on magnetic resonance imaging. This system uses deep learning-based semantic segmentation approaches. The study included a total of 217 magnetic resonance images from 10 patients with anterior displacement of the articular disc and 10 healthy control subjects with normal articular discs. These images were used to evaluate three deep learning-based semantic segmentation approaches: our proposed convolutional neural network encoder-decoder named 3DiscNet (Detection for Displaced articular DISC using convolutional neural NETwork), U-Net, and SegNet-Basic. Of the three algorithms, 3DiscNet and SegNet-Basic showed comparably good metrics (Dice coefficient, sensitivity, and positive predictive value). This study provides a proof-of-concept for a fully automated deep learning-based segmentation methodology for articular discs on magnetic resonance images, and obtained promising initial results, indicating that the method could potentially be used in clinical practice for the assessment of temporomandibular disorders.

scholarly journals Combining citizen science and deep learning to amplify expertise in neuroimaging

2018 ◽  
Author(s):  
Anisha Keshavan ◽  
Jason D. Yeatman ◽  
Ariel Rokem
Keyword(s):  
Decision Making ◽  
Quality Control ◽  
Big Data ◽  
Deep Learning ◽  
Citizen Science ◽  
Large Scale ◽  
Learning Algorithm ◽  
Area Under The Curve ◽  
Magnetic Resonance Images ◽  
Complex Datasets

AbstractResearch in many fields has become increasingly reliant on large and complex datasets. “Big Data” holds untold promise to rapidly advance science by tackling new questions that cannot be answered with smaller datasets. While powerful, research with Big Data poses unique challenges, as many standard lab protocols rely on experts examining each one of the samples. This is not feasible for large-scale datasets because manual approaches are time-consuming and hence difficult to scale. Meanwhile, automated approaches lack the accuracy of examination by highly trained scientists and this may introduce major errors, sources of noise, and unforeseen biases into these large and complex datasets. Our proposed solution is to 1) start with a small, expertly labelled dataset, 2) amplify labels through web-based tools that engage citizen scientists, and 3) train machine learning on amplified labels to emulate expert decision making. As a proof of concept, we developed a system to quality control a large dataset of three-dimensional magnetic resonance images (MRI) of human brains. An initial dataset of 200 brain images labeled by experts were amplified by citizen scientists to label 722 brains, with over 80,000 ratings done through a simple web interface. A deep learning algorithm was then trained to predict data quality, based on a combination of the citizen scientist labels that accounts for differences in the quality of classification by different citizen scientists. In an ROC analysis (on left out test data), the deep learning network performed as well as a state-of-the-art, specialized algorithm (MRIQC) for quality control of T1-weighted images, each with an area under the curve of 0.99. Finally, as a specific practical application of the method, we explore how brain image quality relates to the replicability of a well established relationship between brain volume and age over development. Combining citizen science and deep learning can generalize and scale expert decision making; this is particularly important in emerging disciplines where specialized, automated tools do not already exist.

scholarly journals Using Convolutional Encoder Networks to Determine the Optimal Magnetic Resonance Image for the Automatic Segmentation of Multiple Sclerosis

2021 ◽  
Vol 11 (18) ◽  
pp. 8335
Author(s):  
Shaurnav Ghosh ◽  
Marc Huo ◽  
Mst Shamim Ara Shawkat ◽  
Serena McCalla
Keyword(s):  
Multiple Sclerosis ◽  
Deep Learning ◽  
Magnetic Resonance ◽  
Statistical Significance ◽  
Automatic Segmentation ◽  
Magnetic Resonance Images ◽  
Dice Similarity Coefficient ◽  
Learning Models ◽  
Mri Sequences ◽  
Convolutional Encoder

Multiple Sclerosis (MS) is a neuroinflammatory demyelinating disease that affects over 2,000,000 individuals worldwide. It is characterized by white matter lesions that are identified through the segmentation of magnetic resonance images (MRIs). Manual segmentation is very time-intensive because radiologists spend a great amount of time labeling T1-weighted, T2-weighted, and FLAIR MRIs. In response, deep learning models have been created to reduce segmentation time by automatically detecting lesions. These models often use individual MRI sequences as well as combinations, such as FLAIR2, which is the multiplication of FLAIR and T2 sequences. Unlike many other studies, this seeks to determine an optimal MRI sequence, thus reducing even more time by not having to obtain other MRI sequences. With this consideration in mind, four Convolutional Encoder Networks (CENs) with different network architectures (U-Net, U-Net++, Linknet, and Feature Pyramid Network) were used to ensure that the optimal MRI applies to a wide array of deep learning models. Each model had used a pretrained ResNeXt-50 encoder in order to conserve memory and to train faster. Training and testing had been performed using two public datasets with 30 and 15 patients. Fisher’s exact test was used to evaluate statistical significance, and the automatic segmentation times were compiled for the top two models. This work determined that FLAIR is the optimal sequence based on Dice Similarity Coefficient (DSC) and Intersection over Union (IoU). By using FLAIR, the U-Net++ with the ResNeXt-50 achieved a high DSC of 0.7159.

scholarly journals Deep Learning Algorithm Trained on Brain Magnetic Resonance Images and Clinical Data to Predict Motor Outcomes of Patients With Corona Radiata Infarct

2022 ◽  
Vol 15 ◽  
Author(s):  
Jeoung Kun Kim ◽  
Min Cheol Chang ◽  
Donghwi Park
Keyword(s):  
Deep Learning ◽  
Magnetic Resonance ◽  
Confidence Interval ◽  
Clinical Data ◽  
Learning Algorithm ◽  
Hand Function ◽  
Magnetic Resonance Images ◽  
Deep Learning Algorithm ◽  
Motor Outcomes

The early and accurate prediction of the extent of long-term motor recovery is important for establishing specific rehabilitation strategies for stroke patients. Using clinical parameters and brain magnetic resonance images as inputs, we developed a deep learning algorithm to increase the prediction accuracy of long-term motor outcomes in patients with corona radiata (CR) infarct. Using brain magnetic resonance images and clinical data obtained soon after CR infarct, we developed an integrated algorithm to predict hand function and ambulatory outcomes of the patient 6 months after onset. To develop and evaluate the algorithm, we retrospectively recruited 221 patients with CR infarct. The area under the curve of the validation set of the integrated modified Brunnstrom classification prediction model was 0.891 with 95% confidence interval (0.814–0.967) and that of the integrated functional ambulatory category prediction model was 0.919, with 95% confidence interval (0.842–0.995). We demonstrated that an integrated algorithm trained using patients’ clinical data and brain magnetic resonance images obtained soon after CR infarct can promote the accurate prediction of long-term hand function and ambulatory outcomes. Future efforts will be devoted to finding more appropriate input variables to further increase the accuracy of deep learning models in clinical applications.

scholarly journals Automated Segmentation of Articular Disc of the Temporomandibular Joint in Magnetic Resonance Images Using Deep Learning: A Proof-of-Concept Study

2021 ◽  
Author(s):  
Shota Ito ◽  
Yuichi Mine ◽  
Yuki Yoshimi ◽  
Saori Takeda ◽  
Akari Tanaka ◽  
...  
Keyword(s):  
Deep Learning ◽  
Magnetic Resonance ◽  
Temporomandibular Joint ◽  
Temporomandibular Disorders ◽  
Temporomandibular Disorder ◽  
Semantic Segmentation ◽  
Magnetic Resonance Images ◽  
Automated Segmentation ◽  
Proof Of Concept ◽  
Articular Disc

Abstract Temporomandibular disorders are typically accompanied by a number of clinical manifestations that involve pain and dysfunction of the masticatory muscles and temporomandibular joint. The most important subgroup of articular abnormalities in patients with temporomandibular disorders includes patients with different forms of articular disc displacement and deformation. Here, we propose a fully automated articular disc detection and segmentation system to support the diagnosis of temporomandibular disorder on magnetic resonance imaging. This system uses deep learning-based semantic segmentation approaches. Two hundred and seventeen magnetic resonance images obtained from patients with normal or displaced articular discs were used to evaluate three deep learning-based semantic segmentation approaches: our proposed encoder-decoder CNN named 3DiscNet (Detection for Displaced articular DISC using convolutional neural NETwork), U-Net, and SegNet-Basic. Of the three algorithms, 3DiscNet and SegNet-Basic showed comparably good metrics (Dice coefficient, sensitivity, and PPV). This study provides a proof-of-concept for a fully automated segmentation methodology of the articular disc on MR images with deep learning, and obtained promising initial results indicating that it could potentially be used in clinical practice for the assessment of temporomandibular disorders.

Automatic segmentation of the temporomandibular joint disc on magnetic resonance images using a deep learning technique

2021 ◽  
pp. 20210185
Author(s):  
Michihito Nozawa ◽  
Hirokazu Ito ◽  
Yoshiko Ariji ◽  
Motoki Fukuda ◽  
Chinami Igarashi ◽  
...  
Keyword(s):  
Deep Learning ◽  
Magnetic Resonance ◽  
Temporomandibular Joint ◽  
Test Data ◽  
Automatic Segmentation ◽  
Learning Model ◽  
Magnetic Resonance Images ◽  
Mr Images ◽  
Validity Test ◽  
Deep Learning Model

Objectives: The aims of the present study were to construct a deep learning model for automatic segmentation of the temporomandibular joint (TMJ) disc on magnetic resonance (MR) images, and to evaluate the performances using the internal and external test data. Methods: In total, 1200 MR images of closed and open mouth positions in patients with temporomandibular disorder (TMD) were collected from two hospitals (Hospitals A and B). The training and validation data comprised 1000 images from Hospital A, which were used to create a segmentation model. The performance was evaluated using 200 images from Hospital A (internal validity test) and 200 images from Hospital B (external validity test). Results: Although the analysis of performance determined with data from Hospital B showed low recall (sensitivity), compared with the performance determined with data from Hospital A, both performances were above 80%. Precision (positive predictive value) was lower when test data from Hospital A were used for the position of anterior disc displacement. According to the intra-articular TMD classification, the proportions of accurately assigned TMJs were higher when using images from Hospital A than when using images from Hospital B. Conclusion: The segmentation deep learning model created in this study may be useful for identifying disc positions on MR images.

Levenshtein Augmentation Improves Performance of SMILES Based Deep-Learning Synthesis Prediction

2020 ◽  
Author(s):  
Dean Sumner ◽  
Jiazhen He ◽  
Amol Thakkar ◽  
Ola Engkvist ◽  
Esben Jannik Bjerrum
Keyword(s):  
Neural Networks ◽  
Pattern Recognition ◽  
Deep Learning ◽  
Recurrent Neural Networks ◽  
Data Augmentation ◽  
State Of The Art ◽  
Sequence Similarity ◽  
Learning Models ◽  
Underlying Network

<p>SMILES randomization, a form of data augmentation, has previously been shown to increase the performance of deep learning models compared to non-augmented baselines. Here, we propose a novel data augmentation method we call “Levenshtein augmentation” which considers local SMILES sub-sequence similarity between reactants and their respective products when creating training pairs. The performance of Levenshtein augmentation was tested using two state of the art models - transformer and sequence-to-sequence based recurrent neural networks with attention. Levenshtein augmentation demonstrated an increase performance over non-augmented, and conventionally SMILES randomization augmented data when used for training of baseline models. Furthermore, Levenshtein augmentation seemingly results in what we define as <i>attentional gain </i>– an enhancement in the pattern recognition capabilities of the underlying network to molecular motifs.</p>

scholarly journals Application of deep learning in detecting neurological disorders from magnetic resonance images: a survey on the detection of Alzheimer’s disease, Parkinson’s disease and schizophrenia

2020 ◽  
Vol 7 (1) ◽  
Author(s):  
Manan Binth Taj Noor ◽  
Nusrat Zerin Zenia ◽  
M Shamim Kaiser ◽  
Shamim Al Mamun ◽  
Mufti Mahmud
Keyword(s):  
Alzheimer’S Disease ◽  
Parkinson’S Disease ◽  
Alzheimer's Disease ◽  
Parkinson's Disease ◽  
Deep Learning ◽  
Magnetic Resonance ◽  
Neurological Disorders ◽  
Magnetic Resonance Images ◽  
Future Research ◽  
Comparative Performance

Abstract Neuroimaging, in particular magnetic resonance imaging (MRI), has been playing an important role in understanding brain functionalities and its disorders during the last couple of decades. These cutting-edge MRI scans, supported by high-performance computational tools and novel ML techniques, have opened up possibilities to unprecedentedly identify neurological disorders. However, similarities in disease phenotypes make it very difficult to detect such disorders accurately from the acquired neuroimaging data. This article critically examines and compares performances of the existing deep learning (DL)-based methods to detect neurological disorders—focusing on Alzheimer’s disease, Parkinson’s disease and schizophrenia—from MRI data acquired using different modalities including functional and structural MRI. The comparative performance analysis of various DL architectures across different disorders and imaging modalities suggests that the Convolutional Neural Network outperforms other methods in detecting neurological disorders. Towards the end, a number of current research challenges are indicated and some possible future research directions are provided.

Sign in / Sign up

Export Citation Format

Share Document