scholarly journals Using Convolutional Encoder Networks to Determine the Optimal Magnetic Resonance Image for the Automatic Segmentation of Multiple Sclerosis

2021 ◽  
Vol 11 (18) ◽  
pp. 8335
Author(s):  
Shaurnav Ghosh ◽  
Marc Huo ◽  
Mst Shamim Ara Shawkat ◽  
Serena McCalla

Multiple Sclerosis (MS) is a neuroinflammatory demyelinating disease that affects over 2,000,000 individuals worldwide. It is characterized by white matter lesions that are identified through the segmentation of magnetic resonance images (MRIs). Manual segmentation is very time-intensive because radiologists spend a great amount of time labeling T1-weighted, T2-weighted, and FLAIR MRIs. In response, deep learning models have been created to reduce segmentation time by automatically detecting lesions. These models often use individual MRI sequences as well as combinations, such as FLAIR2, which is the multiplication of FLAIR and T2 sequences. Unlike many other studies, this seeks to determine an optimal MRI sequence, thus reducing even more time by not having to obtain other MRI sequences. With this consideration in mind, four Convolutional Encoder Networks (CENs) with different network architectures (U-Net, U-Net++, Linknet, and Feature Pyramid Network) were used to ensure that the optimal MRI applies to a wide array of deep learning models. Each model had used a pretrained ResNeXt-50 encoder in order to conserve memory and to train faster. Training and testing had been performed using two public datasets with 30 and 15 patients. Fisher’s exact test was used to evaluate statistical significance, and the automatic segmentation times were compiled for the top two models. This work determined that FLAIR is the optimal sequence based on Dice Similarity Coefficient (DSC) and Intersection over Union (IoU). By using FLAIR, the U-Net++ with the ResNeXt-50 achieved a high DSC of 0.7159.

Author(s):  
Vitoantonio Bevilacqua ◽  
Antonio Brunetti ◽  
Giacomo Donato Cascarano ◽  
Andrea Guerriero ◽  
Francesco Pesce ◽  
...  

Abstract Background The automatic segmentation of kidneys in medical images is not a trivial task when the subjects undergoing the medical examination are affected by Autosomal Dominant Polycystic Kidney Disease (ADPKD). Several works dealing with the segmentation of Computed Tomography images from pathological subjects were proposed, showing high invasiveness of the examination or requiring interaction by the user for performing the segmentation of the images. In this work, we propose a fully-automated approach for the segmentation of Magnetic Resonance images, both reducing the invasiveness of the acquisition device and not requiring any interaction by the users for the segmentation of the images. Methods Two different approaches are proposed based on Deep Learning architectures using Convolutional Neural Networks (CNN) for the semantic segmentation of images, without needing to extract any hand-crafted features. In details, the first approach performs the automatic segmentation of images without any procedure for pre-processing the input. Conversely, the second approach performs a two-steps classification strategy: a first CNN automatically detects Regions Of Interest (ROIs); a subsequent classifier performs the semantic segmentation on the ROIs previously extracted. Results Results show that even though the detection of ROIs shows an overall high number of false positives, the subsequent semantic segmentation on the extracted ROIs allows achieving high performance in terms of mean Accuracy. However, the segmentation of the entire images input to the network remains the most accurate and reliable approach showing better performance than the previous approach. Conclusion The obtained results show that both the investigated approaches are reliable for the semantic segmentation of polycystic kidneys since both the strategies reach an Accuracy higher than 85%. Also, both the investigated methodologies show performances comparable and consistent with other approaches found in literature working on images from different sources, reducing both the invasiveness of the analyses and the interaction needed by the users for performing the segmentation task.


NeuroImage ◽  
2010 ◽  
Vol 50 (2) ◽  
pp. 446-455 ◽  
Author(s):  
Mark A. Horsfield ◽  
Stefania Sala ◽  
Mohit Neema ◽  
Martina Absinta ◽  
Anshika Bakshi ◽  
...  

2020 ◽  
Vol 10 (10) ◽  
pp. 3360
Author(s):  
Mizuho Nishio ◽  
Shunjiro Noguchi ◽  
Koji Fujimoto

Combinations of data augmentation methods and deep learning architectures for automatic pancreas segmentation on CT images are proposed and evaluated. Images from a public CT dataset of pancreas segmentation were used to evaluate the models. Baseline U-net and deep U-net were chosen for the deep learning models of pancreas segmentation. Methods of data augmentation included conventional methods, mixup, and random image cropping and patching (RICAP). Ten combinations of the deep learning models and the data augmentation methods were evaluated. Four-fold cross validation was performed to train and evaluate these models with data augmentation methods. The dice similarity coefficient (DSC) was calculated between automatic segmentation results and manually annotated labels and these were visually assessed by two radiologists. The performance of the deep U-net was better than that of the baseline U-net with mean DSC of 0.703–0.789 and 0.686–0.748, respectively. In both baseline U-net and deep U-net, the methods with data augmentation performed better than methods with no data augmentation, and mixup and RICAP were more useful than the conventional method. The best mean DSC was obtained using a combination of deep U-net, mixup, and RICAP, and the two radiologists scored the results from this model as good or perfect in 76 and 74 of the 82 cases.


Author(s):  
Bolun Lin ◽  
Mosha Cheng ◽  
Shuze Wang ◽  
Fulong Li ◽  
Qing Zhou

Objectives: This study aimed to develop models that can automatically detect anterior disc displacement (ADD) of the temporomandibular joint (TMJ) on magnetic resonance images (MRI) before orthodontic treatment to reduce the risk of developing serious complications after treatment. Methods: We used 9009 sagittal MRI of the TMJ as input and constructed three sets of deep learning models to detect ADD automatically. Deep learning models were developed using a convolutional neural network (CNN) based on the ResNet architecture and the “Imagenet” database. Five-fold cross-validation, over sampling, and data augmentation techniques were applied to reduce the risk of overfitting the model. The accuracy and area under the curve (AUC) of the three models were compared. Results: The performance of the maximum open mouth position model was excellent with accuracy and AUC of 0.970 (±0.007) and 0.990 (±0.005), respectively. For closed mouth position models the accuracy and AUC of diagnostic criteria One were 0.863 (±0.008) and 0.922 (±0.009), respectively significantly higher than that of diagnostic criteria two with an 0.839 (±0.013) (p = 0.009) and AUC of 0.885 (±0.018) (p = 0.003). The classification activation heat map also improved our understanding of the models and visually displayed the areas that play a key role in the model recognition process. Conclusion: Our CNN model resulted in high accuracy and AUC in detecting ADD and can therefore potentially be used by clinicians to assess ADD before orthodontic treatment and hence improve treatment outcomes.


2021 ◽  
pp. 20210185
Author(s):  
Michihito Nozawa ◽  
Hirokazu Ito ◽  
Yoshiko Ariji ◽  
Motoki Fukuda ◽  
Chinami Igarashi ◽  
...  

Objectives: The aims of the present study were to construct a deep learning model for automatic segmentation of the temporomandibular joint (TMJ) disc on magnetic resonance (MR) images, and to evaluate the performances using the internal and external test data. Methods: In total, 1200 MR images of closed and open mouth positions in patients with temporomandibular disorder (TMD) were collected from two hospitals (Hospitals A and B). The training and validation data comprised 1000 images from Hospital A, which were used to create a segmentation model. The performance was evaluated using 200 images from Hospital A (internal validity test) and 200 images from Hospital B (external validity test). Results: Although the analysis of performance determined with data from Hospital B showed low recall (sensitivity), compared with the performance determined with data from Hospital A, both performances were above 80%. Precision (positive predictive value) was lower when test data from Hospital A were used for the position of anterior disc displacement. According to the intra-articular TMD classification, the proportions of accurately assigned TMJs were higher when using images from Hospital A than when using images from Hospital B. Conclusion: The segmentation deep learning model created in this study may be useful for identifying disc positions on MR images.


Sign in / Sign up

Export Citation Format

Share Document