scholarly journals Synthesis of Prostate MR Images for Classification Using Capsule Network-Based GAN Model

Sensors ◽  
2020 ◽  
Vol 20 (20) ◽  
pp. 5736
Author(s):  
Houqiang Yu ◽  
Xuming Zhang
Keyword(s):  
Prostate Cancer ◽  
Deep Learning ◽  
Data Augmentation ◽  
Spatial Relationship ◽  
Health Concern ◽  
Complex Data ◽  
Mr Images ◽  
Generative Adversarial Network ◽  
Generation Task ◽  
Leibler Divergence

Prostate cancer remains a major health concern among elderly men. Deep learning is a state-of-the-art technique for MR image-based prostate cancer diagnosis, but one of major bottlenecks is the severe lack of annotated MR images. The traditional and Generative Adversarial Network (GAN)-based data augmentation methods cannot ensure the quality and the diversity of generated training samples. In this paper, we have proposed a novel GAN model for synthesis of MR images by utilizing its powerful ability in modeling the complex data distributions. The proposed model is designed based on the architecture of deep convolutional GAN. To learn the more equivariant representation of images that is robust to the changes in the pose and spatial relationship of objects in the images, the capsule network is applied to replace CNN used in the discriminator of regular GAN. Meanwhile, the least squares loss has been adopted for both the generator and discriminator in the proposed GAN to address the vanishing gradient problem of sigmoid cross entropy loss function in regular GAN. Extensive experiments are conducted on the simulated and real MR images. The results demonstrate that the proposed capsule network-based GAN model can generate more realistic and higher quality MR images than the compared GANs. The quantitative comparisons show that among all evaluated models, the proposed GAN generally achieves the smallest Kullback–Leibler divergence values for image generation task and provides the best classification performance when it is introduced into the deep learning method for image classification task.

scholarly journals An Imbalanced Image Classification Method for the Cell Cycle Phase

Information ◽  
2021 ◽  
Vol 12 (6) ◽  
pp. 249
Author(s):  
Xin Jin ◽  
Yuanwen Zou ◽  
Zhongbing Huang
Keyword(s):  
Cell Cycle ◽  
Deep Learning ◽  
Image Classification ◽  
Classification Accuracy ◽  
Data Augmentation ◽  
Cycle Phase ◽  
Generative Adversarial Network ◽  
Adversarial Network ◽  
Cellular Life

The cell cycle is an important process in cellular life. In recent years, some image processing methods have been developed to determine the cell cycle stages of individual cells. However, in most of these methods, cells have to be segmented, and their features need to be extracted. During feature extraction, some important information may be lost, resulting in lower classification accuracy. Thus, we used a deep learning method to retain all cell features. In order to solve the problems surrounding insufficient numbers of original images and the imbalanced distribution of original images, we used the Wasserstein generative adversarial network-gradient penalty (WGAN-GP) for data augmentation. At the same time, a residual network (ResNet) was used for image classification. ResNet is one of the most used deep learning classification networks. The classification accuracy of cell cycle images was achieved more effectively with our method, reaching 83.88%. Compared with an accuracy of 79.40% in previous experiments, our accuracy increased by 4.48%. Another dataset was used to verify the effect of our model and, compared with the accuracy from previous results, our accuracy increased by 12.52%. The results showed that our new cell cycle image classification system based on WGAN-GP and ResNet is useful for the classification of imbalanced images. Moreover, our method could potentially solve the low classification accuracy in biomedical images caused by insufficient numbers of original images and the imbalanced distribution of original images.

scholarly journals Recognition of Urban Sound Events using Deep Context-Aware Feature Extractors and Handcrafted Features

2018 ◽  
Author(s):  
Theodoros Giannakopoulos ◽  
Stavros Perantonis
Keyword(s):  
Deep Learning ◽  
Data Augmentation ◽  
Urban Environments ◽  
Complex Data ◽  
Context Aware ◽  
Contextual Knowledge ◽  
Feature Representations ◽  
Audio Features ◽  
Significant Performance ◽  
Core Idea

This paper proposes a method for recognizing audio events in urban environments that combines handcrafted audio features with a deep learning architectural scheme (Convolutional Neural Networks, CNNs), which has been trained to distinguish between different audio context classes. The core idea is to use the CNNs as a method to extract context-aware deep audio features that can offer supplementary feature representations to any soundscape analysis classification task. Towards this end, the CNN is trained on a database of audio samples which are annotated in terms of their respective "scene" (e.g. train, street, park), and then it is combined with handcrafted audio features in an early fusion approach, in order to recognize the audio event of an unknown audio recording. Detailed experimentation proves that the proposed context-aware deep learning scheme, when combined with the typical handcrafted features, leads to a significant performance boosting in terms of classification accuracy. The main contribution of this work is the demonstration that transferring audio contextual knowledge using CNNs as feature extractors can significantly improve the performance of the audio classifier, without need for CNN training (a rather demanding process that requires huge datasets and complex data augmentation procedures).

scholarly journals Predicting Three-Dimensional Dose Distribution of Prostate Volumetric Modulated Arc Therapy Using Deep Learning

Life ◽  
2021 ◽  
Vol 11 (12) ◽  
pp. 1305
Author(s):  
Patiparn Kummanee ◽  
Wares Chancharoen ◽  
Kanut Tangtisanon ◽  
Todsaporn Fuangrod
Keyword(s):  
Prostate Cancer ◽  
Deep Learning ◽  
Dose Distribution ◽  
Learning Algorithm ◽  
Volumetric Modulated Arc Therapy ◽  
Dose Calculation ◽  
Generative Adversarial Network ◽  
Percentage Difference ◽  
Prediction Time ◽  
Arc Therapy

Background: Volumetric modulated arc therapy (VMAT) planning is a time-consuming process of radiation therapy. With a deep learning approach, 3D dose distribution can be predicted without the need for an actual dose calculation. This approach can accelerate the process by guiding and confirming the achievable dose distribution in order to reduce the replanning iterations while maintaining the plan quality. Methods: In this study, three dose distribution predictive models of VMAT for prostate cancer were developed, evaluated, and compared. Each model was designed with a different input data structure to train and test the model: (1) patient CT alone (PCT alone), (2) patient CT and generalized organ structure (PCTGOS), and (3) patient CT and specific organ structure (PCTSOS). The generative adversarial network (GAN) model was used as a core learning algorithm. The models were trained slice-by-slice using 46 VMAT plans for prostate cancer, and then used to predict and evaluate the dose distribution from 8 independent plans. Results: VMAT dose distribution was generated with a mean prediction time of approximately 3.5 s per patient, whereas the PCTSOS model was excluded due to a mean prediction time of approximately 17.5 s per patient. The highest average 3D gamma passing rate was 80.51 ± 5.94, while the lowest overall percentage difference of dose-volume histogram (DVH) parameters was 6.01 ± 5.44% for the prescription dose from the PCTGOS model. However, the PCTSOS model was the most reliable for the evaluation of multiple parameters. Conclusions: This dose prediction model could accelerate the iterative optimization process for the planning of VMAT treatment by guiding the planner with the desired dose distribution.

scholarly journals Wildfire-Detection Method Using DenseNet and CycleGAN Data Augmentation-Based Remote Camera Imagery

2020 ◽  
Vol 12 (22) ◽  
pp. 3715 ◽  
Author(s):  
Minsoo Park ◽  
Dai Quoc Tran ◽  
Daekyo Jung ◽  
Seunghee Park
Keyword(s):  
Deep Learning ◽  
Data Augmentation ◽  
Model Performance ◽  
Image Data ◽  
Detection Accuracy ◽  
Generative Adversarial Network ◽  
Data Imbalance ◽  
Surveillance Camera ◽  
Convolutional Networks ◽  
Adversarial Network

To minimize the damage caused by wildfires, a deep learning-based wildfire-detection technology that extracts features and patterns from surveillance camera images was developed. However, many studies related to wildfire-image classification based on deep learning have highlighted the problem of data imbalance between wildfire-image data and forest-image data. This data imbalance causes model performance degradation. In this study, wildfire images were generated using a cycle-consistent generative adversarial network (CycleGAN) to eliminate data imbalances. In addition, a densely-connected-convolutional-networks-based (DenseNet-based) framework was proposed and its performance was compared with pre-trained models. While training with a train set containing an image generated by a GAN in the proposed DenseNet-based model, the best performance result value was realized among the models with an accuracy of 98.27% and an F1 score of 98.16, obtained using the test dataset. Finally, this trained model was applied to high-quality drone images of wildfires. The experimental results showed that the proposed framework demonstrated high wildfire-detection accuracy.

scholarly journals A deep learning segmentation strategy that minimizes the amount of manually annotated images

F1000Research ◽  
2021 ◽  
Vol 10 ◽  
pp. 256
Author(s):  
Thierry Pécot ◽  
Alexander Alekseyenko ◽  
Kristin Wallace
Keyword(s):  
Deep Learning ◽  
Data Augmentation ◽  
Training Data ◽  
Artificial Data ◽  
Deep Convolutional Neural Networks ◽  
Generative Adversarial Network ◽  
Data Set ◽  
Segmentation Strategy ◽  
Adversarial Network ◽  
The Impact

Deep learning has revolutionized the automatic processing of images. While deep convolutional neural networks have demonstrated astonishing segmentation results for many biological objects acquired with microscopy, this technology's good performance relies on large training datasets. In this paper, we present a strategy to minimize the amount of time spent in manually annotating images for segmentation. It involves using an efficient and open source annotation tool, the artificial increase of the training data set with data augmentation, the creation of an artificial data set with a conditional generative adversarial network and the combination of semantic and instance segmentations. We evaluate the impact of each of these approaches for the segmentation of nuclei in 2D widefield images of human precancerous polyp biopsies in order to define an optimal strategy.

Sign in / Sign up

Export Citation Format

Share Document