Alcoholism Detection by Data Augmentation and Convolutional Neural Network with Stochastic Pooling

2017 ◽  
Vol 42 (1) ◽  
Author(s):  
Shui-Hua Wang ◽  
Yi-Ding Lv ◽  
Yuxiu Sui ◽  
Shuai Liu ◽  
Su-Jing Wang ◽  
...  
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Data Augmentation ◽  
Stochastic Pooling

scholarly journals Multiple Sclerosis Detection via 6-layer Stochastic Pooling Convolutional Neural Network and Multiple-way Data Augmentation

STEMedicine ◽  
2021 ◽  
Vol 2 (8) ◽  
pp. e101
Author(s):  
Jian Wang ◽  
Dimas Lima
Keyword(s):  
Neural Network ◽  
Multiple Sclerosis ◽  
Convolutional Neural Network ◽  
Data Augmentation ◽  
Early Stage ◽  
Brain Mri ◽  
Brain Magnetic Resonance Imaging ◽  
White Matter Lesions ◽  
Learning Methods ◽  
Stochastic Pooling

Multiple sclerosis is one of most widespread autoimmune neuroinflammatory diseases which mainly damages body function such as movement, sensation, and vision. Despite of conventional clinical presentation, brain magnetic resonance imaging of white matter lesions is often applied to diagnose multiple sclerosis at the early stage. In this article, we proposed a 6-layer stochastic pooling convolutional neural network with multiple-way data augmentation for multiple sclerosis detection in brain MRI images. Our approach does not demand hand-crafted features unlike those traditional machine learning methods. Via application of stochastic pooling and multiple-way data augmentation, our 6-layer CNN achieved equivalent performance against those deep learning methods which consist of so many layers and parameters that ordinarily bring difficulty to training. The results showed that this 6-layer CNN obtained a sensitivity of 95.98±0.46%, a specificity of 95.67±0.92%, and an accuracy of 95.82±0.58%. According to comparison experiments, our results are better than state-of-the-art approaches. Further, we also conducted ablation experiments to examine the contribution of stochastic pooling and multiple-way data augmentation to the original CNN model. The contrast experiments revealed that our scheme of stochastic pooling and multiple-way data augmentation enhanced the original 6-layer CNN model compared to those using maximum pooling or average pooling and inadequate data augmentation.

scholarly journals SOSPCNN: Structurally Optimized Stochastic Pooling Convolutional Neural Network for Tetralogy of Fallot Recognition

2021 ◽  
Vol 2021 ◽  
pp. 1-17
Author(s):  
Shui-Hua Wang ◽  
Kaihong Wu ◽  
Tianshu Chu ◽  
Steven L. Fernandes ◽  
Qinghua Zhou ◽  
...  
Keyword(s):  
Neural Network ◽  
Artificial Intelligence ◽  
Computed Tomography ◽  
Structural Optimization ◽  
Convolutional Neural Network ◽  
Tetralogy Of Fallot ◽  
Data Augmentation ◽  
State Of The Art ◽  
Stochastic Pooling ◽  
Better Than

Aim. This study proposes a new artificial intelligence model based on cardiovascular computed tomography for more efficient and precise recognition of Tetralogy of Fallot (TOF). Methods. Our model is a structurally optimized stochastic pooling convolutional neural network (SOSPCNN), which combines stochastic pooling, structural optimization, and convolutional neural network. In addition, multiple-way data augmentation is used to overcome overfitting. Grad-CAM is employed to provide explainability to the proposed SOSPCNN model. Meanwhile, both desktop and web apps are developed based on this SOSPCNN model. Results. The results on ten runs of 10-fold crossvalidation show that our SOSPCNN model yields a sensitivity of 92.25 ± 2.19 , a specificity of 92.75 ± 2.49 , a precision of 92.79 ± 2.29 , an accuracy of 92.50 ± 1.18 , an F1 score of 92.48 ± 1.17 , an MCC of 85.06 ± 2.38 , an FMI of 92.50 ± 1.17 , and an AUC of 0.9587. Conclusion. The SOSPCNN method performed better than three state-of-the-art TOF recognition approaches.

scholarly journals Morphological residual convolutional neural network (M-RCNN) for intelligent recognition of wear particles from artificial joints

Friction ◽  
2021 ◽  
Author(s):  
Xiaobin Hu ◽  
Jian Song ◽  
Zhenhua Liao ◽  
Yuhong Liu ◽  
Jian Gao ◽  
...  
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Data Augmentation ◽  
Support Vector ◽  
Wear Particles ◽  
Artificial Joints ◽  
Performance Deterioration ◽  
Overall Performance ◽  
Correct Category ◽  
Intelligent Recognition

AbstractFinding the correct category of wear particles is important to understand the tribological behavior. However, manual identification is tedious and time-consuming. We here propose an automatic morphological residual convolutional neural network (M-RCNN), exploiting the residual knowledge and morphological priors between various particle types. We also employ data augmentation to prevent performance deterioration caused by the extremely imbalanced problem of class distribution. Experimental results indicate that our morphological priors are distinguishable and beneficial to largely boosting overall performance. M-RCNN demonstrates a much higher accuracy (0.940) than the deep residual network (0.845) and support vector machine (0.821). This work provides an effective solution for automatically identifying wear particles and can be a powerful tool to further analyze the failure mechanisms of artificial joints.

Performance Evaluation of Convolutional Neural Network Using Synthetic Medical Data Augmentation Generated by GAN

2021 ◽  
Author(s):  
Ramesh Adhikari ◽  
Suresh Pokharel
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Convolutional Neural Network ◽  
Data Augmentation ◽  
Medical Diagnostics ◽  
Generative Adversarial Networks ◽  
Generalization Capability ◽  
X Ray ◽  
Original Dataset ◽  
Unseen Data

Data augmentation is widely used in image processing and pattern recognition problems in order to increase the richness in diversity of available data. It is commonly used to improve the classification accuracy of images when the available datasets are limited. Deep learning approaches have demonstrated an immense breakthrough in medical diagnostics over the last decade. A significant amount of datasets are needed for the effective training of deep neural networks. The appropriate use of data augmentation techniques prevents the model from over-fitting and thus increases the generalization capability of the network while testing afterward on unseen data. However, it remains a huge challenge to obtain such a large dataset from rare diseases in the medical field. This study presents the synthetic data augmentation technique using Generative Adversarial Networks to evaluate the generalization capability of neural networks using existing data more effectively. In this research, the convolutional neural network (CNN) model is used to classify the X-ray images of the human chest in both normal and pneumonia conditions; then, the synthetic images of the X-ray from the available dataset are generated by using the deep convolutional generative adversarial network (DCGAN) model. Finally, the CNN model is trained again with the original dataset and augmented data generated using the DCGAN model. The classification performance of the CNN model is improved by 3.2% when the augmented data were used along with the originally available dataset.

scholarly journals "LeukNet" - A Model of Convolutional Neural Network for the Diagnosis of Leukemia

2020 ◽  
Author(s):  
Luis H. S. Vogado ◽  
Rodrigo M. S. Veras ◽  
Kelson R. T. Aires
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Cross Validation ◽  
Data Augmentation ◽  
Fine Tuning ◽  
Current State ◽  
Leukemia Diagnosis ◽  
New Guidelines ◽  
Texture Contrast ◽  
Tuning Methods

Leukemia is a disorder that affects the bone marrow, causing uncontrolled production of leukocytes, impairing the transport of oxygen and causing blood coagulation problems. In this article, we propose a new computational tool, named LeukNet, a Convolutional Neural Network (CNN) architecture based on the VGG-16 convolutional blocks, to facilitate the leukemia diagnosis from blood smear images. We evaluated different architectures and fine-tuning methods using 18 datasets containing 3536 images with distinct characteristics of color, texture, contrast, and resolution. Additionally, data augmentation operations were applied to increase the training set by up to 20 times. The k-fold cross-validation (k = 5) results achieved 98.28% of accuracy. A cross-dataset validation technique, named LeaveOne-Dataset-Out Cross-Validation (LODOCV), is also proposed to evaluate the developed model’s generalization capability. The accuracy of using LODOCV on the ALL-IDB 1, ALL-IDB 2, and UFG datasets was 97.04%, 82.46%, and 70.24%, respectively, overcoming the current state-of-the-art results and offering new guidelines for image-based computer-aided diagnosis (CAD) systems in this area.

scholarly journals Voiceprint Identification for Limited Dataset Using the Deep Migration Hybrid Model Based on Transfer Learning

Sensors ◽  
2018 ◽  
Vol 18 (7) ◽  
pp. 2399 ◽  
Author(s):  
Cunwei Sun ◽  
Yuxin Yang ◽  
Chang Wen ◽  
Kai Xie ◽  
Fangqing Wen
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Transfer Learning ◽  
Hybrid Model ◽  
Data Augmentation ◽  
Small Sample ◽  
Restricted Boltzmann Machine ◽  
Small Samples ◽  
Boltzmann Machine ◽  
Training Time

The convolutional neural network (CNN) has made great strides in the area of voiceprint recognition; but it needs a huge number of data samples to train a deep neural network. In practice, it is too difficult to get a large number of training samples, and it cannot achieve a better convergence state due to the limited dataset. In order to solve this question, a new method using a deep migration hybrid model is put forward, which makes it easier to realize voiceprint recognition for small samples. Firstly, it uses Transfer Learning to transfer the trained network from the big sample voiceprint dataset to our limited voiceprint dataset for the further training. Fully-connected layers of a pre-training model are replaced by restricted Boltzmann machine layers. Secondly, the approach of Data Augmentation is adopted to increase the number of voiceprint datasets. Finally, we introduce fast batch normalization algorithms to improve the speed of the network convergence and shorten the training time. Our new voiceprint recognition approach uses the TLCNN-RBM (convolutional neural network mixed restricted Boltzmann machine based on transfer learning) model, which is the deep migration hybrid model that is used to achieve an average accuracy of over 97%, which is higher than that when using either CNN or the TL-CNN network (convolutional neural network based on transfer learning). Thus, an effective method for a small sample of voiceprint recognition has been provided.

Tomato pest classification using deep convolutional neural network with transfer learning, fine tuning and scratch learning

2021 ◽  
pp. 1-10
Author(s):  
Gayatri Pattnaik ◽  
Vimal K. Shrivastava ◽  
K. Parvathi
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Transfer Learning ◽  
Data Augmentation ◽  
State Of The Art ◽  
Deep Convolutional Neural Network ◽  
Fine Tuning ◽  
Tomato Plants ◽  
Random Weights

Pests are major threat to economic growth of a country. Application of pesticide is the easiest way to control the pest infection. However, excessive utilization of pesticide is hazardous to environment. The recent advances in deep learning have paved the way for early detection and improved classification of pest in tomato plants which will benefit the farmers. This paper presents a comprehensive analysis of 11 state-of-the-art deep convolutional neural network (CNN) models with three configurations: transfers learning, fine-tuning and scratch learning. The training in transfer learning and fine tuning initiates from pre-trained weights whereas random weights are used in case of scratch learning. In addition, the concept of data augmentation has been explored to improve the performance. Our dataset consists of 859 tomato pest images from 10 categories. The results demonstrate that the highest classification accuracy of 94.87% has been achieved in the transfer learning approach by DenseNet201 model with data augmentation.

Oversampling Based on Data Augmentation in Convolutional Neural Network for Silicon Wafer Defect Classification

2020 ◽  
Author(s):  
Uzma Batool ◽  
Mohd Ibrahim Shapiai ◽  
Nordinah Ismail ◽  
Hilman Fauzi ◽  
Syahrizal Salleh
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Silicon Wafer ◽  
Data Augmentation ◽  
Imbalanced Data ◽  
Training Data ◽  
Defect Classification ◽  
Learning Method ◽  
Test Set

Silicon wafer defect data collected from fabrication facilities is intrinsically imbalanced because of the variable frequencies of defect types. Frequently occurring types will have more influence on the classification predictions if a model gets trained on such skewed data. A fair classifier for such imbalanced data requires a mechanism to deal with type imbalance in order to avoid biased results. This study has proposed a convolutional neural network for wafer map defect classification, employing oversampling as an imbalance addressing technique. To have an equal participation of all classes in the classifier’s training, data augmentation has been employed, generating more samples in minor classes. The proposed deep learning method has been evaluated on a real wafer map defect dataset and its classification results on the test set returned a 97.91% accuracy. The results were compared with another deep learning based auto-encoder model demonstrating the proposed method, a potential approach for silicon wafer defect classification that needs to be investigated further for its robustness.

Sign in / Sign up

Export Citation Format

Share Document