Interpretability of deep convolutional neural networks on rolling bearing fault diagnosis

2021 ◽  
Author(s):  
Huixin Yang ◽  
Xiang Li ◽  
Wei Zhang
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Deep Learning ◽  
Fault Diagnosis ◽  
Deep Neural Network ◽  
Rapid Development ◽  
Saliency Map ◽  
Data Driven ◽  
Experimental Investigations ◽  
Deep Convolutional Neural Networks

Abstract Despite the rapid development of deep learning-based intelligent fault diagnosis methods on rotating machinery, the data-driven approach generally remains a "black box" to researchers, and its internal mechanism has not been sufficiently understood. The weak interpretability significantly impedes further development and applications of the effective deep neural network-based methods. This paper contributes efforts to understanding the mechanical signal processing of deep learning on the fault diagnosis problems. The diagnostic knowledge learned by the deep neural network is visualized using the neuron activation maximization and the saliency map methods. The discriminative features of different machine health conditions are intuitively observed. The relationship between the data-driven methods and the well-established conventional fault diagnosis knowledge is confirmed by the experimental investigations on two datasets. The results of this study can benefit researchers on understanding the complex neural networks, and increase the reliability of the data-driven fault diagnosis model in the real engineering cases.

Deep distributed convolutional neural networks: Universality

2018 ◽  
Vol 16 (06) ◽  
pp. 895-919 ◽  
Author(s):  
Ding-Xuan Zhou
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Deep Learning ◽  
Convolutional Neural Networks ◽  
Deep Neural Network ◽  
Deep Neural Networks ◽  
Mathematical Foundation ◽  
Deep Convolutional Neural Networks ◽  
The Family ◽  
Fully Connected

Deep learning based on structured deep neural networks has provided powerful applications in various fields. The structures imposed on the deep neural networks are crucial, which makes deep learning essentially different from classical schemes based on fully connected neural networks. One of the commonly used deep neural network structures is generated by convolutions. The produced deep learning algorithms form the family of deep convolutional neural networks. Despite of their power in some practical domains, little is known about the mathematical foundation of deep convolutional neural networks such as universality of approximation. In this paper, we propose a family of new structured deep neural networks: deep distributed convolutional neural networks. We show that these deep neural networks have the same order of computational complexity as the deep convolutional neural networks, and we prove their universality of approximation. Some ideas of our analysis are from ridge approximation, wavelets, and learning theory.

Teeth and Landmarks Detection and Classification Based on Deep Neural Networks

2019 ◽  
pp. 129-150
Author(s):  
Lyudmila N. Tuzova ◽  
Dmitry V. Tuzoff ◽  
Sergey I. Nikolenko ◽  
Alexey S. Krasnov
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Image Analysis ◽  
Deep Learning ◽  
Deep Neural Network ◽  
Deep Neural Networks ◽  
Rapid Development ◽  
Image Interpretation ◽  
Semantic Segmentation ◽  
Recent Decade

In the recent decade, deep neural networks have enjoyed rapid development in various domains, including medicine. Convolutional neural networks (CNNs), deep neural network structures commonly used for image interpretation, brought the breakthrough in computer vision and became state-of-the-art techniques for various image recognition tasks, such as image classification, object detection, and semantic segmentation. In this chapter, the authors provide an overview of deep learning algorithms and review available literature for dental image analysis with methods based on CNNs. The present study is focused on the problems of landmarks and teeth detection and classification, as these tasks comprise an essential part of dental image interpretation both in clinical dentistry and in human identification systems based on the dental biometrical information.

scholarly journals Comparisons of different deep learning-based methods on fault diagnosis for geared system

2019 ◽  
Vol 15 (11) ◽  
pp. 155014771988816 ◽  
Author(s):  
Bing Han ◽  
Xiaohui Yang ◽  
Yafeng Ren ◽  
Wanggui Lan
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Fault Diagnosis ◽  
Convolutional Neural Network ◽  
Mechanical System ◽  
Network Model ◽  
Learning Theory ◽  
Neural Network Model ◽  
Deep Neural Network ◽  
Gear Fault

The running state of a geared transmission system affects the stability and reliability of the whole mechanical system. It will greatly reduce the maintenance cost of a mechanical system to identify the faulty state of the geared transmission system. Based on the measured gear fault vibration signals and the deep learning theory, four fault diagnosis neural network models including fast Fourier transform–deep belief network model, wavelet transform–convolutional neural network model, Hilbert-Huang transform–convolutional neural network model, and comprehensive deep neural network model are developed and trained respectively. The results show that the gear fault diagnosis method based on deep learning theory can effectively identify various gear faults under real test conditions. The comprehensive deep neural network model is the most effective one in gear fault recognition.

scholarly journals Fault Diagnosis of Rotary Machines Using Deep Convolutional Neural Network with Wide Three Axis Vibration Signal Input

Sensors ◽  
2020 ◽  
Vol 20 (14) ◽  
pp. 4017 ◽  
Author(s):  
Davor Kolar ◽  
Dragutin Lisjak ◽  
Michał Pająk ◽  
Danijel Pavković
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Deep Learning ◽  
Fault Diagnosis ◽  
Convolutional Neural Network ◽  
Input Matrix ◽  
Accelerometer Signal ◽  
Rotary Machinery ◽  
Signal Input

Fault diagnosis is considered as an essential task in rotary machinery as possibility of an early detection and diagnosis of the faulty condition can save both time and money. This work presents developed and novel technique for deep-learning-based data-driven fault diagnosis for rotary machinery. The proposed technique input raw three axes accelerometer signal as high definition 1D image into deep learning layers which automatically extract signal features, enabling high classification accuracy. Unlike the researches carried out by other researchers, accelerometer data matrix with dimensions 6400 × 1 × 3 is used as input for convolutional neural network training. Since convolutional neural networks can recognize patterns across input matrix, it is expected that wide input matrix containing vibration data should yield good classification performance. Using convolutional neural networks (CNN) trained model, classification in one of the four classes can be performed. Additionally, number of kernels of CNN is optimized using grid search, as preliminary studies show that alternating number of kernels impacts classification results. This study accomplished the effective classification of different rotary machinery states using convolutional artificial neural network for classification of raw three axis accelerometer signal input.

scholarly journals Research and Application of Ancient Chinese Pattern Restoration Based on Deep Convolutional Neural Network

2021 ◽  
Vol 2021 ◽  
pp. 1-15
Author(s):  
Xuhui Fu
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Image Restoration ◽  
Deep Convolutional Neural Network ◽  
Deep Convolutional Neural Networks ◽  
Multilayer Network ◽  
Restoration Method ◽  
Restoration Effect

In recent years, deep learning, as a very popular artificial intelligence method, can be said to be a small area in the field of image recognition. It is a type of machine learning, actually derived from artificial neural networks, and is a method used to learn the characteristics of sample data. It is a multilayer network, which can learn the information from the bottom to the top of the image through the multilayer network, so as to extract the characteristics of the sample, and then perform identification and classification. The purpose of deep learning is to make the machine have the same analytical and learning capabilities as the human brain. The ability of deep learning in data processing (including images) is unmatched by other methods, and its achievements in recent years have left other methods behind. This article comprehensively reviews the application research progress of deep convolutional neural networks in ancient Chinese pattern restoration and mainly focuses on the research based on deep convolutional neural networks. The main tasks are as follows: (1) a detailed and comprehensive introduction to the basic knowledge of deep convolutional neural and a summary of related algorithms along the three directions of text preprocessing, learning, and neural networks are provided. This article focuses on the related mechanism of traditional pattern repair based on deep convolutional neural network and analyzes the key structure and principle. (2) Research on image restoration models based on deep convolutional networks and adversarial neural networks is carried out. The model is mainly composed of four parts, namely, information masking, feature extraction, generating network, and discriminant network. The main functions of each part are independent and interdependent. (3) The method based on the deep convolutional neural network and the other two methods are tested on the same part of the Qinghai traditional embroidery image data set. From the final evaluation index of the experiment, the method in this paper has better evaluation index than the traditional image restoration method based on samples and the image restoration method based on deep learning. In addition, from the actual image restoration effect, the method in this paper has a better image restoration effect than the other two methods, and the restoration results produced are more in line with the habit of human observation with the naked eye.

scholarly journals Image Classification: A Survey

2020 ◽  
Vol 1 (2) ◽  
pp. 1-9
Author(s):  
Ankita Singh ◽  
◽  
Pawan Singh
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Deep Learning ◽  
Image Classification ◽  
Convolutional Neural Networks ◽  
Language Processing ◽  
Classification Accuracy ◽  
Deep Neural Network ◽  
Learning Ability ◽  
Final Decision

The Classification of images is a paramount topic in artificial vision systems which have drawn a notable amount of interest over the past years. This field aims to classify an image, which is an input, based on its visual content. Currently, most people relied on hand-crafted features to describe an image in a particular way. Then, using classifiers that are learnable, such as random forest, and decision tree was applied to the extract features to come to a final decision. The problem arises when large numbers of photos are concerned. It becomes a too difficult problem to find features from them. This is one of the reasons that the deep neural network model has been introduced. Owing to the existence of Deep learning, it can become feasible to represent the hierarchical nature of features using a various number of layers and corresponding weight with them. The existing image classification methods have been gradually applied in real-world problems, but then there are various problems in its application processes, such as unsatisfactory effect and extremely low classification accuracy or then and weak adaptive ability. Models using deep learning concepts have robust learning ability, which combines the feature extraction and the process of classification into a whole which then completes an image classification task, which can improve the image classification accuracy effectively. Convolutional Neural Networks are a powerful deep neural network technique. These networks preserve the spatial structure of a problem and were built for object recognition tasks such as classifying an image into respective classes. Neural networks are much known because people are getting a state-of-the-art outcome on complex computer vision and natural language processing tasks. Convolutional neural networks have been extensively used.

scholarly journals Intelligent fault diagnosis of rotating machinery based on deep learning with feature selection

2019 ◽  
Vol 39 (4) ◽  
pp. 939-953 ◽  
Author(s):  
Dongying Han ◽  
Kai Liang ◽  
Peiming Shi
Keyword(s):  
Neural Network ◽  
Feature Selection ◽  
Deep Learning ◽  
Fault Diagnosis ◽  
Time Domain ◽  
Deep Neural Network ◽  
Intrinsic Mode Function ◽  
Mode Function ◽  
Mode Decomposition ◽  
Fault Features

In the absence of a priori knowledge, manual feature selection is too blind to find the sensitive features which can effectively classify the different fault features. And it is difficult to obtain a large number of typical fault samples in practice to train the intelligent classifier. A novel intelligent fault diagnosis method based on feature selection and deep learning is proposed for rotating machine mechanical in the paper. In this method, the deep neural network is not only used for feature extraction but also for fault diagnosis. First, the deep neural network 1 is used to extract feature from the spectral signal of the original signal. In addition, the original vibration signal is decomposed to a series of intrinsic mode function components by empirical mode decomposition, and the statistical features of each intrinsic mode function component are extracted by the deep neural network 2 in time domain and frequency domain. Second, the extraction features of the original signal spectrum and the extraction features of each intrinsic mode function component are evaluated, respectively. After features evaluation, the selected sensitive features are combined together to construct a joint feature. Finally, the joint feature is put into the deep neural network 3 to realize the automatic recognition of different fault states of rotating machinery. The experimental results show that the method proposed in this paper which integrated time-domain, frequency-domain statistical characteristics, empirical mode decomposition, feature selection, and deep learning methods can obtain the fault information in detail and can select sensitive features from a large number of fault features. The method can reduce the network size, improve the mechanical fault diagnosis classification accuracy, and has strong robustness.

scholarly journals CheXLocNet: Automatic localization of pneumothorax in chest radiographs using deep convolutional neural networks

PLoS ONE ◽  
2020 ◽  
Vol 15 (11) ◽  
pp. e0242013
Author(s):  
Hongyu Wang ◽  
Hong Gu ◽  
Pan Qin ◽  
Jia Wang
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Deep Learning ◽  
Convolutional Neural Networks ◽  
Characteristic Curve ◽  
Healthcare Delivery ◽  
Chest Radiographs ◽  
Training Dataset ◽  
Deep Convolutional Neural Networks ◽  
Support Tool

Background Pneumothorax can lead to a life-threatening emergency. The experienced radiologists can offer precise diagnosis according to the chest radiographs. The localization of the pneumothorax lesions will help to quickly diagnose, which will be benefit for the patients in the underdevelopment areas lack of the experienced radiologists. In recent years, with the development of large neural network architectures and medical imaging datasets, deep learning methods have become a methodology of choice for analyzing medical images. The objective of this study was to the construct convolutional neural networks to localize the pneumothorax lesions in chest radiographs. Methods and findings We developed a convolutional neural network, called CheXLocNet, for the segmentation of pneumothorax lesions. The SIIM-ACR Pneumothorax Segmentation dataset was used to train and validate CheXLocNets. The training dataset contained 2079 radiographs with the annotated lesion areas. We trained six CheXLocNets with various hyperparameters. Another 300 annotated radiographs were used to select parameters of these CheXLocNets as the validation set. We determined the optimal parameters by the AP50 (average precision at the intersection over union (IoU) equal to 0.50), a segmentation evaluation metric used by several well-known competitions. Then CheXLocNets were evaluated by a test set (1082 normal radiographs and 290 disease radiographs), based on the classification metrics: area under the receiver operating characteristic curve (AUC), sensitivity, specificity, and positive predictive value (PPV); segmentation metrics: IoU and Dice score. For the classification, CheXLocNet with best sensitivity produced an AUC of 0.87, sensitivity of 0.78 (95% CI 0.73-0.83), and specificity of 0.78 (95% CI 0.76-0.81). CheXLocNet with best specificity produced an AUC of 0.79, sensitivity of 0.46 (95% CI 0.40-0.52), and specificity of 0.92 (95% CI 0.90-0.94). For the segmentation, CheXLocNet with best sensitivity produced an IoU of 0.69 and Dice score of 0.72. CheXLocNet with best specificity produced an IoU of 0.77 and Dice score of 0.79. We combined them to form an ensemble CheXLocNet. The ensemble CheXLocNet produced an IoU of 0.81 and Dice score of 0.82. Our CheXLocNet succeeded in automatically detecting pneumothorax lesions, without any human guidance. Conclusions In this study, we proposed a deep learning network, called, CheXLocNet, for the automatic segmentation of chest radiographs to detect pneumothorax. Our CheXLocNets generated accurate classification results and high-quality segmentation masks for the pneumothorax at the same time. This technology has the potential to improve healthcare delivery and increase access to chest radiograph expertise for the detection of diseases. Furthermore, the segmentation results can offer comprehensive geometric information of lesions, which can benefit monitoring the sequential development of lesions with high accuracy. Thus, CheXLocNets can be further extended to be a reliable clinical decision support tool. Although we used transfer learning in training CheXLocNet, the parameters of CheXLocNet was still large for the radiograph dataset. Further work is necessary to prune CheXLocNet suitable for the radiograph dataset.

scholarly journals GAIT RECOGNITION BASED ON CONVOLUTIONAL NEURAL NETWORKS

2017 ◽  
Vol XLII-2/W4 ◽  
pp. 207-212 ◽  
Author(s):  
A. Sokolova ◽  
A. Konushin
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Feature Extraction ◽  
Deep Learning ◽  
Deep Neural Network ◽  
Gait Recognition ◽  
Learning Approach ◽  
Network Architectures ◽  
Motion Information ◽  
Advantages And Disadvantages

In this work we investigate the problem of people recognition by their gait. For this task, we implement deep learning approach using the optical flow as the main source of motion information and combine neural feature extraction with the additional embedding of descriptors for representation improvement. In order to find the best heuristics, we compare several deep neural network architectures, learning and classification strategies. The experiments were made on two popular datasets for gait recognition, so we investigate their advantages and disadvantages and the transferability of considered methods.

scholarly journals A deep neural network approach to predicting clinical outcomes of neuroblastoma patients

2019 ◽  
Author(s):  
Léon-Charles Tranchevent ◽  
Francisco Azuaje ◽  
Jagath C. Rajapakse
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Deep Learning ◽  
Clinical Outcomes ◽  
Deep Neural Network ◽  
Superior Performance ◽  
Support Vector ◽  
Disease Etiology ◽  
Topological Features ◽  
Wide Range

AbstractThe availability of high-throughput omics datasets from large patient cohorts has allowed the development of methods that aim at predicting patient clinical outcomes, such as survival and disease recurrence. Such methods are also important to better understand the biological mechanisms underlying disease etiology and development, as well as treatment responses. Recently, different predictive models, relying on distinct algorithms (including Support Vector Machines and Random Forests) have been investigated. In this context, deep learning strategies are of special interest due to their demonstrated superior performance over a wide range of problems and datasets. One of the main challenges of such strategies is the “small n large p” problem. Indeed, omics datasets typically consist of small numbers of samples and large numbers of features relative to typical deep learning datasets. Neural networks usually tackle this problem through feature selection or by including additional constraints during the learning process.We propose to tackle this problem with a novel strategy that relies on a graph-based method for feature extraction, coupled with a deep neural network for clinical outcome prediction. The omics data are first represented as graphs whose nodes represent patients, and edges represent correlations between the patients’ omics profiles. Topological features, such as centralities, are then extracted from these graphs for every node. Lastly, these features are used as input to train and test various classifiers.We apply this strategy to four neuroblastoma datasets and observe that models based on neural networks are more accurate than state of the art models (DNN: 85%-87%, SVM/RF: 75%-82%). We explore how different parameters and configurations are selected in order to overcome the effects of the small data problem as well as the curse of dimensionality. Our results indicate that the deep neural networks capture complex features in the data that help predicting patient clinical outcomes.

Sign in / Sign up

Export Citation Format

Share Document