scholarly journals Frequency-Domain Fusing Convolutional Neural Network: A Unified Architecture Improving Effect of Domain Adaptation for Fault Diagnosis

Sensors ◽  
2021 ◽  
Vol 21 (2) ◽  
pp. 450
Author(s):  
Xudong Li ◽  
Jianhua Zheng ◽  
Mingtao Li ◽  
Wenzhen Ma ◽  
Yang Hu
Keyword(s):  
Neural Network ◽  
Fault Diagnosis ◽  
Convolutional Neural Network ◽  
Frequency Domain ◽  
Transfer Learning ◽  
Network Architecture ◽  
Domain Adaptation ◽  
Training Dataset ◽  
Testing Dataset ◽  
Feature Extractor

In recent years, transfer learning has been widely applied in fault diagnosis for solving the problem of inconsistent distribution of the original training dataset and the online-collecting testing dataset. In particular, the domain adaptation method can solve the problem of the unlabeled testing dataset in transfer learning. Moreover, Convolutional Neural Network (CNN) is the most widely used network among existing domain adaptation approaches due to its powerful feature extraction capability. However, network designing is too empirical, and there is no network designing principle from the frequency domain. In this paper, we propose a unified convolutional neural network architecture from a frequency domain perspective for a domain adaptation named Frequency-domain Fusing Convolutional Neural Network (FFCNN). The method of FFCNN contains two parts, frequency-domain fusing layer and feature extractor. The frequency-domain fusing layer uses convolution operations to filter signals at different frequency bands and combines them into new input signals. These signals are input to the feature extractor to extract features and make domain adaptation. We apply FFCNN for three domain adaptation methods, and the diagnosis accuracy is improved compared to the typical CNN.

scholarly journals Deep Domain Adaptation Model for Bearing Fault Diagnosis with Riemann Metric Correlation Alignment

2020 ◽  
Vol 2020 ◽  
pp. 1-12 ◽  
Author(s):  
Jing An ◽  
Ping Ai
Keyword(s):  
Neural Network ◽  
Fault Diagnosis ◽  
Convolutional Neural Network ◽  
Network Architecture ◽  
Domain Adaptation ◽  
Training Data ◽  
Target Domain ◽  
Bearing Fault Diagnosis ◽  
Diagnosis Accuracy ◽  
Riemann Metric

In many real-world fault diagnosis applications, due to the frequent changes in working conditions, the distribution of labeled training data (source domain) is different from the distribution of the unlabeled test data (target domain), which leads to performance degradation. In order to solve this problem, an end-to-end unsupervised domain adaptation bear fault diagnosis model that combines Riemann metric correlation alignment and one-dimensional convolutional neural network (RMCA-1DCNN) is proposed in this study. Second-order statistic alignment of the specific activation layer in source and target domains is considered to be a regularization item and embedded in the deep convolutional neural network architecture to compensate for domain shift. Experimental results on the Case Western Reserve University motor bearing database demonstrate that the proposed method has strong fault-discriminative and domain-invariant capacity. Therefore, the proposed method can achieve higher diagnosis accuracy than that of other existing experimental methods.

Non-Blind Image Deconvolution Based on “Ringing” Removal Using Convolutional Neural Network

2020 ◽  
Vol 2020 (10) ◽  
pp. 181-1-181-7
Author(s):  
Takahiro Kudo ◽  
Takanori Fujisawa ◽  
Takuro Yamaguchi ◽  
Masaaki Ikehara
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Network Architecture ◽  
Large Scale ◽  
Blind Deconvolution ◽  
Training Dataset ◽  
Image Deconvolution ◽  
Classic Problem ◽  
Key Points ◽  
Blind Image

Image deconvolution has been an important issue recently. It has two kinds of approaches: non-blind and blind. Non-blind deconvolution is a classic problem of image deblurring, which assumes that the PSF is known and does not change universally in space. Recently, Convolutional Neural Network (CNN) has been used for non-blind deconvolution. Though CNNs can deal with complex changes for unknown images, some CNN-based conventional methods can only handle small PSFs and does not consider the use of large PSFs in the real world. In this paper we propose a non-blind deconvolution framework based on a CNN that can remove large scale ringing in a deblurred image. Our method has three key points. The first is that our network architecture is able to preserve both large and small features in the image. The second is that the training dataset is created to preserve the details. The third is that we extend the images to minimize the effects of large ringing on the image borders. In our experiments, we used three kinds of large PSFs and were able to observe high-precision results from our method both quantitatively and qualitatively.

scholarly journals Effectiveness of transfer learning for enhancing tumor classification with a convolutional neural network on frozen sections

2020 ◽  
Vol 10 (1) ◽  
Author(s):  
Young-Gon Kim ◽  
Sungchul Kim ◽  
Cristina Eunbee Cho ◽  
In Hye Song ◽  
Hee Jin Lee ◽  
...  
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Transfer Learning ◽  
Frozen Section ◽  
Medical Center ◽  
External Validation ◽  
Model Performance ◽  
Classification Model ◽  
Training Dataset

AbstractFast and accurate confirmation of metastasis on the frozen tissue section of intraoperative sentinel lymph node biopsy is an essential tool for critical surgical decisions. However, accurate diagnosis by pathologists is difficult within the time limitations. Training a robust and accurate deep learning model is also difficult owing to the limited number of frozen datasets with high quality labels. To overcome these issues, we validated the effectiveness of transfer learning from CAMELYON16 to improve performance of the convolutional neural network (CNN)-based classification model on our frozen dataset (N = 297) from Asan Medical Center (AMC). Among the 297 whole slide images (WSIs), 157 and 40 WSIs were used to train deep learning models with different dataset ratios at 2, 4, 8, 20, 40, and 100%. The remaining, i.e., 100 WSIs, were used to validate model performance in terms of patch- and slide-level classification. An additional 228 WSIs from Seoul National University Bundang Hospital (SNUBH) were used as an external validation. Three initial weights, i.e., scratch-based (random initialization), ImageNet-based, and CAMELYON16-based models were used to validate their effectiveness in external validation. In the patch-level classification results on the AMC dataset, CAMELYON16-based models trained with a small dataset (up to 40%, i.e., 62 WSIs) showed a significantly higher area under the curve (AUC) of 0.929 than those of the scratch- and ImageNet-based models at 0.897 and 0.919, respectively, while CAMELYON16-based and ImageNet-based models trained with 100% of the training dataset showed comparable AUCs at 0.944 and 0.943, respectively. For the external validation, CAMELYON16-based models showed higher AUCs than those of the scratch- and ImageNet-based models. Model performance for slide feasibility of the transfer learning to enhance model performance was validated in the case of frozen section datasets with limited numbers.

A novel adaptive and fast deep convolutional neural network for bearing fault diagnosis under different working conditions

2019 ◽  
Vol 234 (4) ◽  
pp. 1167-1182 ◽  
Author(s):  
Kun Xu ◽  
Shunming Li ◽  
Jinrui Wang ◽  
Zenghui An ◽  
Yu Xin
Keyword(s):  
Neural Network ◽  
Fault Diagnosis ◽  
Receptive Field ◽  
Convolutional Neural Network ◽  
Network Model ◽  
Working Conditions ◽  
Neural Network Model ◽  
Network Architecture ◽  
Deep Convolutional Neural Network ◽  
Mechanical Equipment

Deep learning method is gradually applied in the field of mechanical equipment fault diagnosis because it can learn complex and useful features automatically from the vibration signals. Among the many intelligent diagnostic models, convolutional neural network has been gradually applied to intelligent fault diagnosis of bearings due to its advantages of local connection and weight sharing. However, there are still some drawbacks. (1) The training process of convolutional neural network is slow and unstable. It has more training parameters. (2) It cannot perform well under different working conditions, such as noisy environment and different workloads. In this paper, a novel model named adaptive and fast convolutional neural network with wide receptive field is presented to overcome the aforementioned deficiencies. The prime innovations include the following. First, a deep convolutional neural network architecture is constructed using the scaled exponential linear unit activation function and global average pooling. The model has fewer training parameters and can converge rapidly and stably. Second, the model has a wide receptive field with two medium and three small length convolutional kernels. It also has high diagnostic accuracy and robustness when the environment is noisy and workloads are changed compared with other models. Furthermore, to demonstrate how the wide receptive field convolutional neural network model works, the reasons for high model performance are analyzed and the learned features are also visualized. Finally, the wide receptive field convolutional neural network model is verified by the vibration dataset collected in the background of high noise, and the results indicate that it has high diagnostic performance.

Cross-domain gearbox diagnostics under variable working conditions with deep convolutional transfer learning

2020 ◽  
pp. 107754632093379
Author(s):  
Moslem Azamfar ◽  
Jaskaran Singh ◽  
Xiang Li ◽  
Jay Lee
Keyword(s):  
Fault Diagnosis ◽  
Transfer Learning ◽  
High Performance ◽  
Training Sample ◽  
Training Dataset ◽  
Target Domain ◽  
Training Sample Size ◽  
Vibration Data ◽  
Cross Domain ◽  
Testing Dataset

This study proposes a novel 1D deep convolutional transfer learning method that is able to learn the high-dimensional domain-invariant feature from the labeled training dataset and perform diagnosis tasks on the unlabeled testing dataset subjected to a domain shift. To obtain the domain-invariant features, the cross-entropy loss in the source domain classifier and the maximum mean discrepancies between the source and target domain data are minimized simultaneously. To evaluate the performance of the proposed method, an experimental study is conducted on a gearbox under significant speed variation. Because of inherent limitations of the vibration data, in this research, the effectiveness of torque measurement signals has been explored for gearbox fault diagnosis. Comprehensive studies on network parameters and the training sample size are performed to illustrate the robustness and effectiveness of the proposed method. A comparison study is performed on similar techniques to illustrate the superiority and high performance of the proposed diagnosis method. The achieved results illustrate the effectiveness of torque signal in multiclass cross-domain fault diagnosis of gearboxes.

scholarly journals Fault Diagnosis of Reciprocating Compressor Valve Based on Transfer Learning Convolutional Neural Network

2021 ◽  
Vol 2021 ◽  
pp. 1-13
Author(s):  
Fu-Yan Guo ◽  
Yan-Chao Zhang ◽  
Yue Wang ◽  
Pei-Jun Ren ◽  
Ping Wang
Keyword(s):  
Neural Network ◽  
Fault Diagnosis ◽  
Convolutional Neural Network ◽  
Transfer Learning ◽  
Recognition Rate ◽  
Vital Role ◽  
Stable Operation ◽  
Reciprocating Compressor ◽  
Gas Temperature ◽  
Label Prediction

Reciprocating compressors play a vital role in oil, natural gas, and general industrial processes. Their safe and stable operation directly affects the healthy development of the enterprise economy. Since the valve failure accounts for 60% of the total failures when the reciprocating compressor fails, it is of great significance to quickly find and diagnose the failure type of the valve for the fault diagnosis of the reciprocating compressor. At present, reciprocating compressor valve fault diagnosis based on deep neural networks requires sufficient labeled data for training, but valve in real-case reciprocating compressor (VRRC) does not have enough labeled data to train a reliable model. Fortunately, the data of valve in laboratory reciprocating compressor (VLRC) contains relevant fault diagnosis knowledge. Therefore, inspired by the idea of transfer learning, a fault diagnosis method for reciprocating compressor valves based on transfer learning convolutional neural network (TCNN) is proposed. This method uses convolutional neural network (CNN) to extract the transferable features of gas temperature and pressure data from VLRC and VRRC and establish pseudolabels for VRRC unlabeled data. Three regularization terms, the maximum mean discrepancy (MMD) of the transferable features of VLRC and VRRC data, the error between the VLRC sample label prediction and the actual label, and the error between the VRRC sample label prediction and the pseudolabel, are proposed. Their weighted sum is used as an objective function to train the model, thereby reducing the distribution difference of domain feature transfer and increasing the distance between learning feature classes. Experimental results show that this method uses VLRC data to identify the health status of VRRC, and the fault recognition rate can reach 98.32%. Compared with existing methods, this method has higher diagnostic accuracy, which proves the effectiveness of this method.

A domain adaptation model for early gear pitting fault diagnosis based on deep transfer learning network

2019 ◽  
Vol 234 (1) ◽  
pp. 168-182 ◽  
Author(s):  
Jialin Li ◽  
Xueyi Li ◽  
David He ◽  
Yongzhi Qu
Keyword(s):  
Neural Network ◽  
Fault Diagnosis ◽  
Transfer Learning ◽  
Working Conditions ◽  
Deep Neural Network ◽  
Domain Adaptation ◽  
Diagnostic Model ◽  
Target Domain ◽  
Vibration Signals ◽  
Learning Network

In recent years, research on gear pitting fault diagnosis has been conducted. Most of the research has focused on feature extraction and feature selection process, and diagnostic models are only suitable for one working condition. To diagnose early gear pitting faults under multiple working conditions, this article proposes to develop a domain adaptation diagnostic model–based improved deep neural network and transfer learning with raw vibration signals. A particle swarm optimization algorithm and L2 regularization are used to optimize the improved deep neural network to improve the stability and accuracy of the diagnosis. When using the domain adaptation diagnostic model for fault diagnosis, it is necessary to discriminate whether the target domain (test data) is the same as the source domain (training data). If the target domain and the source domain are consistent, the trained improved deep neural network can be used directly for diagnosis. Otherwise, the transfer learning is combined with improved deep neural network to develop a deep transfer learning network to improve the domain adaptability of the diagnostic model. Vibration signals for seven gear types with early pitting faults under 25 working conditions collected from a gear test rig are used to validate the proposed method. It is confirmed by the validation results that the developed domain adaptation diagnostic model has a significant improvement in the adaptability of multiple working conditions.

Sign in / Sign up

Export Citation Format

Share Document