Alignment subdomain based deep convolutional transfer learning for machinery fault diagnosis under different working conditions

2021 ◽  
Author(s):  
Yibing Li ◽  
Hu Wan ◽  
Li Jiang
Keyword(s):  
Fault Diagnosis ◽  
Transfer Learning ◽  
Working Conditions ◽  
Local Maximum ◽  
Mean Difference ◽  
Global Distribution ◽  
Target Domain ◽  
Learning Methods ◽  
Time Frequency ◽  
Machinery Fault Diagnosis

Abstract In recent years, transfer learning methods have been extensively used in machinery fault diagnosis under different working conditions. However, most of these transfer learning methods perform poorly in the actual industrial applications, due to the fact that they mainly focus on the global distribution of different domains without considering the distribution of subdomains belonging to the same category in different domains. Therefore, we propose an alignment subdomain-based deep convolutional transfer learning (AS-DCTL) network for machinery fault diagnosis. First, continuous wavelet transform is used to transform the original vibration signal into a two-dimensional time-frequency image. Then, AS-DCTL uses convolutional neural network as the feature extractor to extract the features of the source and target domain samples and introduces maximum mean difference to align the global distribution of the extracted features. Simultaneously, we use local maximum mean difference as a metric criterion to align the distribution of related subdomains, by adding weights to similar samples in the source domain and target domain. The experimental results of the two case studies show that the proposed AS-DCTL network can achieve higher recognition accuracy and classification effect, in comparison with the current mainstream transfer learning methods.

A domain adaptation model for early gear pitting fault diagnosis based on deep transfer learning network

2019 ◽  
Vol 234 (1) ◽  
pp. 168-182 ◽  
Author(s):  
Jialin Li ◽  
Xueyi Li ◽  
David He ◽  
Yongzhi Qu
Keyword(s):  
Neural Network ◽  
Fault Diagnosis ◽  
Transfer Learning ◽  
Working Conditions ◽  
Deep Neural Network ◽  
Domain Adaptation ◽  
Diagnostic Model ◽  
Target Domain ◽  
Vibration Signals ◽  
Learning Network

In recent years, research on gear pitting fault diagnosis has been conducted. Most of the research has focused on feature extraction and feature selection process, and diagnostic models are only suitable for one working condition. To diagnose early gear pitting faults under multiple working conditions, this article proposes to develop a domain adaptation diagnostic model–based improved deep neural network and transfer learning with raw vibration signals. A particle swarm optimization algorithm and L2 regularization are used to optimize the improved deep neural network to improve the stability and accuracy of the diagnosis. When using the domain adaptation diagnostic model for fault diagnosis, it is necessary to discriminate whether the target domain (test data) is the same as the source domain (training data). If the target domain and the source domain are consistent, the trained improved deep neural network can be used directly for diagnosis. Otherwise, the transfer learning is combined with improved deep neural network to develop a deep transfer learning network to improve the domain adaptability of the diagnostic model. Vibration signals for seven gear types with early pitting faults under 25 working conditions collected from a gear test rig are used to validate the proposed method. It is confirmed by the validation results that the developed domain adaptation diagnostic model has a significant improvement in the adaptability of multiple working conditions.

scholarly journals Rotating machinery fault diagnosis by deep adversarial transfer learning based on subdomain adaptation

2021 ◽  
Vol 13 (8) ◽  
pp. 168781402110402
Author(s):  
Jiajie Shao ◽  
Zhiwen Huang ◽  
Yidan Zhu ◽  
Jianmin Zhu ◽  
Dianjun Fang
Keyword(s):  
Fault Diagnosis ◽  
Transfer Learning ◽  
Working Conditions ◽  
Diagnostic Performance ◽  
Domain Adaptation ◽  
Rotating Machinery ◽  
Learning Method ◽  
Migration Ability ◽  
Adversarial Learning ◽  
Machinery Fault Diagnosis

Rotating machinery fault diagnosis is very important for industrial production. Many intelligent fault diagnosis technologies are successfully applied and achieved good results. Due to the fact that machine damages usually happen under different working conditions, and manual scale labeled data are too expensive, domain adaptation has been developed for fault diagnosis. However, the current methods mostly focus on global domain adaptation, the application of subdomain adaptation for fault diagnosis is still limited. A deep transfer learning method is proposed for rotating machinery fault diagnosis in this study, where subdomain adaptation and adversarial learning are introduced to align local feature distribution and global feature distribution separately. Experiments are performed on two rotating machinery datasets to verify the effectiveness of this method. The results reveal that this method has outstanding mutual migration ability and can improve the diagnostic performance.

scholarly journals Spacecraft Intelligent Fault Diagnosis under Variable Working Conditions via Wasserstein Distance-Based Deep Adversarial Transfer Learning

2021 ◽  
Vol 2021 ◽  
pp. 1-16
Author(s):  
Gang Xiang ◽  
Kun Tian
Keyword(s):  
Fault Diagnosis ◽  
Transfer Learning ◽  
Working Conditions ◽  
Manufacturing Industry ◽  
Probability Distributions ◽  
Wasserstein Distance ◽  
Target Domain ◽  
Target Feature ◽  
Generative Adversarial Network ◽  
Adversarial Network

In recent years, deep learning methods which promote the accuracy and efficiency of fault diagnosis task without any extra requirement of artificial feature extraction have elicited the attention of researchers in the field of manufacturing industry as well as aerospace. However, the problems that data in source and target domains usually have different probability distributions because of different working conditions and there are insufficient labeled or even unlabeled data in target domain significantly deteriorate the performance and generalization of deep fault diagnosis models. To address these problems, we propose a novel Wasserstein Generative Adversarial Network with Gradient Penalty- (WGAN-GP-) based deep adversarial transfer learning (WDATL) model in this study, which exploits a domain critic to learn domain invariant feature representations by minimizing the Wasserstein distance between the source and target feature distributions through adversarial training. Moreover, an improved one-dimensional convolutional neural network- (CNN-) based feature extractor which utilizes exponential linear units (ELU) as activation functions and wide kernels is designed to automatically extract the latent features of raw time-series input data. Then, the fault model classifier trained in one working condition (source domain) with sufficient labeled samples could be generalized to diagnose data in other working conditions (target domain) with insufficient labeled samples. Experiments on two open datasets demonstrate that our proposed WDATL model outperforms most of the state-of-the-art approaches on transfer diagnosis tasks under diverse working circumstances.

scholarly journals Generative Transfer Learning for Intelligent Fault Diagnosis of the Wind Turbine Gearbox

Sensors ◽  
2020 ◽  
Vol 20 (5) ◽  
pp. 1361 ◽  
Author(s):  
Jianwen Guo ◽  
Jiapeng Wu ◽  
Shaohui Zhang ◽  
Jianyu Long ◽  
Weidong Chen ◽  
...  
Keyword(s):  
Fault Diagnosis ◽  
Wind Turbine ◽  
Transfer Learning ◽  
Domain Adaptation ◽  
Industrial Applications ◽  
Classification Model ◽  
Intelligent Fault Diagnosis ◽  
Target Domain ◽  
Wind Turbine Gearbox ◽  
Time Frequency

Intelligent fault diagnosis algorithms based on machine learning and deep learning techniques have been widely used in industrial applications and have obtained much attention as well as achievements. In real industrial applications, working loads of machines are always changing. Hence, directly applying the traditional algorithms will cause significant degradation of performance with changing conditions. In this paper, a novel domain adaptation method, named generative transfer learning (GTL), is proposed to tackle this problem. First, raw datasets were transformed to time–frequency domain based on short-time Fourier transformation. A domain discriminator was then built to distinguish whether the data came from the source or the target domain. A target domain classification model was finally acquired by the feature extractor and the classifier. Experiments were carried out for the fault diagnosis of a wind turbine gearbox. The t-distributed stochastic neighbor embedding technique was used to visualize the output features for checking the effectiveness of the proposed algorithm in feature extraction. The results showed that the proposed GTL could improve classification rates under various working loads. Compared with other domain adaptation algorithms, the proposed method exhibited not only higher accuracy but faster convergence speed as well.

scholarly journals One-Dimensional Multi-Scale Domain Adaptive Network for Bearing-Fault Diagnosis under Varying Working Conditions

Sensors ◽  
2020 ◽  
Vol 20 (21) ◽  
pp. 6039
Author(s):  
Kai Wang ◽  
Wei Zhao ◽  
Aidong Xu ◽  
Peng Zeng ◽  
Shunkun Yang
Keyword(s):  
Fault Diagnosis ◽  
Transfer Learning ◽  
Working Conditions ◽  
Target Domain ◽  
One Dimensional ◽  
Bearing Fault ◽  
Bearing Fault Diagnosis ◽  
Multi Scale ◽  
Classifier Adaptation ◽  
Feature Adaptation

Data-driven bearing-fault diagnosis methods have become a research hotspot recently. These methods have to meet two premises: (1) the distributions of the data to be tested and the training data are the same; (2) there are a large number of high-quality labeled data. However, machines usually work under different working conditions in practice, which challenges these prerequisites due to the fact that the data distributions under different working conditions are different. In this paper, the one-dimensional Multi-Scale Domain Adaptive Network (1D-MSDAN) is proposed to address this issue. The 1D-MSDAN is a kind of deep transfer model, which uses both feature adaptation and classifier adaptation to guide the multi-scale convolutional neural network to perform bearing-fault diagnosis under varying working conditions. Feature adaptation is performed by both multi-scale feature adaptation and multi-level feature adaptation, which helps in finding domain-invariant features by minimizing the distribution discrepancy between different working conditions by using the Multi-kernel Maximum Mean Discrepancy (MK-MMD). Furthermore, classifier adaptation is performed by entropy minimization in the target domain to bridge the source classifier and target classifier to further eliminate domain discrepancy. The Case Western Reserve University (CWRU) bearing database is used to validate the proposed 1D-MSDAN. The experimental results show that the diagnostic accuracy for the 12 transfer tasks performed by 1D-MSDAN was superior to that of the mainstream transfer learning models for bearing-fault diagnosis under variable working conditions. In addition, the transfer learning performance of 1D-MSDAN for multi-target domain adaptation and real industrial scenarios was also verified.

scholarly journals Rolling Bearing Fault Diagnosis Based on Sensitive Feature Transfer Learning and Local Maximum Margin Criterion under Variable Working Condition

2020 ◽  
Vol 2020 ◽  
pp. 1-34
Author(s):  
Shiyuan Liu ◽  
Xiao Yu ◽  
Xu Qian ◽  
Fei Dong
Keyword(s):  
Fault Diagnosis ◽  
Transfer Learning ◽  
Working Conditions ◽  
Local Maximum ◽  
Industrial Applications ◽  
Feature Reduction ◽  
Machine Learning Techniques ◽  
Mean Deviation ◽  
Maximum Margin ◽  
Maximum Margin Criterion

In real industrial scenarios, the working conditions of bearings are variable, and it is therefore difficult for data-driven diagnosis methods based on conventional machine-learning techniques to guarantee the desirable performance of diagnosis models, as the models assume that the distributions of both the training and testing data are the same. To enhance the performance of the fault diagnosis of bearings under different working conditions, a novel diagnosis framework inspired by feature extraction, transfer learning (TL), and feature dimensionality reduction is proposed in this work, and dual-tree complex wavelet packet transform (DTCWPT) is used for signal processing. Additionally, transferable sensitive feature selection by ReliefF and the sum of mean deviation (TSFSR) is proposed to reduce the redundant information of the original feature set, to select sensitive features for fault diagnosis, and to reduce the difference between the marginal distributions of the training and testing feature sets. Furthermore, a modified feature reduction method, the local maximum margin criterion (LMMC), is proposed to acquire low-dimensional mapping for high-dimensional feature spaces. Finally, bearing vibration signals collected from two test rigs are analyzed to demonstrate the adaptability, effectiveness, and practicability of the proposed diagnosis framework. The experimental results show that the proposed method can achieve high diagnosis accuracy and has significant potential benefits in industrial applications.

scholarly journals Fault Diagnosis under Variable Working Conditions Based on STFT and Transfer Deep Residual Network

2020 ◽  
Vol 2020 ◽  
pp. 1-18 ◽  
Author(s):  
Yan Du ◽  
Aiming Wang ◽  
Shuai Wang ◽  
Baomei He ◽  
Guoying Meng
Keyword(s):  
Deep Learning ◽  
Fault Diagnosis ◽  
Transfer Learning ◽  
Working Conditions ◽  
Classification Accuracy ◽  
Working Condition ◽  
Learning Ability ◽  
Residual Network ◽  
Time Frequency ◽  
Residual Learning

Fault diagnosis plays a very important role in ensuring the safe and reliable operations of machines. Currently, the deep learning-based fault diagnosis is attracting increasing attention. However, fault diagnosis under variable working conditions has been a significant challenge due to the domain discrepancy problem. This problem is also unavoidable in deep learning-based fault diagnosis methods. This paper contributes to the ongoing investigation by proposing a new approach for the fault diagnosis under variable working conditions based on STFT and transfer deep residual network (TDRN). The STFT was employed to convert vibration signal to time-frequency image as the input of the TDRN. To address the domain discrepancy problem, the TDRN was developed in this paper. Unlike traditional deep convolutional neural network (DCNN) methods, by combining with transfer learning, the TDRN can make a bridge between two different working conditions, thereby using the knowledge learned from a working condition to achieve a high classification accuracy in another working condition. Moreover, since the residual learning is introducing, the TDRN can overcome the problems of training difficulty and performance degradation existing in traditional DCNN methods, thus further improving the classification accuracy. Experiments are conducted on the popular CWRU bearing dataset to validate the effectiveness and superiority of the proposed approach. The results show that the developed TDRN outperforms those methods without transfer learning and/or residual learning in terms of the accuracy and feature learning ability for the fault diagnosis under variable working conditions.

Transfer Learning Method for Rolling Bearing Fault Diagnosis under Different Working Conditions Based on CycleGAN

2021 ◽  
Author(s):  
Jiantong Zhao ◽  
Wentao Huang
Keyword(s):  
Fault Diagnosis ◽  
Transfer Learning ◽  
Working Conditions ◽  
Working Condition ◽  
Learning Method ◽  
Target Domain ◽  
Simulation Data ◽  
Source Domain ◽  
Bearing Fault Diagnosis ◽  
Cross Domain

Abstract In practical bearing fault diagnosis tasks, the available labelled data are often not from the equipment to be diagnosed and cannot cover all manner of working conditions. The adopted data-driven method is required to have a certain degree of cross-domain and cross-working condition transfer learning diagnosis ability. However, limited by the performance of existing transfer learning methods, the potential difference between the source domain and the target domain poses a challenge for the accuracy of transfer diagnosis. In this paper, a cross-working condition data supplement method based on the cycle generative adversarial network (CycleGAN) and a dynamics model is proposed, which can use limited available data to approximate the missing parts of existing data and be used for diagnosis of the target domain. First, we considered the limited experimental data as the target domain, the simulation data corresponding to the working condition as the source domain and used the working condition as the benchmark to constrain the data correspondence between the two datasets. We then used the CycleGAN model to learn the feature mapping from simulation to experiment. Second, based on the working condition of the data to be tested, the corresponding simulation data were input into the trained generator to obtain labeled data with experimental characteristics under the corresponding working conditions, and transferred the dataset as the source domain data to the data to be tested. In the test using self-made simulation and experimental datasets, combined with the transfer learning method based on the probability distribution adaptation, it was shown that the proposed method could effectively improve the diagnostic impact of the single transfer learning method in cross-domain and cross-working conditions when the working condition span was large.

scholarly journals Model Parameter Transfer for Gear Fault Diagnosis under Varying Working Conditions

2021 ◽  
Vol 34 (1) ◽  
Author(s):  
Chao Chen ◽  
Fei Shen ◽  
Jiawen Xu ◽  
Ruqiang Yan
Keyword(s):  
Fault Diagnosis ◽  
Transfer Learning ◽  
Working Conditions ◽  
Rapid Development ◽  
Target Domain ◽  
Source Domain ◽  
Model Parameter ◽  
Operation Conditions ◽  
Gear Fault ◽  
Gear Fault Diagnosis

AbstractGear fault diagnosis technologies have received rapid development and been effectively implemented in many engineering applications. However, the various working conditions would degrade the diagnostic performance and make gear fault diagnosis (GFD) more and more challenging. In this paper, a novel model parameter transfer (NMPT) is proposed to boost the performance of GFD under varying working conditions. Based on the previous transfer strategy that controls empirical risk of source domain, this method further integrates the superiorities of multi-task learning with the idea of transfer learning (TL) to acquire transferable knowledge by minimizing the discrepancies of separating hyperplanes between one specific working condition (target domain) and another (source domain), and then transferring both commonality and specialty parameters over tasks to make use of source domain samples to assist target GFD task when sufficient labeled samples from target domain are unavailable. For NMPT implementation, insufficient target domain features and abundant source domain features with supervised information are fed into NMPT model to train a robust classifier for target GFD task. Related experiments prove that NMPT is expected to be a valuable technology to boost practical GFD performance under various working conditions. The proposed methods provides a transfer learning-based framework to handle the problem of insufficient training samples in target task caused by variable operation conditions.

Deep transfer learning with limited data for machinery fault diagnosis

2021 ◽  
Vol 103 ◽  
pp. 107150
Author(s):  
Te Han ◽  
Chao Liu ◽  
Rui Wu ◽  
Dongxiang Jiang
Keyword(s):  
Fault Diagnosis ◽  
Transfer Learning ◽  
Limited Data ◽  
Machinery Fault Diagnosis
Sign in / Sign up

Export Citation Format

Share Document