scholarly journals Multisignal VGG19 Network with Transposed Convolution for Rotating Machinery Fault Diagnosis Based on Deep Transfer Learning

2020 ◽  
Vol 2020 ◽  
pp. 1-12
Author(s):  
Jianye Zhou ◽  
Xinyu Yang ◽  
Lin Zhang ◽  
Siyu Shao ◽  
Gangying Bian
Keyword(s):  
Fault Diagnosis ◽  
Transfer Learning ◽  
High Efficiency ◽  
Image Resolution ◽  
Fine Tuning ◽  
Test Accuracy ◽  
Multiple Sensors ◽  
Learning Framework ◽  
Training Samples ◽  
Model Training

To realize high-precision and high-efficiency machine fault diagnosis, a novel deep learning framework that combines transfer learning and transposed convolution is proposed. Compared with existing methods, this method has faster training speed, fewer training samples per time, and higher accuracy. First, the raw data collected by multiple sensors are combined into a graph and normalized to facilitate model training. Next, the transposed convolution is utilized to expand the image resolution, and then the images are treated as the input of the transfer learning model for training and fine-tuning. The proposed method adopts 512 time series to conduct experiments on two main mechanical datasets of bearings and gears in the variable-speed gearbox, which verifies the effectiveness and versatility of the method. We have obtained advanced results on both datasets of the gearbox dataset. The dataset shows that the test accuracy is 99.99%, achieving a significant improvement from 98.07% to 99.99%.

scholarly journals Deep Learning Techniques for Grape Plant Species Identification in Natural Images

Sensors ◽  
2019 ◽  
Vol 19 (22) ◽  
pp. 4850 ◽  
Author(s):  
Carlos S. Pereira ◽  
Raul Morais ◽  
Manuel J. C. S. Reis
Keyword(s):  
Transfer Learning ◽  
Climatic Conditions ◽  
Fine Tuning ◽  
Variety Identification ◽  
Test Accuracy ◽  
Accuracy Score ◽  
Learning Techniques ◽  
Four Corners ◽  
Integrated Software ◽  
Grape Varieties

Frequently, the vineyards in the Douro Region present multiple grape varieties per parcel and even per row. An automatic algorithm for grape variety identification as an integrated software component was proposed that can be applied, for example, to a robotic harvesting system. However, some issues and constraints in its development were highlighted, namely, the images captured in natural environment, low volume of images, high similarity of the images among different grape varieties, leaf senescence, and significant changes on the grapevine leaf and bunch images in the harvest seasons, mainly due to adverse climatic conditions, diseases, and the presence of pesticides. In this paper, the performance of the transfer learning and fine-tuning techniques based on AlexNet architecture were evaluated when applied to the identification of grape varieties. Two natural vineyard image datasets were captured in different geographical locations and harvest seasons. To generate different datasets for training and classification, some image processing methods, including a proposed four-corners-in-one image warping algorithm, were used. The experimental results, obtained from the application of an AlexNet-based transfer learning scheme and trained on the image dataset pre-processed through the four-corners-in-one method, achieved a test accuracy score of 77.30%. Applying this classifier model, an accuracy of 89.75% on the popular Flavia leaf dataset was reached. The results obtained by the proposed approach are promising and encouraging in helping Douro wine growers in the automatic task of identifying grape varieties.

A sub-domain adaptive transfer learning base on residual network for bearing fault diagnosis

2021 ◽  
pp. 107754632110429
Author(s):  
Chongyu Wang ◽  
Guangya Zhu ◽  
Tianyuan Liu ◽  
Yonghui Xie ◽  
Di Zhang
Keyword(s):  
Big Data ◽  
Fault Diagnosis ◽  
Transfer Learning ◽  
Research Work ◽  
Research Field ◽  
Residual Network ◽  
Bearing Fault ◽  
Bearing Fault Diagnosis ◽  
Training Samples ◽  
The Impact

Bearing fault diagnosis is an important research field for rotating machinery health monitoring. Recently, many intelligent fault diagnosis methods driven by big data, such as transfer learning, have been studied. However, there are two shortcomings for the prior transfer learning method in industry application. First, it is necessary to design a complex loss function to enhance the similarity between the two domains further. Second, previous studies required big data both in source and target task, without considering the lack of sufficient training samples. Inspired by relevant research work, this article proposes a local joint distribution discrepancy to increase similar features. A sub-domain adaptive transfer learning is designed to detect bearing faults based on the residual network. Two kinds of transfer experiments are designed to verify the method effectiveness. After that, the impact of small training samples and noise on the results is explored. The proposed method reaches high accuracy.

scholarly journals A Study of Deep Neural Networks Transfer Learning For Fault Diagnosis Applications

2021 ◽  
Vol 13 (1) ◽  
Author(s):  
Michael Franco-Garcia ◽  
Alex Benasutti ◽  
Larry Pearlstein ◽  
Mohammed Alabsi
Keyword(s):  
Neural Networks ◽  
Fault Diagnosis ◽  
Transfer Learning ◽  
Deep Neural Networks ◽  
Model Performance ◽  
Poor Performance ◽  
Operating Conditions ◽  
Learning Performance ◽  
Vibration Data ◽  
Model Training

Intelligent fault diagnosis utilizing deep learning algorithms has been widely investigated recently. Although previous results demonstrated excellent performance, features learned by Deep Neural Networks (DNN) are part of a large black box. Consequently, lack of understanding of underlying physical meanings embedded within the features can lead to poor performance when applied to different but related datasets i.e. transfer learning applications. This study will investigate the transfer learning performance of a Convolution Neural Network (CNN) considering 4 different operating conditions. Utilizing the Case Western Reserve University (CWRU) bearing dataset, the CNN will be trained to classify 12 classes. Each class represents a unique differentfault scenario with varying severity i.e. inner race fault of 0.007”, 0.014” diameter. Initially, zero load data will be utilized for model training and the model will be tuned until testing accuracy above 99% is obtained. The model performance will be evaluated by feeding vibration data collected when the load is varied to 1, 2 and 3 HP. Initial results indicated that the classification accuracy will degrade substantially. Hence, this paper will visualize convolution kernels in time and frequency domains and will investigate the influence of changing loads on fault characteristics, network classification mechanism and activation strength.

Sentiment analysis via dually-born-again network and sample selection

2020 ◽  
Vol 24 (6) ◽  
pp. 1257-1271
Author(s):  
Pinlong Zhao ◽  
Zefeng Han ◽  
Qing Yin ◽  
Shuxiao Li ◽  
Ou Wu
Keyword(s):  
Sentiment Analysis ◽  
Language Processing ◽  
State Of The Art ◽  
Sample Selection ◽  
Learning Framework ◽  
Training Samples ◽  
Knowledge Distillation ◽  
Model Training ◽  
Born Again ◽  
Text Sentiment Analysis

Text sentiment analysis is an important natural language processing (NLP) task and has received considerable attention in recent years. Numerous deep-learning based methods have been proposed in previous literature in terms of new deep neural networks (DNN) including new embedding strategies, new attention mechanisms, and new encoding layers. In this study, an alternative technical path is investigated to further improve the state-of-the-art performance of text sentiment analysis. An new effective learning framework is proposed that combines knowledge distillation and sample selection. A dually-born-again network (DBAN) is presented in which the teacher network and the student network are simultaneously trained through an iterative approach. A selection gate is defined to deal with training samples which are useless or even harmful for model training. Moreover, both the DBAN and sample selection are further improved by ensemble. The proposed framework can improve the existing state-of-the-art DNN models in sentiment analysis. Experimental results indicate that the proposed framework enhances the performances of existing networks. In addition, DBAN outperforms existing born-again network.

scholarly journals Vibration Images-Driven Fault Diagnosis Based on CNN and Transfer Learning of Rolling Bearing under Strong Noise

2021 ◽  
Vol 2021 ◽  
pp. 1-16
Author(s):  
Hongwei Fan ◽  
Ceyi Xue ◽  
Xuhui Zhang ◽  
Xiangang Cao ◽  
Shuoqi Gao ◽  
...  
Keyword(s):  
Fault Diagnosis ◽  
Transfer Learning ◽  
Gaussian White Noise ◽  
Rolling Bearing ◽  
Fault Classification ◽  
Model Parameters ◽  
Test Accuracy ◽  
Image Generation ◽  
Training Time ◽  
The Impact

Deep learning-based fault diagnosis of rolling bearings is a hot research topic, and a rapid and accurate diagnosis is important. In this paper, aiming at the vibration image samples of rolling bearing affected by strong noise, the convolutional neural network- (CNN-) and transfer learning- (TL-) based fault diagnosis method is proposed. Firstly, four kinds of vibration image generation method with different characteristics are put forward, and the corresponding pure vibration image samples are obtained according to the original data. Secondly, using CNN as the adaptive feature extraction and recognition model, the influences of main sensitive parameters of CNN on the network recognition effect are studied, such as learning rate, optimizer, and L1 regularization, and the best model is determined. In order to obtain the pretraining parameters, the training and fault classification test for different image samples are carried out, respectively. Thirdly, the Gaussian white noise with different levels is added to the original signals, and four kinds of noised vibration image samples are obtained. The previous pretrained model parameters are shared for the TL. Each kind of sample research compares the impact of thirteen data sharing schemes on the TL accuracy and efficiency, and finally, the test accuracy and time index are introduced to evaluate the model. The results show that, among the four kinds of image generation method, the classification performance of data obtained by empirical mode decomposition-pseudo-Wigner–Ville distribution (EP) is the best; when the signal to noise ratio (SNR) is 10 dB, the model test accuracy obtained by TL is 96.67% and the training time is 170.46 s.

scholarly journals Progressive Deep Learning Framework for Recognizing 3D Orientations and Object Class Based on Point Cloud Representation

Sensors ◽  
2021 ◽  
Vol 21 (18) ◽  
pp. 6108
Author(s):  
Sukhan Lee ◽  
Yongjun Yang
Keyword(s):  
Deep Learning ◽  
High Efficiency ◽  
Object Classification ◽  
High Accuracy ◽  
Fine Tuning ◽  
Object Class ◽  
Global Features ◽  
Axis Orientation ◽  
Learning Framework ◽  
Object Classes

Deep learning approaches to estimating full 3D orientations of objects, in addition to object classes, are limited in their accuracies, due to the difficulty in learning the continuous nature of three-axis orientation variations by regression or classification with sufficient generalization. This paper presents a novel progressive deep learning framework, herein referred to as 3D POCO Net, that offers high accuracy in estimating orientations about three rotational axes yet with efficiency in network complexity. The proposed 3D POCO Net is configured, using four PointNet-based networks for independently representing the object class and three individual axes of rotations. The four independent networks are linked by in-between association subnetworks that are trained to progressively map the global features learned by individual networks one after another for fine-tuning the independent networks. In 3D POCO Net, high accuracy is achieved by combining a high precision classification based on a large number of orientation classes with a regression based on a weighted sum of classification outputs, while high efficiency is maintained by a progressive framework by which a large number of orientation classes are grouped into independent networks linked by association subnetworks. We implemented 3D POCO Net for full three-axis orientation variations and trained it with about 146 million orientation variations augmented from the ModelNet10 dataset. The testing results show that we can achieve an orientation regression error of about 2.5° with about 90% accuracy in object classification for general three-axis orientation estimation and object classification. Furthermore, we demonstrate that a pre-trained 3D POCO Net can serve as an orientation representation platform based on which orientations as well as object classes of partial point clouds from occluded objects are learned in the form of transfer learning.

Construction of a deep sparse filtering network for rotating machinery fault diagnosis

2021 ◽  
pp. 095440702110148
Author(s):  
Chun Cheng ◽  
Wei Zou ◽  
Weiping Wang ◽  
Michael Pecht
Keyword(s):  
Fault Diagnosis ◽  
Back Propagation ◽  
Feature Learning ◽  
Back Propagation Neural Network ◽  
Rotating Machinery ◽  
Fine Tuning ◽  
Local Optimum ◽  
Back Propagation Algorithm ◽  
Intelligent Fault Diagnosis ◽  
Sparse Filtering

Deep neural networks (DNNs) have shown potential in intelligent fault diagnosis of rotating machinery. However, traditional DNNs such as the back-propagation neural network are highly sensitive to the initial weights and easily fall into the local optimum, which restricts the feature learning capability and diagnostic performance. To overcome the above problems, a deep sparse filtering network (DSFN) constructed by stacked sparse filtering is developed in this paper and applied to fault diagnosis. The developed DSFN is pre-trained by sparse filtering in an unsupervised way. The back-propagation algorithm is employed to optimize the DSFN after pre-training. Then, the DSFN-based intelligent fault diagnosis method is validated using two experiments. The results show that pre-training with sparse filtering and fine-tuning can help the DSFN search for the optimal network parameters, and the DSFN can learn discriminative features adaptively from rotating machinery datasets. Compared with classical methods, the developed diagnostic method can diagnose rotating machinery faults with higher accuracy using fewer training samples.

scholarly journals Classification of jujube defects in small data sets based on transfer learning

2021 ◽  
Author(s):  
Jianping Ju ◽  
Hong Zheng ◽  
Xiaohang Xu ◽  
Zhongyuan Guo ◽  
Zhaohui Zheng ◽  
...  
Keyword(s):  
Transfer Learning ◽  
Loss Function ◽  
Training Model ◽  
Parameter Distribution ◽  
Test Accuracy ◽  
Small Data ◽  
Data Sets ◽  
Data Set ◽  
Small Data Sets

AbstractAlthough convolutional neural networks have achieved success in the field of image classification, there are still challenges in the field of agricultural product quality sorting such as machine vision-based jujube defects detection. The performance of jujube defect detection mainly depends on the feature extraction and the classifier used. Due to the diversity of the jujube materials and the variability of the testing environment, the traditional method of manually extracting the features often fails to meet the requirements of practical application. In this paper, a jujube sorting model in small data sets based on convolutional neural network and transfer learning is proposed to meet the actual demand of jujube defects detection. Firstly, the original images collected from the actual jujube sorting production line were pre-processed, and the data were augmented to establish a data set of five categories of jujube defects. The original CNN model is then improved by embedding the SE module and using the triplet loss function and the center loss function to replace the softmax loss function. Finally, the depth pre-training model on the ImageNet image data set was used to conduct training on the jujube defects data set, so that the parameters of the pre-training model could fit the parameter distribution of the jujube defects image, and the parameter distribution was transferred to the jujube defects data set to complete the transfer of the model and realize the detection and classification of the jujube defects. The classification results are visualized by heatmap through the analysis of classification accuracy and confusion matrix compared with the comparison models. The experimental results show that the SE-ResNet50-CL model optimizes the fine-grained classification problem of jujube defect recognition, and the test accuracy reaches 94.15%. The model has good stability and high recognition accuracy in complex environments.

Sign in / Sign up

Export Citation Format

Share Document