scholarly journals A Novel Hybrid Signal Decomposition Technique for Transfer Learning Based Industrial Fault Diagnosis

2021 ◽  
Vol 5 (4) ◽  
pp. 37-53
Author(s):  
Zurana Mehrin Ruhi ◽  
Sigma Jahan ◽  
Jia Uddin
Keyword(s):  
Deep Learning ◽  
Fault Diagnosis ◽  
Transfer Learning ◽  
Industrial Revolution ◽  
State Of The Art ◽  
Signal Decomposition ◽  
Data Driven ◽  
Detection Model ◽  
Mode Decomposition ◽  
To Come

In the fourth industrial revolution, data-driven intelligent fault diagnosis for industrial purposes serves a crucial role. In contemporary times, although deep learning is a popular approach for fault diagnosis, it requires massive amounts of labelled samples for training, which is arduous to come by in the real world. Our contribution to introduce a novel comprehensive intelligent fault detection model using the Case Western Reserve University dataset is divided into two steps. Firstly, a new hybrid signal decomposition methodology is developed comprising Empirical Mode Decomposition and Variational Mode Decomposition to leverage signal information from both processes for effective feature extraction. Secondly, transfer learning with DenseNet121 is employed to alleviate the constraints of deep learning models. Finally, our proposed novel technique surpassed not only previous outcomes but also generated state-of-the-art outcomes represented via the F1 score.

Deep Learning for text in limted data settings

2020 ◽  
Author(s):  
Pathikkumar Patel ◽  
Bhargav Lad ◽  
Jinan Fiaidhi
Keyword(s):  
Machine Learning ◽  
Time Series ◽  
Deep Learning ◽  
Sentiment Analysis ◽  
Transfer Learning ◽  
Text Classification ◽  
State Of The Art ◽  
Time Series Forecasting ◽  
Text Data ◽  
Performance Levels

During the last few years, RNN models have been extensively used and they have proven to be better for sequence and text data. RNNs have achieved state-of-the-art performance levels in several applications such as text classification, sequence to sequence modelling and time series forecasting. In this article we will review different Machine Learning and Deep Learning based approaches for text data and look at the results obtained from these methods. This work also explores the use of transfer learning in NLP and how it affects the performance of models on a specific application of sentiment analysis.

scholarly journals Data-Driven Structural Health Monitoring and Damage Detection through Deep Learning: State-of-the-Art Review

Sensors ◽  
2020 ◽  
Vol 20 (10) ◽  
pp. 2778 ◽  
Author(s):  
Mohsen Azimi ◽  
Armin Eslamlou ◽  
Gokhan Pekcan
Keyword(s):  
Deep Learning ◽  
Structural Health Monitoring ◽  
Health Monitoring ◽  
High Speed ◽  
Deep Neural Networks ◽  
State Of The Art ◽  
Data Driven ◽  
Structural Health ◽  
Promising Tool ◽  
Significant Attention

Data-driven methods in structural health monitoring (SHM) is gaining popularity due to recent technological advancements in sensors, as well as high-speed internet and cloud-based computation. Since the introduction of deep learning (DL) in civil engineering, particularly in SHM, this emerging and promising tool has attracted significant attention among researchers. The main goal of this paper is to review the latest publications in SHM using emerging DL-based methods and provide readers with an overall understanding of various SHM applications. After a brief introduction, an overview of various DL methods (e.g., deep neural networks, transfer learning, etc.) is presented. The procedure and application of vibration-based, vision-based monitoring, along with some of the recent technologies used for SHM, such as sensors, unmanned aerial vehicles (UAVs), etc. are discussed. The review concludes with prospects and potential limitations of DL-based methods in SHM applications.

scholarly journals Deep Transfer Learning for Source Code Modeling

2020 ◽  
Vol 30 (05) ◽  
pp. 649-668
Author(s):  
Yasir Hussain ◽  
Zhiqiu Huang ◽  
Yu Zhou ◽  
Senzhang Wang
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Transfer Learning ◽  
Related Problem ◽  
State Of The Art ◽  
Source Code ◽  
Traditional Learning ◽  
Learning Models ◽  
Modeling And Analysis ◽  
F Measure

In recent years, deep learning models have shown great potential in source code modeling and analysis. Generally, deep learning-based approaches are problem-specific and data-hungry. A challenging issue of these approaches is that they require training from scratch for a different related problem. In this work, we propose a transfer learning-based approach that significantly improves the performance of deep learning-based source code models. In contrast to traditional learning paradigms, transfer learning can transfer the knowledge learned in solving one problem into another related problem. First, we present two recurrent neural network-based models RNN and GRU for the purpose of transfer learning in the domain of source code modeling. Next, via transfer learning, these pre-trained (RNN and GRU) models are used as feature extractors. Then, these extracted features are combined into attention learner for different downstream tasks. The attention learner leverages from the learned knowledge of pre-trained models and fine-tunes them for a specific downstream task. We evaluate the performance of the proposed approach with extensive experiments with the source code suggestion task. The results indicate that the proposed approach outperforms the state-of-the-art models in terms of accuracy, precision, recall and F-measure without training the models from scratch.

scholarly journals Combining DBN and FCM for Fault Diagnosis of Roller Element Bearings without Using Data Labels

2018 ◽  
Vol 2018 ◽  
pp. 1-12 ◽  
Author(s):  
Fan Xu ◽  
Yan jun Fang ◽  
Dong Wang ◽  
Jia qi Liang ◽  
Kwok Leung Tsui
Keyword(s):  
Deep Learning ◽  
Fault Diagnosis ◽  
Clustering Algorithm ◽  
Principal Component ◽  
Belief Networks ◽  
Deep Belief Networks ◽  
Vibration Signals ◽  
Fuzzy C Means ◽  
Roller Bearings ◽  
Mode Decomposition

Because deep belief networks (DBNs) in deep learning have a powerful ability to extract useful information from the raw data without prior knowledge, DBNs are used to extract the useful feature from the roller bearings vibration signals. Unlike classification methods, the clustering method can classify the different fault types without data label. Therefore, a method based on deep belief networks (DBNs) in deep learning (DL) and fuzzy C-means (FCM) clustering algorithm for roller bearings fault diagnosis without a data label is presented in this paper. Firstly, the roller bearings vibration signals are extracted by using DBN, and then principal component analysis (PCA) is used to reduce the dimension of the vibration signal features. Secondly, the first two principal components (PCs) are selected as the input of fuzzy C-means (FCM) for roller bearings fault identification. Finally, the experimental results show that the fault diagnosis of the method presented is better than that of other combination models, such as variation mode decomposition- (VMD-) singular value decomposition- (SVD-) FCM, and ensemble empirical mode decomposition- (EEMD-) fuzzy entropy- (FE-) PCA-FCM.

Data-driven fault diagnosis for PEMFC systems of hybrid tram based on deep learning

2020 ◽  
Vol 45 (24) ◽  
pp. 13483-13495 ◽  
Author(s):  
Xuexia Zhang ◽  
Jingzhe Zhou ◽  
Weirong Chen
Keyword(s):  
Deep Learning ◽  
Fault Diagnosis ◽  
Data Driven

An Automated Approach to Enhance Multiscale Signal Monitoring of Manufacturing Processes

2015 ◽  
Vol 138 (5) ◽  
Author(s):  
Marco Grasso ◽  
Bianca Maria Colosimo
Keyword(s):  
Kernel Estimation ◽  
Optimal Number ◽  
Signal Decomposition ◽  
Data Driven ◽  
Manufacturing Processes ◽  
Density Functions ◽  
Decomposition Approach ◽  
Mode Decomposition ◽  
Manufacturing Applications ◽  
Original Information

Multiscale signal decomposition represents an important step to enhance process monitoring results in many manufacturing applications. Empirical mode decomposition (EMD) is a data driven technique that gained an increasing interest in this framework. However, it usually yields an-over decomposition of the signal, leading to the generation of spurious and meaningless modes and the possible mixing of embedded modes. This study proposes an enhanced signal decomposition approach that synthetizes the original information content into a minimal number of relevant modes via a data-driven and automated procedure. A criterion based on the kernel estimation of density functions is proposed to estimate the dissimilarities between the intrinsic modes generated by the EMD, together with a methodology to automatically determine the optimal number of final modes. The performances of the method are demonstrated by means of simulated signals and real industrial data from a waterjet cutting application.

scholarly journals Automated color detection in orchids using color labels and deep learning

PLoS ONE ◽  
2021 ◽  
Vol 16 (10) ◽  
pp. e0259036
Author(s):  
Diah Harnoni Apriyanti ◽  
Luuk J. Spreeuwers ◽  
Peter J. F. Lucas ◽  
Raymond N. J. Veldhuis
Keyword(s):  
Deep Learning ◽  
Transfer Learning ◽  
Recognition System ◽  
Ensemble Classifier ◽  
Ensemble Classifiers ◽  
Detection Model ◽  
Color Detection ◽  
Multi Class Classification ◽  
The One ◽  
Color Scheme

The color of particular parts of a flower is often employed as one of the features to differentiate between flower types. Thus, color is also used in flower-image classification. Color labels, such as ‘green’, ‘red’, and ‘yellow’, are used by taxonomists and lay people alike to describe the color of plants. Flower image datasets usually only consist of images and do not contain flower descriptions. In this research, we have built a flower-image dataset, especially regarding orchid species, which consists of human-friendly textual descriptions of features of specific flowers, on the one hand, and digital photographs indicating how a flower looks like, on the other hand. Using this dataset, a new automated color detection model was developed. It is the first research of its kind using color labels and deep learning for color detection in flower recognition. As deep learning often excels in pattern recognition in digital images, we applied transfer learning with various amounts of unfreezing of layers with five different neural network architectures (VGG16, Inception, Resnet50, Xception, Nasnet) to determine which architecture and which scheme of transfer learning performs best. In addition, various color scheme scenarios were tested, including the use of primary and secondary color together, and, in addition, the effectiveness of dealing with multi-class classification using multi-class, combined binary, and, finally, ensemble classifiers were studied. The best overall performance was achieved by the ensemble classifier. The results show that the proposed method can detect the color of flower and labellum very well without having to perform image segmentation. The result of this study can act as a foundation for the development of an image-based plant recognition system that is able to offer an explanation of a provided classification.

Sign in / Sign up

Export Citation Format

Share Document