A New Method to Assist Small Data Set Neural Network Learning

Author(s):  
Rongfu Mao ◽  
Haichao Zhu ◽  
Linke Zhang ◽  
Aizhi Chen
Sensors ◽  
2019 ◽  
Vol 19 (20) ◽  
pp. 4408 ◽  
Author(s):  
Hyun-Myung Cho ◽  
Heesu Park ◽  
Suh-Yeon Dong ◽  
Inchan Youn

The goals of this study are the suggestion of a better classification method for detecting stressed states based on raw electrocardiogram (ECG) data and a method for training a deep neural network (DNN) with a smaller data set. We suggest an end-to-end architecture to detect stress using raw ECGs. The architecture consists of successive stages that contain convolutional layers. In this study, two kinds of data sets are used to train and validate the model: A driving data set and a mental arithmetic data set, which smaller than the driving data set. We apply a transfer learning method to train a model with a small data set. The proposed model shows better performance, based on receiver operating curves, than conventional methods. Compared with other DNN methods using raw ECGs, the proposed model improves the accuracy from 87.39% to 90.19%. The transfer learning method improves accuracy by 12.01% and 10.06% when 10 s and 60 s of ECG signals, respectively, are used in the model. In conclusion, our model outperforms previous models using raw ECGs from a small data set and, so, we believe that our model can significantly contribute to mobile healthcare for stress management in daily life.


Author(s):  
Anan Zhang ◽  
Jiahui He ◽  
Yu Lin ◽  
Qian Li ◽  
Wei Yang ◽  
...  

Purpose Considering the problem that the high recognition rate of deep learning requires the support of mass data, this study aims to propose an insulating fault identification method based on small data set convolutional neural network (CNN). Design/methodology/approach Because of the chaotic characteristics of partial discharge (PD) signals, the equivalent transformation of the PD signal of unit power frequency period is carried out by phase space reconstruction to derive the chaotic features. At the same time, geometric, fractal, entropy and time domain features are extracted to increase the volume of feature data. Finally, the combined features are constructed and imported into CNN to complete PD recognition. Findings The results of the case study show that the proposed method can realize the PD recognition of small data set and make up for the shortcomings of the methods based on CNN. Also, the 1-CNN built in this paper has better recognition performance for four typical insulation faults of cable accessories. The recognition performance is improved by 4.37% and 1.25%, respectively, compared with similar methods based on support vector machine and BPNN. Originality/value In this paper, a method of insulation fault recognition based on CNN with small data set is proposed, which can solve the difficulty to realize insulation fault recognition of cable accessories and deep data mining because of insufficient measure data.


2018 ◽  
Vol 62 ◽  
pp. 69-100 ◽  
Author(s):  
Gustav Sourek ◽  
Vojtech Aschenbrenner ◽  
Filip Zelezny ◽  
Steven Schockaert ◽  
Ondrej Kuzelka

We propose a method to combine the interpretability and expressive power of firstorder logic with the effectiveness of neural network learning. In particular, we introduce a lifted framework in which first-order rules are used to describe the structure of a given problem setting. These rules are then used as a template for constructing a number of neural networks, one for each training and testing example. As the different networks corresponding to different examples share their weights, these weights can be efficiently learned using stochastic gradient descent. Our framework provides a flexible way for implementing and combining a wide variety of modelling constructs. In particular, the use of first-order logic allows for a declarative specification of latent relational structures, which can then be efficiently discovered in a given data set using neural network learning. Experiments on 78 relational learning benchmarks clearly demonstrate the effectiveness of the framework.


2021 ◽  
Vol 1755 (1) ◽  
pp. 012037
Author(s):  
V. Vijayasarveswari ◽  
M. Jusoh ◽  
T. Sabapathy ◽  
R.A.A. Raof ◽  
S. Khatun ◽  
...  

2011 ◽  
Vol 131 (11) ◽  
pp. 1889-1894
Author(s):  
Yuta Tsuchida ◽  
Michifumi Yoshioka

2012 ◽  
Vol 197 ◽  
pp. 271-277
Author(s):  
Zhu Ping Gong

Small data set approach is used for the estimation of Largest Lyapunov Exponent (LLE). Primarily, the mean period drawback of Small data set was corrected. On this base, the LLEs of daily qualified rate time series of HZ, an electronic manufacturing enterprise, were estimated and all positive LLEs were taken which indicate that this time series is a chaotic time series and the corresponding produce process is a chaotic process. The variance of the LLEs revealed the struggle between the divergence nature of quality system and quality control effort. LLEs showed sharp increase in getting worse quality level coincide with the company shutdown. HZ’s daily qualified rate, a chaotic time series, shows us the predictable nature of quality system in a short-run.


Sign in / Sign up

Export Citation Format

Share Document