Semisupervised Deep Stacking Network with Adaptive Learning Rate Strategy for Motor Imagery EEG Recognition

2019 ◽  
Vol 31 (5) ◽  
pp. 919-942 ◽  
Author(s):  
Xian-Lun Tang ◽  
Wei-Chang Ma ◽  
De-Song Kong ◽  
Wei Li

Practical motor imagery electroencephalogram (EEG) data-based applications are limited by the waste of unlabeled samples in supervised learning and excessive time consumption in the pretraining period. A semisupervised deep stacking network with an adaptive learning rate strategy (SADSN) is proposed to solve the sample loss caused by supervised learning of EEG data and the extraction of manual features. The SADSN adopts the idea of an adaptive learning rate into a contrastive divergence (CD) algorithm to accelerate its convergence. Prior knowledge is introduced into the intermediary layer of the deep stacking network, and a restricted Boltzmann machine is trained by a semisupervised method in which the adjusting scope of the coefficient in learning rate is determined by performance analysis. Several EEG data sets are carried out to evaluate the performance of the proposed method. The results show that the recognition accuracy of SADSN is advanced with a more significant convergence rate and successfully classifies motor imagery.

2009 ◽  
Vol 21 (9) ◽  
pp. 2667-2686 ◽  
Author(s):  
Wenwu He

To improve the single-run performance of online learning and reinforce its stability, we consider online learning with limited adaptive learning rate in this letter. The letter extends convergence proofs for NORMA to a range of step sizes, then employs support vector learning with stochastic meta-descent (SVMD) limited to that range for step size adaptation, so as to obtain an online kernel algorithm that combines theoretical convergence guarantees with good practical performance. Experiments on different data sets corroborate theoretical results well and show that our method is another promising way for online learning.


Author(s):  
Vakada Naveen ◽  
Yaswanth Mareedu ◽  
Neeharika Sai Mandava ◽  
Sravya Kaveti ◽  
G. Krishna Kishore

2018 ◽  
Vol 26 (8) ◽  
pp. 2100-2111 ◽  
Author(s):  
刘教民 LIU Jiao-min ◽  
郭剑威 GUO Jian-wei ◽  
师 硕 SHI Shuo

Author(s):  
Tong Gao ◽  
Wei Sheng ◽  
Mingliang Zhou ◽  
Bin Fang ◽  
Liping Zheng

In this paper, we propose a novel fault diagnosis (FD) approach for micro-electromechanical systems (MEMS) inertial sensors that recognize the fault patterns of MEMS inertial sensors in an end-to-end manner. We use a convolutional neural network (CNN)-based data-driven method to classify the temperature-related sensor faults in unmanned aerial vehicles (UAVs). First, we formulate the FD problem for MEMS inertial sensors into a deep learning framework. Second, we design a multi-scale CNN which uses the raw data of MEMS inertial sensors as input and which outputs classification results indicating faults. Then we extract fault features in the temperature domain to solve the non-uniform sampling problem. Finally, we propose an improved adaptive learning rate optimization method which accelerates the loss convergence by using the Kalman filter (KF) to train the network efficiently with a small dataset. Our experimental results show that our method achieved high fault recognition accuracy and that our proposed adaptive learning rate method improved performance in terms of loss convergence and robustness on a small training batch.


Sign in / Sign up

Export Citation Format

Share Document