Improved Adaptive Incremental Error-Minimization-Based Extreme Learning Machine with Localized Generalization Error Model

Author(s):  
Wen-wen Han ◽  
Peng Zheng ◽  
Zhong-Qiu Zhao ◽  
Wei-dong Tian
2014 ◽  
Vol 27 (1) ◽  
pp. 59-66 ◽  
Author(s):  
Qiang Liu ◽  
Jianping Yin ◽  
Victor C. M. Leung ◽  
Jun-Hai Zhai ◽  
Zhiping Cai ◽  
...  

Author(s):  
WING W. Y. NG ◽  
DANIEL S. YEUNG ◽  
ERIC C. C. TSANG

We had developed the localized generalization error model for supervised learning with minimization of Mean Square Error. In this work, we extend the error model to Single Layer Perceptron Neural Network (SLPNN) and Support Vector Machine (SVM) with sigmoid kernel function. For a trained SLPNN or SVM and a given training dataset, the proposed error model bounds above the error for unseen samples which are similar to the training samples. As the major component of the localized generalization error model, the stochastic sensitivity measure formula for perceptron neural network derived in this work has relaxed the assumptions of same distribution for all inputs and each sample perturbed only once in previous works. These make the sensitivity measure applicable to pattern classification problems. The stochastic sensitivity measure of SVM with Sigmoid kernel is also derived in this work as a component of the localized generalization error model. At the end of this paper, we discuss the advantages of the proposed error bound over existing error bound.


2012 ◽  
Vol 217 ◽  
pp. 1-20 ◽  
Author(s):  
Patrick P.K. Chan ◽  
Daniel S. Yeung ◽  
Wing W.Y. Ng ◽  
Chih Min Lin ◽  
James N.K. Liu

Sign in / Sign up

Export Citation Format

Share Document