The improved localized generalization error model and its applications to feature selection for RBFNN

Author(s):  
Yan-Jun Cui ◽  
Jie Li ◽  
Yan-Dong Ma
2014 ◽  
Vol 146 ◽  
pp. 104-112 ◽  
Author(s):  
Wing W.Y. Ng ◽  
Xue-Ling Liang ◽  
Jincheng Li ◽  
Daniel S. Yeung ◽  
Patrick P.K. Chan

2004 ◽  
Vol 13 (04) ◽  
pp. 791-800 ◽  
Author(s):  
HOLGER FRÖHLICH ◽  
OLIVIER CHAPELLE ◽  
BERNHARD SCHÖLKOPF

The problem of feature selection is a difficult combinatorial task in Machine Learning and of high practical relevance, e.g. in bioinformatics. Genetic Algorithms (GAs) offer a natural way to solve this problem. In this paper we present a special Genetic Algorithm, which especially takes into account the existing bounds on the generalization error for Support Vector Machines (SVMs). This new approach is compared to the traditional method of performing cross-validation and to other existing algorithms for feature selection.


2008 ◽  
Vol 41 (12) ◽  
pp. 3706-3719 ◽  
Author(s):  
Wing W.Y. Ng ◽  
Daniel S. Yeung ◽  
Michael Firth ◽  
Eric C.C. Tsang ◽  
Xi-Zhao Wang

Author(s):  
WING W. Y. NG ◽  
DANIEL S. YEUNG ◽  
ERIC C. C. TSANG

We had developed the localized generalization error model for supervised learning with minimization of Mean Square Error. In this work, we extend the error model to Single Layer Perceptron Neural Network (SLPNN) and Support Vector Machine (SVM) with sigmoid kernel function. For a trained SLPNN or SVM and a given training dataset, the proposed error model bounds above the error for unseen samples which are similar to the training samples. As the major component of the localized generalization error model, the stochastic sensitivity measure formula for perceptron neural network derived in this work has relaxed the assumptions of same distribution for all inputs and each sample perturbed only once in previous works. These make the sensitivity measure applicable to pattern classification problems. The stochastic sensitivity measure of SVM with Sigmoid kernel is also derived in this work as a component of the localized generalization error model. At the end of this paper, we discuss the advantages of the proposed error bound over existing error bound.


Sign in / Sign up

Export Citation Format

Share Document