Stable L2-Regularized Ensemble Feature Weighting

Author(s):  
Yun Li ◽  
Shasha Huang ◽  
Songcan Chen ◽  
Jennie Si
Keyword(s):  
IEEE Access ◽  
2020 ◽  
pp. 1-1
Author(s):  
Ya-Feng Zheng ◽  
Zhang-Hao Gao ◽  
Yi-Hang Wang ◽  
Qian Fu

2012 ◽  
Vol 8 (2) ◽  
pp. 44-63 ◽  
Author(s):  
Baoxun Xu ◽  
Joshua Zhexue Huang ◽  
Graham Williams ◽  
Qiang Wang ◽  
Yunming Ye

The selection of feature subspaces for growing decision trees is a key step in building random forest models. However, the common approach using randomly sampling a few features in the subspace is not suitable for high dimensional data consisting of thousands of features, because such data often contains many features which are uninformative to classification, and the random sampling often doesn’t include informative features in the selected subspaces. Consequently, classification performance of the random forest model is significantly affected. In this paper, the authors propose an improved random forest method which uses a novel feature weighting method for subspace selection and therefore enhances classification performance over high-dimensional data. A series of experiments on 9 real life high dimensional datasets demonstrated that using a subspace size of features where M is the total number of features in the dataset, our random forest model significantly outperforms existing random forest models.


2016 ◽  
Vol 100 ◽  
pp. 137-144 ◽  
Author(s):  
Lungan Zhang ◽  
Liangxiao Jiang ◽  
Chaoqun Li ◽  
Ganggang Kong

2015 ◽  
Vol 73 ◽  
pp. 1-17 ◽  
Author(s):  
Saleh Alshomrani ◽  
Abdullah Bawakid ◽  
Seong-O Shim ◽  
Alberto Fernández ◽  
Francisco Herrera

Sign in / Sign up

Export Citation Format

Share Document