Improving multilabel classification via heterogeneous ensemble methods

2019 ◽  
Vol 12 (6) ◽  
pp. 1035-1050
Author(s):  
Yujue Wu ◽  
Qing Wang
F1000Research ◽  
2017 ◽  
Vol 5 ◽  
pp. 2676 ◽  
Author(s):  
Sebastian Pölsterl ◽  
Pankaj Gupta ◽  
Lichao Wang ◽  
Sailesh Conjeti ◽  
Amin Katouzian ◽  
...  

Ensemble methods have been successfully applied in a wide range of scenarios, including survival analysis. However, most ensemble models for survival analysis consist of models that all optimize the same loss function and do not fully utilize the diversity in available models. We propose heterogeneous survival ensembles that combine several survival models, each optimizing a different loss during training. We evaluated our proposed technique in the context of the Prostate Cancer DREAM Challenge, where the objective was to predict survival of patients with metastatic, castrate-resistant prostate cancer from patient records of four phase III clinical trials. Results demonstrate that a diverse set of survival models were preferred over a single model and that our heterogeneous ensemble of survival models outperformed all competing methods with respect to predicting the exact time of death in the Prostate Cancer DREAM Challenge.


F1000Research ◽  
2016 ◽  
Vol 5 ◽  
pp. 2676 ◽  
Author(s):  
Sebastian Pölsterl ◽  
Pankaj Gupta ◽  
Lichao Wang ◽  
Sailesh Conjeti ◽  
Amin Katouzian ◽  
...  

Ensemble methods have been successfully applied in a wide range of scenarios, including survival analysis. However, most ensemble models for survival analysis consist of models that all optimize the same loss function and do not fully utilize the diversity in available models. We propose heterogeneous survival ensembles that combine several survival models, each optimizing a different loss during training. We evaluated our proposed technique in the context of the Prostate Cancer DREAM Challenge, where the objective was to predict survival of patients with metastatic, castrate-resistant prostate cancer from patient records of four phase III clinical trials. Results demonstrate that a diverse set of survival models were preferred over a single model and that our heterogeneous ensemble of survival models outperformed all competing methods with respect to predicting the exact time of death in the Prostate Cancer DREAM Challenge.


F1000Research ◽  
2017 ◽  
Vol 5 ◽  
pp. 2676 ◽  
Author(s):  
Sebastian Pölsterl ◽  
Pankaj Gupta ◽  
Lichao Wang ◽  
Sailesh Conjeti ◽  
Amin Katouzian ◽  
...  

Ensemble methods have been successfully applied in a wide range of scenarios, including survival analysis. However, most ensemble models for survival analysis consist of models that all optimize the same loss function and do not fully utilize the diversity in available models. We propose heterogeneous survival ensembles that combine several survival models, each optimizing a different loss during training. We evaluated our proposed technique in the context of the Prostate Cancer DREAM Challenge, where the objective was to predict survival of patients with metastatic, castrate-resistant prostate cancer from patient records of four phase III clinical trials. Results demonstrate that a diverse set of survival models were preferred over a single model and that our heterogeneous ensemble of survival models outperformed all competing methods with respect to predicting the exact time of death in the Prostate Cancer DREAM Challenge.


F1000Research ◽  
2018 ◽  
Vol 7 ◽  
pp. 1577 ◽  
Author(s):  
Linhua Wang ◽  
Jeffrey Law ◽  
Shiv D. Kale ◽  
T. M. Murali ◽  
Gaurav Pandey

Heterogeneous ensembles are an effective approach in scenarios where the ideal data type and/or individual predictor are unclear for a given problem. These ensembles have shown promise for protein function prediction (PFP), but their ability to improve PFP at a large scale is unclear. The overall goal of this study is to critically assess this ability of a variety of heterogeneous ensemble methods across a multitude of functional terms, proteins and organisms. Our results show that these methods, especially Stacking using Logistic Regression, indeed produce more accurate predictions for a variety of Gene Ontology terms differing in size and specificity. To enable the application of these methods to other related problems, we have publicly shared the HPC-enabled code underlying this work as LargeGOPred (https://github.com/GauravPandeyLab/LargeGOPred).


2012 ◽  
Vol 33 (5) ◽  
pp. 513-523 ◽  
Author(s):  
Muhammad Atif Tahir ◽  
Josef Kittler ◽  
Ahmed Bouridane

2021 ◽  
Vol 187 ◽  
pp. 229-234
Author(s):  
Dan Guo ◽  
Jia Zhai ◽  
Xiaodan Xie ◽  
Yong Zhu

2021 ◽  
Vol 13 (2) ◽  
pp. 238
Author(s):  
Zhice Fang ◽  
Yi Wang ◽  
Gonghao Duan ◽  
Ling Peng

This study presents a new ensemble framework to predict landslide susceptibility by integrating decision trees (DTs) with the rotation forest (RF) ensemble technique. The proposed framework mainly includes four steps. First, training and validation sets are randomly selected according to historical landslide locations. Then, landslide conditioning factors are selected and screened by the gain ratio method. Next, several training subsets are produced from the training set and a series of trained DTs are obtained by using a DT as a base classifier couple with different training subsets. Finally, the resultant landslide susceptibility map is produced by combining all the DT classification results using the RF ensemble technique. Experimental results demonstrate that the performance of all the DTs can be effectively improved by integrating them with the RF ensemble technique. Specifically, the proposed ensemble methods achieved the predictive values of 0.012–0.121 higher than the DTs in terms of area under the curve (AUC). Furthermore, the proposed ensemble methods are better than the most popular ensemble methods with the predictive values of 0.005–0.083 in terms of AUC. Therefore, the proposed ensemble framework is effective to further improve the spatial prediction of landslides.


Sign in / Sign up

Export Citation Format

Share Document