Predicting tree species presence and basal area in Utah: A comparison of stochastic gradient boosting, generalized additive models, and tree-based methods

2006 ◽  
Vol 199 (2) ◽  
pp. 176-187 ◽  
Author(s):  
Gretchen G. Moisen ◽  
Elizabeth A. Freeman ◽  
Jock A. Blackard ◽  
Tracey S. Frescino ◽  
Niklaus E. Zimmermann ◽  
...  
Keyword(s):  
Tree Species ◽  
Generalized Additive Models ◽  
Basal Area ◽  
Additive Models ◽  
Stochastic Gradient ◽  
Gradient Boosting ◽  
Stochastic Gradient Boosting

Enhanced prediction of vulnerable Web components using Stochastic Gradient Boosting Trees

2019 ◽  
Vol 15 (2) ◽  
pp. 201-214 ◽  
Author(s):  
Mahmoud Elish
Keyword(s):  
Web Applications ◽  
Prediction Models ◽  
Stochastic Gradient ◽  
Gradient Boosting ◽  
Data Sets ◽  
Content Type ◽  
Stochastic Gradient Boosting ◽  
Security Inspection ◽  
Novel Model ◽  
Efficient Software

Purpose Effective and efficient software security inspection is crucial as the existence of vulnerabilities represents severe risks to software users. The purpose of this paper is to empirically evaluate the potential application of Stochastic Gradient Boosting Trees (SGBT) as a novel model for enhanced prediction of vulnerable Web components compared to common, popular and recent machine learning models. Design/methodology/approach An empirical study was conducted where the SGBT and 16 other prediction models have been trained, optimized and cross validated using vulnerability data sets from multiple versions of two open-source Web applications written in PHP. The prediction performance of these models have been evaluated and compared based on accuracy, precision, recall and F-measure. Findings The results indicate that the SGBT models offer improved prediction over the other 16 models and thus are more effective and reliable in predicting vulnerable Web components. Originality/value This paper proposed a novel application of SGBT for enhanced prediction of vulnerable Web components and showed its effectiveness.

scholarly journals Machine learning as a successful approach for predicting complex spatio–temporal patterns in animal species abundance

2021 ◽  
pp. 289-301
Author(s):  
B. Martín ◽  
J. González–Arias ◽  
J. A. Vicente–Vírseda
Keyword(s):  
Machine Learning ◽  
Random Forest ◽  
Animal Species ◽  
Temporal Patterns ◽  
Additive Models ◽  
Gradient Boosting ◽  
Support Vector ◽  
Stochastic Gradient Boosting ◽  
Extreme Gradient Boosting ◽  
Spatio Temporal

Our aim was to identify an optimal analytical approach for accurately predicting complex spatio–temporal patterns in animal species distribution. We compared the performance of eight modelling techniques (generalized additive models, regression trees, bagged CART, k–nearest neighbors, stochastic gradient boosting, support vector machines, neural network, and random forest –enhanced form of bootstrap. We also performed extreme gradient boosting –an enhanced form of radiant boosting– to predict spatial patterns in abundance of migrating Balearic shearwaters based on data gathered within eBird. Derived from open–source datasets, proxies of frontal systems and ocean productivity domains that have been previously used to characterize the oceanographic habitats of seabirds were quantified, and then used as predictors in the models. The random forest model showed the best performance according to the parameters assessed (RMSE value and R2). The correlation between observed and predicted abundance with this model was also considerably high. This study shows that the combination of machine learning techniques and massive data provided by open data sources is a useful approach for identifying the long–term spatial–temporal distribution of species at regional spatial scales.

Predicting 90-Day and 1-Year Mortality in Spinal Metastatic Disease: Development and Internal Validation

Neurosurgery ◽  
2019 ◽  
Vol 85 (4) ◽  
pp. E671-E681 ◽  
Author(s):  
Aditya V Karhade ◽  
Quirina C B S Thio ◽  
Paul T Ogink ◽  
Christopher M Bono ◽  
Marco L Ferrone ◽  
...  
Keyword(s):  
Metastatic Disease ◽  
Web Application ◽  
Performance Status ◽  
Predictive Performance ◽  
Operative Management ◽  
Stochastic Gradient ◽  
Patient Specific ◽  
Gradient Boosting ◽  
Support Vector ◽  
Stochastic Gradient Boosting

Abstract BACKGROUND Increasing prevalence of metastatic disease has been accompanied by increasing rates of surgical intervention. Current tools have poor to fair predictive performance for intermediate (90-d) and long-term (1-yr) mortality. OBJECTIVE To develop predictive algorithms for spinal metastatic disease at these time points and to provide patient-specific explanations of the predictions generated by these algorithms. METHODS Retrospective review was conducted at 2 large academic medical centers to identify patients undergoing initial operative management for spinal metastatic disease between January 2000 and December 2016. Five models (penalized logistic regression, random forest, stochastic gradient boosting, neural network, and support vector machine) were developed to predict 90-d and 1-yr mortality. RESULTS Overall, 732 patients were identified with 90-d and 1-yr mortality rates of 181 (25.1%) and 385 (54.3%), respectively. The stochastic gradient boosting algorithm had the best performance for 90-d mortality and 1-yr mortality. On global variable importance assessment, albumin, primary tumor histology, and performance status were the 3 most important predictors of 90-d mortality. The final models were incorporated into an open access web application able to provide predictions as well as patient-specific explanations of the results generated by the algorithms. The application can be found at https://sorg-apps.shinyapps.io/spinemetssurvival/ CONCLUSION Preoperative estimation of 90-d and 1-yr mortality was achieved with assessment of more flexible modeling techniques such as machine learning. Integration of these models into applications and patient-centered explanations of predictions represent opportunities for incorporation into healthcare systems as decision tools in the future.

Sign in / Sign up

Export Citation Format

Share Document