An assessment of predictive performance of Zellner’s g-priors in Bayesian model averaging

2018 ◽  
Vol 13 (1) ◽  
pp. 63-71
Author(s):  
Rotimi Ogundeji ◽  
Ismaila Adeleke ◽  
Ray Okafor
2019 ◽  
Vol 220 (2) ◽  
pp. 1368-1378
Author(s):  
M Bertin ◽  
S Marin ◽  
C Millet ◽  
C Berge-Thierry

SUMMARY In low-seismicity areas such as Europe, seismic records do not cover the whole range of variable configurations required for seismic hazard analysis. Usually, a set of empirical models established in such context (the Mediterranean Basin, northeast U.S.A., Japan, etc.) is considered through a logic-tree-based selection process. This approach is mainly based on the scientist’s expertise and ignores the uncertainty in model selection. One important and potential consequence of neglecting model uncertainty is that we assign more precision to our inference than what is warranted by the data, and this leads to overly confident decisions and precision. In this paper, we investigate the Bayesian model averaging (BMA) approach, using nine ground-motion prediction equations (GMPEs) issued from several databases. The BMA method has become an important tool to deal with model uncertainty, especially in empirical settings with large number of potential models and relatively limited number of observations. Two numerical techniques, based on the Markov chain Monte Carlo method and the maximum likelihood estimation approach, for implementing BMA are presented and applied together with around 1000 records issued from the RESORCE-2013 database. In the example considered, it is shown that BMA provides both a hierarchy of GMPEs and an improved out-of-sample predictive performance.


2018 ◽  
Vol 42 (4) ◽  
pp. 423-457 ◽  
Author(s):  
David Kaplan ◽  
Chansoon Lee

This article provides a review of Bayesian model averaging as a means of optimizing the predictive performance of common statistical models applied to large-scale educational assessments. The Bayesian framework recognizes that in addition to parameter uncertainty, there is uncertainty in the choice of models themselves. A Bayesian approach to addressing the problem of model uncertainty is the method of Bayesian model averaging. Bayesian model averaging searches the space of possible models for a set of submodels that satisfy certain scientific principles and then averages the coefficients across these submodels weighted by each model’s posterior model probability (PMP). Using the weighted coefficients for prediction has been shown to yield optimal predictive performance according to certain scoring rules. We demonstrate the utility of Bayesian model averaging for prediction in education research with three examples: Bayesian regression analysis, Bayesian logistic regression, and a recently developed approach for Bayesian structural equation modeling. In each case, the model-averaged estimates are shown to yield better prediction of the outcome of interest than any submodel based on predictive coverage and the log-score rule. Implications for the design of large-scale assessments when the goal is optimal prediction in a policy context are discussed.


2019 ◽  
Vol 11 (1) ◽  
Author(s):  
Jie Chen ◽  
Yongming Liu

Accurate pipe material strength estimation is critical for the integrity and risk assessment of aging pipeline infrastructure systems. To predict the strength without interrupting the serviceability of the pipeline, inference methods are used through the relationship between the bulk yield tensile strength and surface material properties from nondestructive testing, such as chemical composition, microstructure images, and hardness testing. In order to make the best of information provided by multimodality surface measurements, Bayesian model averaging (BMA) method is used in this paper to integrate the information from various types of surface measurements for a more accurate bulk strength estimation. The models being considered are constructed by randomly combining the multimodality surface measurements and each case of linear combinations is included. The models considered are assessed by assigning different weights based on the posterior model probability. Markov Chain Monte Carlo sampling provides an effective way for numerically computing the marginal likelihoods, which are essential for obtaining the posterior model probabilities. To avoid the risk of overfitting, BMA is implemented to account for model uncertainty. The predictive performance of single model and BMA are compared by logarithmic scoring rule. The data collected from industry are used for demonstration and model predictive performance assessment. It is shown that the Bayesian model averaging approach can provide more reliable results in predicting the strength of the aging pipelines.


Author(s):  
Lorenzo Bencivelli ◽  
Massimiliano Giuseppe Marcellino ◽  
Gianluca Moretti

Sign in / Sign up

Export Citation Format

Share Document