Computational Bayesian Statistics Including Markov Chain Monte Carlo

Psychology ◽  
2021 ◽  
Author(s):  
Sarah Depaoli

The use of Bayesian statistics within psychology is on the rise, and this trajectory will likely continue to accelerate in the coming years. There are many different reasons why a researcher may want to implement Bayesian methodology. First, there are cases where models are too “complex” for traditional (frequentist) methods to handle. Second, Bayesian methods are sometimes preferred if only small samples are available, since the use of priors can improve estimation accuracy with minimal data. Third, the researcher may prefer to include background information in the estimation process, and this can be done via the priors. Finally, Bayesian methods produce results that are rich with detail and can be more informative about the population parameters. Specifically, information surrounding the entire posterior distribution is provided through Bayesian estimation, as opposed to a point estimate obtained through traditional (frequentist) methods. All of these reasons make Bayesian methods attractive to the psychological sciences. This bibliography begins with a section on General Overviews, which presents works that provide general introductions to Bayesian methods. A subsection within this overview section covers Papers Introducing Bayesian Methods to Subfields in Psychology, and a second subsection includes Resources for Particular Model Types Popular in Psychological Research. Next, some of the more comprehensive Bayesian Textbooks are presented, and this is followed by a treatment of the Philosophy that underlies Bayesian statistics. The next section is Markov Chain Monte Carlo and Samplers. One of the most common tools for Bayesian estimation is the Markov chain Monte Carlo (MCMC) algorithm. MCMC is used to construct chains through samplers, and these chains represent draws from the posterior. A subsection on Convergence is included here to highlight the importance of assessing Markov chain convergence. This is followed by a section on Prior Distributions, which includes subsections on Expert Elicitation of Priors and the Data-Prior Conflict. A section on Software Resources is presented, which covers some of the main software programs implementing Bayesian statistical modeling. Finally, a section on Model Assessment and Fit is presented. Each of these sections and subsections were selected to highlight an understanding of Bayesian statistics, the role it plays in psychology, and proper implementation.


Sign in / Sign up

Export Citation Format

Share Document