Markov Chain Monte Carlo (MCMC, Metropolis-Hastings, Gibbs Sampling)

Author(s):  
John M. Hancock
2019 ◽  
Vol 8 (2) ◽  
pp. 76
Author(s):  
Jusri Repi Basri Yuliani ◽  
Maiyastri Maiyastri ◽  
Rita Diana

Penelitian ini mengkaji tentang pendekatan Hierarchical Bayesian (HB) Loglogistik yang diaplikasikan pada Small Area Estimation (SAE) dengan tujuan mengestimasi tingkat kemiskinan di Kabupaten Padang Pariaman. Metode pendugaan area kecil yang digunakan pada penelitian ini adalah model level area dasar (basic area level model ) dengan bantuan variabel penyerta yang tersedia pada level kecamatan. Variabel penyerta yang digunakan pada penelitian ini yaitu rasio SLTA/Sederajat (X1), persentase keluarga pertanian (X2), rasio industri mikro kecil (X3), persentase buruh tani dalam setiap anggota keluarga (X4), kepadatan penduduk (X5), dan persentase penduduk pelanggan listrik PLN (X6). Bentuk integrasi yang kompleks dari sebaran peluang bersyarat pada model diselesaikan menggunakan Markov Chain Monte Carlo (MCMC) dengan menerapkan algortima Gibbs Sampling dan bantuan software WinBugs 1.4.3. Hasil estimasi menggunkan model HB yang diperoleh dibandingkan dengan hasil estimasi pendugaan langsung dengan memperhatikan nilai standard error sebagai tolok ukurnya. Hasil pendugaan tingkat kemiskinan untuk level kecamatan di Kabupaten Padang Pariaman dengan model HB menunjukkan nilai standard error yang kecil.Kata Kunci: Tingkat kemiskinan, Small Area Estimation, Hierarchical Bayesian


Author(s):  
Christopher De Sa ◽  
Kunle Olukotun ◽  
Christopher Ré

Gibbs sampling is a Markov chain Monte Carlo technique commonly used for estimating marginal distributions. To speed up Gibbs sampling, there has recently been interest in parallelizing it by executing asynchronously. While empirical results suggest that many models can be efficiently sampled asynchronously, traditional Markov chain analysis does not apply to the asynchronous case, and thus asynchronous Gibbs sampling is poorly understood. In this paper, we derive a better understanding of the two main challenges of asynchronous Gibbs: bias and mixing time. We show experimentally that our theoretical results match practical outcomes.


2019 ◽  
Vol 51 (1) ◽  
Author(s):  
Motohide Nishio ◽  
Aisaku Arakawa

Abstract Background Hamiltonian Monte Carlo is one of the algorithms of the Markov chain Monte Carlo method that uses Hamiltonian dynamics to propose samples that follow a target distribution. The method can avoid the random walk behavior to achieve a more effective and consistent exploration of the probability space and sensitivity to correlated parameters, which are shortcomings that plague many Markov chain Monte Carlo methods. However, the performance of Hamiltonian Monte Carlo is highly sensitive to two hyperparameters. The No-U-Turn Sampler, an extension of Hamiltonian Monte Carlo, was recently introduced to automate the tuning of these hyperparameters. Thus, this study compared the performances of Gibbs sampling, Hamiltonian Monte Carlo, and the No-U-Turn Sampler for estimating genetic parameters and breeding values as well as sampling qualities in both simulated and real pig data. For all datasets, we used a pedigree-based univariate linear mixed model. Results For all datasets, the No-U-Turn Sampler and Gibbs sampling performed comparably regarding the estimation of heritabilities and accuracies of breeding values. Compared with Gibbs sampling, the estimates of effective sample sizes for simulated and pig data with the No-U-Turn Sampler were 3.2 to 22.6 and 3.5 to 5.9 times larger, respectively. Autocorrelations decreased more quickly with the No-U-Turn Sampler than with Gibbs sampling. When true heritability was low in the simulated data, the skewness of the marginal posterior distributions with the No-U-Turn Sampler was smaller than that with Gibbs sampling. The performance of Hamiltonian Monte Carlo for sampling quality was inferior to that of No-U-Turn Sampler in the simulated data. Moreover, Hamiltonian Monte Carlo could not estimate genetic parameters because of difficulties with the hyperparameter settings with pig data. Conclusions The No-U-Turn Sampler is a promising sampling method for animal breeding because of its good sampling qualities: large effective sample sizes, low autocorrelations, and low skewness of marginal posterior distributions, particularly when heritability is low. Meanwhile, Hamiltonian Monte Carlo failed to converge with a simple univariate model for pig data. Thus, it might be difficult to use Hamiltonian Monte Carlo for usual complex models in animal breeding.


2017 ◽  
Vol 23 (3) ◽  
pp. 376
Author(s):  
Herlin Venny Johannes ◽  
Septiadi Padmadisastra ◽  
Bertho Tantular

ABSTRACTThis paper present a study for the number of crime that run into underreporting counts. The purpose of the analysis is to estimate parameter of the model which is the actual number of crime. The model is a mixture of the poisson and the binomial distributions developed by Winkelmann (1996). The parameters of the model are estimated by Bayesian approach and Markov Chain Monte Carlo simulation using Gibbs sampling algorithm. Determination the convergence of the algorithm using trace plot, autocorrelation plot and ergodic mean plot. In the end, estimator of the parameters of the underreported counts model are the simulation sample mean that calculated from the simulation sample of iteration after burn in period until the last iteration.ABSTRAKPenelitian ini mengkaji permodelan data tingkat kejahatan yang mengalami underreporting counts. Tujuan analisis ini adalah untuk menaksir parameter model yaitu banyaknya jumlah tindak kejahatan yang sebenarnya.  Model yang digunakan adalah hasil penggabungan antara distribusi poisson dan distribusi binomial yang dikembengkan oleh Winkelmann (1996). Penaksiran parameter model dilakukan melalui pendekatan bayes dan simulasi Markov Chain Monte Carlo menggunakan algoritma gibbs sampling. Penentuan konvergensi algoritma akan dilakukan melalui trace plot, autocorrelation plot, dan ergodic mean plot. Taksiran parameter model diperoleh dari rata-rata nilai sampel hasil simulasi yang dihitung dari iterasi setelah burn in period sampai dengan iterasi yang terakhir.


Sign in / Sign up

Export Citation Format

Share Document