Coupling from the past: A user’s guide

Author(s):  
James Propp ◽  
David Wilson
2008 ◽  
Vol 45 (02) ◽  
pp. 568-574
Author(s):  
Erol A. Peköz ◽  
Sheldon M. Ross

We give a new method for simulating the time average steady-state distribution of a continuous-time queueing system, by extending a ‘read-once’ or ‘forward’ version of the coupling from the past (CFTP) algorithm developed for discrete-time Markov chains. We then use this to give a new proof of the ‘Poisson arrivals see time averages’ (PASTA) property, and a new proof for why renewal arrivals see either stochastically smaller or larger congestion than the time average if interarrival times are respectively new better than used in expectation (NBUE) or new worse than used in expectation (NWUE).


2011 ◽  
Vol 48 (A) ◽  
pp. 165-182 ◽  
Author(s):  
Jose H. Blanchet ◽  
Karl Sigman

A stochastic perpetuity takes the formD∞=∑n=0∞exp(Y1+⋯+Yn)Bn, whereYn:n≥0) and (Bn:n≥0) are two independent sequences of independent and identically distributed random variables (RVs). This is an expression for the stationary distribution of the Markov chain defined recursively byDn+1=AnDn+Bn,n≥0, whereAn=eYn;D∞then satisfies the stochastic fixed-point equationD∞D̳AD∞+B, whereAandBare independent copies of theAnandBn(and independent ofD∞on the right-hand side). In our framework, the quantityBn, which represents a random reward at timen, is assumed to be positive, unbounded with EBnp<∞ for somep>0, and have a suitably regular continuous positive density. The quantityYnis assumed to be light tailed and represents a discount rate from timenton-1. The RVD∞then represents the net present value, in a stochastic economic environment, of an infinite stream of stochastic rewards. We provide an exact simulation algorithm for generating samples ofD∞. Our method is a variation ofdominated coupling from the pastand it involves constructing a sequence of dominating processes.


2011 ◽  
Vol 43 (02) ◽  
pp. 484-503 ◽  
Author(s):  
Hongsheng Dai

In a fork-join network each incoming job is split into K tasks and the K tasks are simultaneously assigned to K parallel service stations for processing. For the distributions of response times and queue lengths of fork-join networks, no explicit formulae are available. Existing methods provide only analytic approximations for the response time and the queue length distributions. The accuracy of such approximations may be difficult to justify for some complicated fork-join networks. In this paper we propose a perfect simulation method based on coupling from the past to generate exact realisations from the equilibrium of fork-join networks. Using the simulated realisations, Monte Carlo estimates for the distributions of response times and queue lengths of fork-join networks are obtained. Comparisons of Monte Carlo estimates and theoretical approximations are also provided. The efficiency of the sampling algorithm is shown theoretically and via simulation.


2011 ◽  
Vol 43 (2) ◽  
pp. 484-503 ◽  
Author(s):  
Hongsheng Dai

In a fork-join network each incoming job is split into K tasks and the K tasks are simultaneously assigned to K parallel service stations for processing. For the distributions of response times and queue lengths of fork-join networks, no explicit formulae are available. Existing methods provide only analytic approximations for the response time and the queue length distributions. The accuracy of such approximations may be difficult to justify for some complicated fork-join networks. In this paper we propose a perfect simulation method based on coupling from the past to generate exact realisations from the equilibrium of fork-join networks. Using the simulated realisations, Monte Carlo estimates for the distributions of response times and queue lengths of fork-join networks are obtained. Comparisons of Monte Carlo estimates and theoretical approximations are also provided. The efficiency of the sampling algorithm is shown theoretically and via simulation.


2011 ◽  
Vol 48 (A) ◽  
pp. 165-182 ◽  
Author(s):  
Jose H. Blanchet ◽  
Karl Sigman

A stochastic perpetuity takes the form D∞=∑n=0∞ exp(Y1+⋯+Yn)Bn, where Yn:n≥0) and (Bn:n≥0) are two independent sequences of independent and identically distributed random variables (RVs). This is an expression for the stationary distribution of the Markov chain defined recursively by Dn+1=AnDn+Bn, n≥0, where An=eYn; D∞ then satisfies the stochastic fixed-point equation D∞D̳AD∞+B, where A and B are independent copies of the An and Bn (and independent of D∞ on the right-hand side). In our framework, the quantity Bn, which represents a random reward at time n, is assumed to be positive, unbounded with EBnp <∞ for some p>0, and have a suitably regular continuous positive density. The quantity Yn is assumed to be light tailed and represents a discount rate from time n to n-1. The RV D∞ then represents the net present value, in a stochastic economic environment, of an infinite stream of stochastic rewards. We provide an exact simulation algorithm for generating samples of D∞. Our method is a variation of dominated coupling from the past and it involves constructing a sequence of dominating processes.


2019 ◽  
Vol 51 (4) ◽  
pp. 967-993
Author(s):  
Jorge I. González Cázares ◽  
Aleksandar Mijatović ◽  
Gerónimo Uribe Bravo

AbstractWe exhibit an exact simulation algorithm for the supremum of a stable process over a finite time interval using dominated coupling from the past (DCFTP). We establish a novel perpetuity equation for the supremum (via the representation of the concave majorants of Lévy processes [27]) and use it to construct a Markov chain in the DCFTP algorithm. We prove that the number of steps taken backwards in time before the coalescence is detected is finite. We analyse the performance of the algorithm numerically (the code, written in Julia 1.0, is available on GitHub).


2013 ◽  
Vol 34 (5) ◽  
pp. 1567-1586 ◽  
Author(s):  
SANDRO GALLO ◽  
DANIEL Y. TAKAHASHI

AbstractWe prove that uniqueness of the stationary chain, or equivalently, of the$g$-measure, compatible with an attractive regular probability kernel is equivalent to either one of the following two assertions for this chain: (1) it is a finitary coding of an independent and identically distributed (i.i.d.) process with countable alphabet; (2) the concentration of measure holds at exponential rate. We show in particular that if a stationary chain is uniquely defined by a kernel that is continuous and attractive, then this chain can be sampled using a coupling-from-the-past algorithm. For the original Bramson–Kalikow model we further prove that there exists a unique compatible chain if and only if the chain is a finitary coding of a finite alphabet i.i.d. process. Finally, we obtain some partial results on conditions for phase transition for general chains of infinite order.


Sign in / Sign up

Export Citation Format

Share Document