Approach to Stationarity of the Bernoulli–Laplace Diffusion Model

1994 ◽  
Vol 26 (03) ◽  
pp. 715-727
Author(s):  
Peter Donnelly ◽  
Peter Lloyd ◽  
Aidan Sudbury

Two urns initially contain r red balls and n – r black balls respectively. At each time epoch a ball is chosen randomly from each urn and the balls are switched. Effectively the same process arises in many other contexts, notably for a symmetric exclusion process and random walk on the Johnson graph. If Y(·) counts the number of black balls in the first urn then we give a direct asymptotic analysis of its transition probabilities to show that (when run at rate (n – r)/n in continuous time) for as n →∞, where π n denotes the equilibrium distribution of Y(·) and γ α = 1 – α /β (1 – β). Thus for large n the transient probabilities approach their equilibrium values at time log n + log|γ α | (≦log n) in a particularly sharp manner. The same is true of the separation distance between the transient distribution and the equilibrium distribution. This is an explicit analysis of the so-called cut-off phenomenon associated with a wide variety of Markov chains.

1994 ◽  
Vol 26 (3) ◽  
pp. 715-727 ◽  
Author(s):  
Peter Donnelly ◽  
Peter Lloyd ◽  
Aidan Sudbury

Two urns initially contain r red balls and n – r black balls respectively. At each time epoch a ball is chosen randomly from each urn and the balls are switched. Effectively the same process arises in many other contexts, notably for a symmetric exclusion process and random walk on the Johnson graph. If Y(·) counts the number of black balls in the first urn then we give a direct asymptotic analysis of its transition probabilities to show that (when run at rate (n – r)/n in continuous time) for as n →∞, where π n denotes the equilibrium distribution of Y(·) and γ α = 1 – α /β (1 – β). Thus for large n the transient probabilities approach their equilibrium values at time log n + log|γ α | (≦log n) in a particularly sharp manner. The same is true of the separation distance between the transient distribution and the equilibrium distribution. This is an explicit analysis of the so-called cut-off phenomenon associated with a wide variety of Markov chains.


Author(s):  
Leonid Petrov ◽  
Axel Saenz

AbstractWe obtain a new relation between the distributions $$\upmu _t$$ μ t at different times $$t\ge 0$$ t ≥ 0 of the continuous-time totally asymmetric simple exclusion process (TASEP) started from the step initial configuration. Namely, we present a continuous-time Markov process with local interactions and particle-dependent rates which maps the TASEP distributions $$\upmu _t$$ μ t backwards in time. Under the backwards process, particles jump to the left, and the dynamics can be viewed as a version of the discrete-space Hammersley process. Combined with the forward TASEP evolution, this leads to a stationary Markov dynamics preserving $$\upmu _t$$ μ t which in turn brings new identities for expectations with respect to $$\upmu _t$$ μ t . The construction of the backwards dynamics is based on Markov maps interchanging parameters of Schur processes, and is motivated by bijectivizations of the Yang–Baxter equation. We also present a number of corollaries, extensions, and open questions arising from our constructions.


Risks ◽  
2021 ◽  
Vol 9 (2) ◽  
pp. 37
Author(s):  
Manuel L. Esquível ◽  
Gracinda R. Guerreiro ◽  
Matilde C. Oliveira ◽  
Pedro Corte Real

We consider a non-homogeneous continuous time Markov chain model for Long-Term Care with five states: the autonomous state, three dependent states of light, moderate and severe dependence levels and the death state. For a general approach, we allow for non null intensities for all the returns from higher dependence levels to all lesser dependencies in the multi-state model. Using data from the 2015 Portuguese National Network of Continuous Care database, as the main research contribution of this paper, we propose a method to calibrate transition intensities with the one step transition probabilities estimated from data. This allows us to use non-homogeneous continuous time Markov chains for modeling Long-Term Care. We solve numerically the Kolmogorov forward differential equations in order to obtain continuous time transition probabilities. We assess the quality of the calibration using the Portuguese life expectancies. Based on reasonable monthly costs for each dependence state we compute, by Monte Carlo simulation, trajectories of the Markov chain process and derive relevant information for model validation and premium calculation.


2014 ◽  
Vol 2014 ◽  
pp. 1-8 ◽  
Author(s):  
Jumei Wei ◽  
Rui Ma

This paper investigates the problem of the stability and stabilization of continuous-time Markovian jump singular systems with partial information on transition probabilities. A new stability criterion which is necessary and sufficient is obtained for these systems. Furthermore, sufficient conditions for the state feedback controller design are derived in terms of linear matrix inequalities. Finally, numerical examples are given to illustrate the effectiveness of the proposed methods.


1987 ◽  
Vol 1 (3) ◽  
pp. 251-264 ◽  
Author(s):  
Sheldon M. Ross

In this paper we propose a new approach for estimating the transition probabilities and mean occupation times of continuous-time Markov chains. Our approach is to approximate the probability of being in a state (or the mean time already spent in a state) at time t by the probability of being in that state (or the mean time already spent in that state) at a random time that is gamma distributed with mean t.


2009 ◽  
Vol 41 (01) ◽  
pp. 270-291 ◽  
Author(s):  
Hua Zhou ◽  
Kenneth Lange

Suppose that n identical particles evolve according to the same marginal Markov chain. In this setting we study chains such as the Ehrenfest chain that move a prescribed number of randomly chosen particles at each epoch. The product chain constructed by this device inherits its eigenstructure from the marginal chain. There is a further chain derived from the product chain called the composition chain that ignores particle labels and tracks the numbers of particles in the various states. The composition chain in turn inherits its eigenstructure and various properties such as reversibility from the product chain. The equilibrium distribution of the composition chain is multinomial. The current paper proves these facts in the well-known framework of state lumping and identifies the column eigenvectors of the composition chain with the multivariate Krawtchouk polynomials of Griffiths. The advantages of knowing the full spectral decomposition of the composition chain include (a) detailed estimates of the rate of convergence to equilibrium, (b) construction of martingales that allow calculation of the moments of the particle counts, and (c) explicit expressions for mean coalescence times in multi-person random walks. These possibilities are illustrated by applications to Ehrenfest chains, the Hoare and Rahman chain, Kimura's continuous-time chain for DNA evolution, a light bulb chain, and random walks on some specific graphs.


2010 ◽  
Vol 08 (08) ◽  
pp. 1323-1335 ◽  
Author(s):  
S. SALIMI ◽  
R. RADGOHAR ◽  
M. M. SOLTANZADEH

We study the classical and quantum transport processes on some finite networks and model them by continuous-time random walks (CTRW) and continuous-time quantum walks (CTQW), respectively. We calculate the classical and quantum transition probabilities between two nodes of the network. We numerically show that there is a high probability to find the walker at the initial node for CTQWs on the underlying networks due to the interference phenomenon, even for long times. To get global information (independent of the starting node) about the transport efficiency, we average the return probability over all nodes of the network. We apply the decay rate and the asymptotic value of the average of the return probability to evaluate the transport efficiency. Our numerical results prove that the existence of the symmetry in the underlying networks makes quantum transport less efficient than the classical one. In addition, we find that the increasing of the symmetry of these networks decreases the efficiency of quantum transport on them.


1992 ◽  
Vol 6 (1) ◽  
pp. 127-131 ◽  
Author(s):  
Masaaki Kijima

An external uniformization technique was developed by Ross [4] to obtain approximations of transition probabilities of finite Markov chains in continuous time. Yoon and Shanthikumar [7] then reported through extensive numerical experiments that this technique performs quite well compared to other existing methods. In this paper, we show that external uniformization results from the strong law of large numbers whose underlying distributions are exponential. Based on this observation, some remarks regarding properties of the approximation are given.


Sign in / Sign up

Export Citation Format

Share Document