An extension of a convergence theorem for Markov chains arising in population genetics

2016 ◽  
Vol 53 (3) ◽  
pp. 953-956 ◽  
Author(s):  
Martin Möhle ◽  
Morihiro Notohara

AbstractAn extension of a convergence theorem for sequences of Markov chains is derived. For every positive integer N let (XN(r))r be a Markov chain with the same finite state space S and transition matrix ΠN=I+dNBN, where I is the unit matrix, Q a generator matrix, (BN)N a sequence of matrices, limN℩∞cN= limN→∞dN=0 and limN→∞cN∕dN=0. Suppose that the limits P≔limm→∞(I+dNQ)m and G≔limN→∞PBNP exist. If the sequence of initial distributions PXN(0) converges weakly to some probability measure μ, then the finite-dimensional distributions of (XN([t∕cN))t≥0 converge to those of the Markov process (Xt)t≥0 with initial distribution μ, transition matrix PetG and limN→∞(I+dNQ+cNBN)[t∕cN]

2009 ◽  
Vol 46 (02) ◽  
pp. 497-506 ◽  
Author(s):  
V. B. Yap

In a homogeneous continuous-time Markov chain on a finite state space, two states that jump to every other state with the same rate are called similar. By partitioning states into similarity classes, the algebraic derivation of the transition matrix can be simplified, using hidden holding times and lumped Markov chains. When the rate matrix is reversible, the transition matrix is explicitly related in an intuitive way to that of the lumped chain. The theory provides a unified derivation for a whole range of useful DNA base substitution models, and a number of amino acid substitution models.


2003 ◽  
Vol 40 (1) ◽  
pp. 107-122 ◽  
Author(s):  
Eilon Solan ◽  
Nicolas Vieille

We study irreducible time-homogenous Markov chains with finite state space in discrete time. We obtain results on the sensitivity of the stationary distribution and other statistical quantities with respect to perturbations of the transition matrix. We define a new closeness relation between transition matrices, and use graph-theoretic techniques, in contrast with the matrix analysis techniques previously used.


2003 ◽  
Vol 40 (01) ◽  
pp. 107-122 ◽  
Author(s):  
Eilon Solan ◽  
Nicolas Vieille

We study irreducible time-homogenous Markov chains with finite state space in discrete time. We obtain results on the sensitivity of the stationary distribution and other statistical quantities with respect to perturbations of the transition matrix. We define a new closeness relation between transition matrices, and use graph-theoretic techniques, in contrast with the matrix analysis techniques previously used.


2009 ◽  
Vol 46 (2) ◽  
pp. 497-506 ◽  
Author(s):  
V. B. Yap

In a homogeneous continuous-time Markov chain on a finite state space, two states that jump to every other state with the same rate are called similar. By partitioning states into similarity classes, the algebraic derivation of the transition matrix can be simplified, using hidden holding times and lumped Markov chains. When the rate matrix is reversible, the transition matrix is explicitly related in an intuitive way to that of the lumped chain. The theory provides a unified derivation for a whole range of useful DNA base substitution models, and a number of amino acid substitution models.


1967 ◽  
Vol 4 (1) ◽  
pp. 192-196 ◽  
Author(s):  
J. N. Darroch ◽  
E. Seneta

In a recent paper, the authors have discussed the concept of quasi-stationary distributions for absorbing Markov chains having a finite state space, with the further restriction of discrete time. The purpose of the present note is to summarize the analogous results when the time parameter is continuous.


2009 ◽  
Vol 46 (3) ◽  
pp. 866-893 ◽  
Author(s):  
Thierry Huillet ◽  
Martin Möhle

A Markov chain X with finite state space {0,…,N} and tridiagonal transition matrix is considered, where transitions from i to i-1 occur with probability (i/N)(1-p(i/N)) and transitions from i to i+1 occur with probability (1-i/N)p(i/N). Here p:[0,1]→[0,1] is a given function. It is shown that if p is continuous with p(x)≤p(1) for all x∈[0,1] then, for each N, a dual process Y to X (with respect to a specific duality function) exists if and only if 1-p is completely monotone with p(0)=0. A probabilistic interpretation of Y in terms of an ancestral process of a mixed multitype Moran model with a random number of types is presented. It is shown that, under weak conditions on p, the process Y, properly time and space scaled, converges to an Ornstein–Uhlenbeck process as N tends to ∞. The asymptotics of the stationary distribution of Y is studied as N tends to ∞. Examples are presented involving selection mechanisms. results.


1982 ◽  
Vol 19 (02) ◽  
pp. 272-288 ◽  
Author(s):  
P. J. Brockwell ◽  
S. I. Resnick ◽  
N. Pacheco-Santiago

A study is made of the maximum, minimum and range on [0,t] of the integral processwhereSis a finite state-space Markov chain. Approximate results are derived by establishing weak convergence of a sequence of such processes to a Wiener process. For a particular family of two-state stationary Markov chains we show that the corresponding centered integral processes exhibit the Hurst phenomenon to a remarkable degree in their pre-asymptotic behaviour.


2008 ◽  
Vol 45 (3) ◽  
pp. 630-639 ◽  
Author(s):  
Víctor Ruiz

We introduce a class of stochastic processes in discrete time with finite state space by means of a simple matrix product. We show that this class coincides with that of the hidden Markov chains and provides a compact framework for it. We study a measure obtained by a projection on the real line of the uniform measure on the Sierpinski gasket, finding that the dimension of this measure fits with the Shannon entropy of an associated hidden Markov chain.


2009 ◽  
Vol 46 (03) ◽  
pp. 866-893 ◽  
Author(s):  
Thierry Huillet ◽  
Martin Möhle

A Markov chainXwith finite state space {0,…,N} and tridiagonal transition matrix is considered, where transitions fromitoi-1 occur with probability (i/N)(1-p(i/N)) and transitions fromitoi+1 occur with probability (1-i/N)p(i/N). Herep:[0,1]→[0,1] is a given function. It is shown that ifpis continuous withp(x)≤p(1) for allx∈[0,1] then, for eachN, a dual processYtoX(with respect to a specific duality function) exists if and only if 1-pis completely monotone withp(0)=0. A probabilistic interpretation ofYin terms of an ancestral process of a mixed multitype Moran model with a random number of types is presented. It is shown that, under weak conditions onp, the processY, properly time and space scaled, converges to an Ornstein–Uhlenbeck process asNtends to ∞. The asymptotics of the stationary distribution ofYis studied asNtends to ∞. Examples are presented involving selection mechanisms. results.


1994 ◽  
Vol 8 (1) ◽  
pp. 1-19 ◽  
Author(s):  
Madhav Desai ◽  
Sunil Kumar ◽  
P. R. Kumar

We consider time-inhomogeneous Markov chains on a finite state-space, whose transition probabilitiespij(t) = cijε(t)Vij are proportional to powers of a vanishing small parameter ε(t). We determine the precise relationship between this chain and the corresponding time-homogeneous chains pij= cijε(t)vij, as ε ↘ 0. Let {} be the steady-state distribution of this time-homogeneous chain. We characterize the orders {ηι} in = θ(εηι). We show that if ε(t) ↘ 0 slowly enough, then the timewise occupation measures βι := sup { q > 0 | Prob(x(t) = i) = + ∞}, called the recurrence orders, satisfy βi — βj = ηj — ηi. Moreover, : = { ηι|ηι = minj} is the set of ground states of the time-homogeneous chain, then x(t) → . in an appropriate sense, whenever η(t) is “cooled” slowly. We also show that there exists a critical ρ* such that x(t) → if and only if = + ∞. We characterize this critical rate as ρ* = max.min min max. Finally, we provide a graph algorithm for determining the orders [ηi] [βi] and the critical rate ρ*.


Sign in / Sign up

Export Citation Format

Share Document