A ratio limit theorem for (sub) Markov chains on {1,2, …} with bounded jumps

1995 ◽  
Vol 27 (3) ◽  
pp. 652-691 ◽  
Author(s):  
Harry Kesten

We consider positive matrices Q, indexed by {1,2, …}. Assume that there exists a constant 1 L < ∞ and sequences u1< u2< · ·· and d1d2< · ·· such that Q(i, j) = 0 whenever i < ur < ur + L < j or i > dr + L > dr > j for some r. If Q satisfies some additional uniform irreducibility and aperiodicity assumptions, then for s > 0, Q has at most one positive s-harmonic function and at most one s-invariant measure µ. We use this result to show that if Q is also substochastic, then it has the strong ratio limit property, that is for a suitable R and some R–1-harmonic function f and R–1-invariant measure µ. Under additional conditions µ can be taken as a probability measure on {1,2, …} and exists. An example shows that this limit may fail to exist if Q does not satisfy the restrictions imposed above, even though Q may have a minimal normalized quasi-stationary distribution (i.e. a probability measure µ for which R–1µ = µQ).The results have an immediate interpretation for Markov chains on {0,1,2, …} with 0 as an absorbing state. They give ratio limit theorems for such a chain, conditioned on not yet being absorbed at 0 by time n.

1995 ◽  
Vol 27 (03) ◽  
pp. 652-691
Author(s):  
Harry Kesten

We consider positive matricesQ,indexed by {1,2, …}. Assume that there exists a constant 1L &lt;∞ and sequencesu1&lt; u2&lt; · ··andd1d2&lt; · ··such thatQ(i, j) = 0 wheneveri&lt;ur&lt; ur+L &lt; jori &gt; dr+ L &gt; dr&gt; jfor somer. IfQsatisfies some additional uniform irreducibility and aperiodicity assumptions, then fors&gt; 0,Qhas at most one positives-harmonic function and at most ones-invariant measureµ.We use this result to show that ifQis also substochastic, then it has the strong ratio limit property, that isfor a suitableRand someR–1-harmonic functionfandR–1-invariant measureµ.Under additional conditionsµcan be taken as a probability measure on {1,2, …} andexists. An example shows that this limit may fail to exist ifQdoes not satisfy the restrictions imposed above, even thoughQmay have a minimal normalized quasi-stationary distribution (i.e. a probability measureµfor whichR–1µ = µQ).The results have an immediate interpretation for Markov chains on {0,1,2, …} with 0 as an absorbing state. They give ratio limit theorems for such a chain, conditioned on not yet being absorbed at 0 by timen.


1976 ◽  
Vol 28 (2) ◽  
pp. 403-407
Author(s):  
A. G. Mucci

Let be an adapted sequence of integrable random variables on the probability space . Let us set .The following result can be immediately derived from Brown [2]:


1978 ◽  
Vol 15 (02) ◽  
pp. 321-339 ◽  
Author(s):  
Gérard Letac

Nelson [9], [10] has computed the generating function of return probabilities to the initial state for a particular Markov chain on permutations of three objects. The formula obtained is The present paper studies three distinct Markov chains generalizing the Nelson chain: the so-called three-coloured chain, with some birth-and-death processes on ℤ as a particular case, a chain on a graph close to the graph of the edges of a cube, and the daisy library. Two other themes piece together these chains: the notion of coloured chain and the technique of computation by additive processes.


1978 ◽  
Vol 15 (2) ◽  
pp. 321-339 ◽  
Author(s):  
Gérard Letac

Nelson [9], [10] has computed the generating function of return probabilities to the initial state for a particular Markov chain on permutations of three objects. The formula obtained is The present paper studies three distinct Markov chains generalizing the Nelson chain: the so-called three-coloured chain, with some birth-and-death processes on ℤ as a particular case, a chain on a graph close to the graph of the edges of a cube, and the daisy library. Two other themes piece together these chains: the notion of coloured chain and the technique of computation by additive processes.


Sign in / Sign up

Export Citation Format

Share Document