scholarly journals Geomatric ergodicity and quasi-stationarity in discrete-time birth-death processes

Author(s):  
Erik A. van Doorn ◽  
Pauline Schrijner

AbstractWe study two aspects of discrete-time birth-death processes, the common feature of which is the central role played by the decay parameter of the process. First, conditions for geometric ergodicity and bounds for the decay parameter are obtained. Then the existence and structure of quasi-stationary distributions are discussed. The analyses are based on the spectral representation for the n-step transition probabilities of a birth-death process developed by Karlin and McGregor.

1991 ◽  
Vol 23 (4) ◽  
pp. 683-700 ◽  
Author(s):  
Erik A. Van Doorn

For a birth–death process (X(t), ) on the state space {−1, 0, 1, ·· ·}, where −1 is an absorbing state which is reached with certainty and {0, 1, ·· ·} is an irreducible class, we address and solve three problems. First, we determine the set of quasi-stationary distributions of the process, that is, the set of initial distributions which are such that the distribution of X(t), conditioned on non-absorption up to time t, is independent of t. Secondly, we determine the quasi-limiting distribution of X(t), that is, the limit as t→∞ of the distribution of X(t), conditioned on non-absorption up to time t, for any initial distribution with finite support. Thirdly, we determine the rate of convergence of the transition probabilities of X(t), conditioned on non-absorption up to time t, to their limits. Some examples conclude the paper. Our main tools are the spectral representation for the transition probabilities of a birth–death process and a duality concept for birth–death processes.


1991 ◽  
Vol 23 (04) ◽  
pp. 683-700 ◽  
Author(s):  
Erik A. Van Doorn

For a birth–death process (X(t), ) on the state space {−1, 0, 1, ·· ·}, where −1 is an absorbing state which is reached with certainty and {0, 1, ·· ·} is an irreducible class, we address and solve three problems. First, we determine the set of quasi-stationary distributions of the process, that is, the set of initial distributions which are such that the distribution of X(t), conditioned on non-absorption up to time t, is independent of t. Secondly, we determine the quasi-limiting distribution of X(t), that is, the limit as t→∞ of the distribution of X(t), conditioned on non-absorption up to time t, for any initial distribution with finite support. Thirdly, we determine the rate of convergence of the transition probabilities of X(t), conditioned on non-absorption up to time t, to their limits. Some examples conclude the paper. Our main tools are the spectral representation for the transition probabilities of a birth–death process and a duality concept for birth–death processes.


2005 ◽  
Vol 42 (01) ◽  
pp. 185-198 ◽  
Author(s):  
Erik A. Van Doorn ◽  
Alexander I. Zeifman

We study birth-death processes on the nonnegative integers, where {1, 2,…} is an irreducible class and 0 an absorbing state, with the additional feature that a transition to state 0 may occur from any state. We give a condition for absorption (extinction) to be certain and obtain the eventual absorption probabilities when absorption is not certain. We also study the rate of convergence, as t → ∞, of the probability of absorption at time t, and relate it to the common rate of convergence of the transition probabilities that do not involve state 0. Finally, we derive upper and lower bounds for the probability of absorption at time t by applying a technique that involves the logarithmic norm of an appropriately defined operator.


2005 ◽  
Vol 42 (1) ◽  
pp. 185-198 ◽  
Author(s):  
Erik A. Van Doorn ◽  
Alexander I. Zeifman

We study birth-death processes on the nonnegative integers, where {1, 2,…} is an irreducible class and 0 an absorbing state, with the additional feature that a transition to state 0 may occur from any state. We give a condition for absorption (extinction) to be certain and obtain the eventual absorption probabilities when absorption is not certain. We also study the rate of convergence, as t → ∞, of the probability of absorption at time t, and relate it to the common rate of convergence of the transition probabilities that do not involve state 0. Finally, we derive upper and lower bounds for the probability of absorption at time t by applying a technique that involves the logarithmic norm of an appropriately defined operator.


2015 ◽  
Vol 52 (1) ◽  
pp. 278-289 ◽  
Author(s):  
Erik A. van Doorn

We study the decay parameter (the rate of convergence of the transition probabilities) of a birth-death process on {0, 1, …}, which we allow to evanesce by escape, via state 0, to an absorbing state -1. Our main results are representations for the decay parameter under four different scenarios, derived from a unified perspective involving the orthogonal polynomials appearing in Karlin and McGregor's representation for the transition probabilities of a birth-death process, and the Courant-Fischer theorem on eigenvalues of a symmetric matrix. We also show how the representations readily yield some upper and lower bounds that have appeared in the literature.


2015 ◽  
Vol 52 (01) ◽  
pp. 278-289 ◽  
Author(s):  
Erik A. van Doorn

We study the decay parameter (the rate of convergence of the transition probabilities) of a birth-death process on {0, 1, …}, which we allow to evanesce by escape, via state 0, to an absorbing state -1. Our main results are representations for the decay parameter under four different scenarios, derived from a unified perspective involving the orthogonal polynomials appearing in Karlin and McGregor's representation for the transition probabilities of a birth-death process, and the Courant-Fischer theorem on eigenvalues of a symmetric matrix. We also show how the representations readily yield some upper and lower bounds that have appeared in the literature.


1997 ◽  
Vol 34 (01) ◽  
pp. 46-53
Author(s):  
Pauline Schrijner ◽  
Erik A. Van Doorn

We consider a discrete-time birth-death process on the non-negative integers with −1 as an absorbing state and study the limiting behaviour asn →∞ of the process conditioned on non-absorption until timen.By proving that a condition recently proposed by Martinez and Vares is vacuously true, we establish that the conditioned process is always weakly convergent when all self-transition probabilities are zero. In the aperiodic case we obtain a necessary and sufficient condition for weak convergence.


2006 ◽  
Vol 2006 ◽  
pp. 1-15 ◽  
Author(s):  
Pauline Coolen-Schrijner ◽  
Erik A. van Doorn

The Karlin-McGregor representation for the transition probabilities of a birth-death process with an absorbing bottom state involves a sequence of orthogonal polynomials and the corresponding measure. This representation can be generalized to a setting in which a transition to the absorbing state (killing) is possible from any state rather than just one state. The purpose of this paper is to investigate to what extent properties of birth-death processes, in particular with regard to the existence of quasi-stationary distributions, remain valid in the generalized setting. It turns out that the elegant structure of the theory of quasi-stationarity for birth-death processes remains largely intact as long as killing is possible from only finitely many states. In particular, the existence of a quasi-stationary distribution is ensured in this case if absorption is certain and the state probabilities tend to zero exponentially fast.


1997 ◽  
Vol 34 (1) ◽  
pp. 46-53 ◽  
Author(s):  
Pauline Schrijner ◽  
Erik A. Van Doorn

We consider a discrete-time birth-death process on the non-negative integers with −1 as an absorbing state and study the limiting behaviour as n → ∞ of the process conditioned on non-absorption until time n. By proving that a condition recently proposed by Martinez and Vares is vacuously true, we establish that the conditioned process is always weakly convergent when all self-transition probabilities are zero. In the aperiodic case we obtain a necessary and sufficient condition for weak convergence.


1997 ◽  
Vol 29 (1) ◽  
pp. 185-204 ◽  
Author(s):  
M. Kijima ◽  
M. G. Nair ◽  
P. K. Pollett ◽  
E. A. Van Doorn

In a recent paper [16], one of us identified all of the quasi-stationary distributions for a non-explosive, evanescent birth-death process for which absorption is certain, and established conditions for the existence of the corresponding limiting conditional distributions. Our purpose is to extend these results in a number of directions. We shall consider separately two cases depending on whether or not the process is evanescent. In the former case we shall relax the condition that absorption is certain. Furthermore, we shall allow for the possibility that the minimal process might be explosive, so that the transition rates alone will not necessarily determine the birth-death process uniquely. Although we shall be concerned mainly with the minimal process, our most general results hold for any birth-death process whose transition probabilities satisfy both the backward and the forward Kolmogorov differential equations.


Sign in / Sign up

Export Citation Format

Share Document