Birth and Death Processes

2021 ◽  
pp. 19-32
Author(s):  
Michael B. Marcus ◽  
Jay Rosen
Keyword(s):  
Birth And Death Processes

scholarly journals Denumerable state continuous time Markov decision processes with unbounded cost and transition rates under average criterion

2002 ◽  
Vol 43 (4) ◽  
pp. 541-557 ◽  
Author(s):  
Xianping Guo ◽  
Weiping Zhu
Keyword(s):  
Markov Decision Processes ◽  
Continuous Time ◽  
Decision Processes ◽  
Transition Rates ◽  
Birth And Death Processes ◽  
Optimality Equation ◽  
Average Criterion ◽  
Markov Decision ◽  
Unbounded Cost ◽  
Queue Model

AbstractIn this paper, we consider denumerable state continuous time Markov decision processes with (possibly unbounded) transition and cost rates under average criterion. We present a set of conditions and prove the existence of both average cost optimal stationary policies and a solution of the average optimality equation under the conditions. The results in this paper are applied to an admission control queue model and controlled birth and death processes.

The λ-classification of continuous-time birth-and-death processes

2003 ◽  
Vol 35 (04) ◽  
pp. 1111-1130 ◽  
Author(s):  
Andrew G. Hart ◽  
Servet Martínez ◽  
Jaime San Martín
Keyword(s):  
Continuous Time ◽  
Sufficient Conditions ◽  
Necessary And Sufficient Conditions ◽  
Birth And Death Processes ◽  
Positive Recurrent ◽  
Necessary And Sufficient

We study the λ-classification of absorbing birth-and-death processes, giving necessary and sufficient conditions for such processes to be λ-transient, λ-null recurrent and λ-positive recurrent.

Spectral Theory for Skip-Free Markov Chains

1989 ◽  
Vol 3 (1) ◽  
pp. 77-88 ◽  
Author(s):  
Joseph Abate ◽  
Ward Whitt
Keyword(s):  
Markov Chains ◽  
Spectral Theory ◽  
First Passage Time ◽  
Passage Time ◽  
First Passage Times ◽  
Simple Relationship ◽  
First Passage ◽  
Birth And Death Processes ◽  
The Laplace Transform ◽  
Passage Times

The distribution of upward first passage times in skip-free Markov chains can be expressed solely in terms of the eigenvalues in the spectral representation, without performing a separate calculation to determine the eigenvectors. We provide insight into this result and skip-free Markov chains more generally by showing that part of the spectral theory developed for birth-and-death processes extends to skip-free chains. We show that the eigenvalues and eigenvectors of skip-free chains can be characterized in terms of recursively defined polynomials. Moreover, the Laplace transform of the upward first passage time from 0 to n is the reciprocal of the nth polynomial. This simple relationship holds because the Laplace transforms of the first passage times satisfy the same recursion as the polynomials except for a normalization.

Birth and death processes in large populations

Biometrika ◽  
1973 ◽  
Vol 60 (2) ◽  
pp. 419-420 ◽  
Author(s):  
N. G. VAN KAMPEN
Keyword(s):  
Birth And Death Processes ◽  
Large Populations

scholarly journals Skeletons of Near-Critical Bienaymé-Galton-Watson Branching Processes

2015 ◽  
Vol 47 (2) ◽  
pp. 530-544
Author(s):  
Serik Sagitov ◽  
Maria Conceição Serra
Keyword(s):  
Critical Case ◽  
Branching Processes ◽  
Threshold Value ◽  
High Threshold ◽  
Birth Process ◽  
Birth And Death Processes ◽  
Supercritical Case ◽  
Natural Choice ◽  
Future Reproduction ◽  
Asymptotic Representations

Skeletons of branching processes are defined as trees of lineages characterized by an appropriate signature of future reproduction success. In the supercritical case a natural choice is to look for the lineages that survive forever (O'Connell (1993)). In the critical case it was suggested that the particles with the total number of descendants exceeding a certain threshold could be distinguished (see Sagitov (1997)). These two definitions lead to asymptotic representations of the skeletons as either pure birth process (in the slightly supercritical case) or critical birth-death processes (in the critical case conditioned on the total number of particles exceeding a high threshold value). The limit skeletons reveal typical survival scenarios for the underlying branching processes. In this paper we consider near-critical Bienaymé-Galton-Watson processes and define their skeletons using marking of particles. If marking is rare, such skeletons are approximated by birth and death processes, which can be subcritical, critical, or supercritical. We obtain the limit skeleton for a sequential mutation model (Sagitov and Serra (2009)) and compute the density distribution function for the time to escape from extinction.

Zipf's Law for Firms: Relevance of Birth and Death Processes

2008 ◽  
Author(s):  
Yannick Malevergne ◽  
Alexander I. Saichev ◽  
Didier Sornette
Keyword(s):  
Zipf’S Law ◽  
Birth And Death Processes ◽  
Zipf's Law

On a property of finite-state birth and death processes

1986 ◽  
Vol 23 (04) ◽  
pp. 859-866
Author(s):  
A. J. Branford
Keyword(s):  
Simple Proof ◽  
Death Process ◽  
Birth And Death Process ◽  
Birth And Death Processes ◽  
Converse Result ◽  
Finite State ◽  
Event Times

A simple proof is given of the result that the ‘overflow' from a finite-state birth and death process is a renewal stream characterized by hyperexponential inter-event times. Our structure is utilized to give a converse result that any hyperexponential renewal stream can be so produced as the overflow from a finite-state birth and death process.

Optimal control of random walks, birth and death processes, and queues

1981 ◽  
Vol 13 (01) ◽  
pp. 61-83 ◽  
Author(s):  
Richard Serfozo
Keyword(s):  
Optimal Control ◽  
Random Walks ◽  
Queue Length ◽  
Transition Probabilities ◽  
Transition Rates ◽  
Average Reward ◽  
Birth And Death Processes ◽  
Optimal Policies ◽  
One Step ◽  
Increasing Functions

This is a study of simple random walks, birth and death processes, and M/M/s queues that have transition probabilities and rates that are sequentially controlled at jump times of the processes. Each control action yields a one-step reward depending on the chosen probabilities or transition rates and the state of the process. The aim is to find control policies that maximize the total discounted or average reward. Conditions are given for these processes to have certain natural monotone optimal policies. Under such a policy for the M/M/s queue, for example, the service and arrival rates are non-decreasing and non-increasing functions, respectively, of the queue length. Properties of these policies and a linear program for computing them are also discussed.

Sign in / Sign up

Export Citation Format

Share Document