scholarly journals Stationary Distributions of Continuous-Time Markov Chains: A Review of Theory and Truncation-Based Approximations

SIAM Review ◽  
2021 ◽  
Vol 63 (1) ◽  
pp. 3-64
Author(s):  
Juan Kuntz ◽  
Philipp Thomas ◽  
Guy-Bart Stan ◽  
Mauricio Barahona
Keyword(s):  
Markov Chains ◽  
Continuous Time ◽  
Stationary Distributions ◽  
Continuous Time Markov Chains

On the Problem of Establishing the Existence of Stationary Distributions for Continuous-Time Markov Chains

1993 ◽  
Vol 7 (4) ◽  
pp. 529-543 ◽  
Author(s):  
P. K. Pollett ◽  
P. G. Taylor
Keyword(s):  
Markov Chains ◽  
Continuous Time ◽  
Sufficient Conditions ◽  
Sufficient Condition ◽  
Transition Rates ◽  
Necessary And Sufficient Condition ◽  
Stationary Distributions ◽  
Continuous Time Markov Chains ◽  
Necessary And Sufficient ◽  
Networks Of Queues

We consider the problem of establishing the existence of stationary distributions for continuous-time Markov chains directly from the transition rates Q. Given an invariant probability distribution m for Q, we show that a necessary and sufficient condition for m to be a stationary distribution for the minimal process is that Q be regular. We provide sufficient conditions for the regularity of Q that are simple to verify in practice, thus allowing one to easily identify stationary distributions for a variety of models. To illustrate our results, we shall consider three classes of multidimensional Markov chains, namely, networks of queues with batch movements, semireversible queues, and partially balanced Markov processes.

scholarly journals Trace Machines for Observing Continuous-Time Markov Chains

2006 ◽  
Vol 153 (2) ◽  
pp. 259-277 ◽  
Author(s):  
Verena Wolf ◽  
Christel Baier ◽  
Mila Majster-Cederbaum
Keyword(s):  
Markov Chains ◽  
Continuous Time ◽  
Continuous Time Markov Chains

On quasi-stationary distributions in absorbing continuous-time finite Markov chains

1967 ◽  
Vol 4 (1) ◽  
pp. 192-196 ◽  
Author(s):  
J. N. Darroch ◽  
E. Seneta
Keyword(s):  
Markov Chains ◽  
Discrete Time ◽  
Continuous Time ◽  
Present Note ◽  
Time Parameter ◽  
Stationary Distributions ◽  
Finite State ◽  
Absorbing Markov Chains ◽  
Finite Markov Chains ◽  
Finite State Space

In a recent paper, the authors have discussed the concept of quasi-stationary distributions for absorbing Markov chains having a finite state space, with the further restriction of discrete time. The purpose of the present note is to summarize the analogous results when the time parameter is continuous.

Sign in / Sign up

Export Citation Format

Share Document