scholarly journals Stationary distribution Markov chain for Covid-19 pandemic

2021 ◽  
Vol 1722 ◽  
pp. 012084
Author(s):  
A L H Achmad ◽  
Mahrudinda ◽  
B N Ruchjana
Keyword(s):  
Markov Chain ◽  
Stationary Distribution

Approximating the stationary distribution of an infinite stochastic matrix

1991 ◽  
Vol 28 (1) ◽  
pp. 96-103 ◽  
Author(s):  
Daniel P. Heyman
Keyword(s):  
Markov Chain ◽  
Steady State ◽  
Stationary Distribution ◽  
Numerical Approximation ◽  
Stochastic Matrix ◽  
Sufficient Conditions ◽  
Finite System ◽  
Balance Equations ◽  
The Given ◽  
Steady State Balance

We are given a Markov chain with states 0, 1, 2, ···. We want to get a numerical approximation of the steady-state balance equations. To do this, we truncate the chain, keeping the first n states, make the resulting matrix stochastic in some convenient way, and solve the finite system. The purpose of this paper is to provide some sufficient conditions that imply that as n tends to infinity, the stationary distributions of the truncated chains converge to the stationary distribution of the given chain. Our approach is completely probabilistic, and our conditions are given in probabilistic terms. We illustrate how to verify these conditions with five examples.

An extension of a theorem concerning an interesting Markov chain

1973 ◽  
Vol 10 (4) ◽  
pp. 886-890 ◽  
Author(s):  
W. J. Hendricks
Keyword(s):  
Markov Chain ◽  
Stationary Distribution ◽  
Ergodic Markov Chain ◽  
The Right

In a single-shelf library of N books we suppose that books are selected one at a time and returned to the kth position on the shelf before another selection is made. Books are moved to the right or left as necessary to vacate position k. The probability of selecting each book is assumed to be known, and the N! arrangements of the books are considered as states of an ergodic Markov chain for which we find the stationary distribution.

Perturbation theory and finite Markov chains

1968 ◽  
Vol 5 (2) ◽  
pp. 401-413 ◽  
Author(s):  
Paul J. Schweitzer
Keyword(s):  
Perturbation Theory ◽  
Markov Chain ◽  
Markov Chains ◽  
Stationary Distribution ◽  
Fundamental Matrix ◽  
Transition Probabilities ◽  
Semi Group ◽  
Partial Derivatives ◽  
Finite Markov Chains ◽  
Derivatives Of

A perturbation formalism is presented which shows how the stationary distribution and fundamental matrix of a Markov chain containing a single irreducible set of states change as the transition probabilities vary. Expressions are given for the partial derivatives of the stationary distribution and fundamental matrix with respect to the transition probabilities. Semi-group properties of the generators of transformations from one Markov chain to another are investigated. It is shown that a perturbation formalism exists in the multiple subchain case if and only if the change in the transition probabilities does not alter the number of, or intermix the various subchains. The formalism is presented when this condition is satisfied.

scholarly journals A Combinatorial Derivation of the PASEP Stationary State

10.37236/1134 ◽  
2006 ◽  
Vol 13 (1) ◽  
Author(s):  
Richard Brak ◽  
Sylvie Corteel ◽  
John Essam ◽  
Robert Parviainen ◽  
Andrew Rechnitzer
Keyword(s):  
Markov Chain ◽  
Stationary State ◽  
Stationary Distribution ◽  
Exclusion Process ◽  
Direct Proof ◽  
Asymmetric Exclusion Process ◽  
Original Process ◽  
Combinatorial Derivation ◽  
Path Models ◽  
Asymmetric Exclusion

We give a combinatorial derivation and interpretation of the weights associated with the stationary distribution of the partially asymmetric exclusion process. We define a set of weight equations, which the stationary distribution satisfies. These allow us to find explicit expressions for the stationary distribution and normalisation using both recurrences and path models. To show that the stationary distribution satisfies the weight equations, we construct a Markov chain on a larger set of generalised configurations. A bijection on this new set of configurations allows us to find the stationary distribution of the new chain. We then show that a subset of the generalised configurations is equivalent to the original process and that the stationary distribution on this subset is simply related to that of the original chain. We also provide a direct proof of the validity of the weight equations.

Perturbation bounds for the stationary probabilities of a finite Markov chain

1984 ◽  
Vol 16 (04) ◽  
pp. 804-818 ◽  
Author(s):  
Moshe Haviv ◽  
Ludo Van Der Heyden
Keyword(s):  
Markov Chain ◽  
Stationary Distribution ◽  
Finite Markov Chain ◽  
Perturbation Bounds ◽  
Aggregation Technique ◽  
Stationary Probabilities

This paper discusses perturbation bounds for the stationary distribution of a finite indecomposable Markov chain. Existing bounds are reviewed. New bounds are presented which more completely exploit the stochastic features of the perturbation and which also are easily computable. Examples illustrate the tightness of the bounds and their application to bounding the error in the Simon–Ando aggregation technique for approximating the stationary distribution of a nearly completely decomposable Markov chain.

A Markov chain associated with the minimal quasi-stationary distribution of birth–death chains

1995 ◽  
Vol 32 (01) ◽  
pp. 25-38
Author(s):  
Servet Martínez ◽  
Maria Eulália Vares
Keyword(s):  
Markov Chain ◽  
Stationary Distribution ◽  
Conditional Distribution ◽  
Transition Probabilities ◽  
The Matrix ◽  
Quasi Stationary Distribution ◽  
Birth Death

We show that if the limiting conditional distribution for an absorbed birth–death chain exists, then the chain conditioned to non-absorption converges to a Markov chain with transition probabilities given by the matrix associated with the minimal quasi-stationary distribution.

A stable algorithm for stationary distribution calculation for a BMAP/SM/1 queueing system with Markovian arrival input of disasters

2004 ◽  
Vol 41 (02) ◽  
pp. 547-556 ◽  
Author(s):  
Alexander Dudin ◽  
Olga Semenova
Keyword(s):  
Markov Chain ◽  
Stationary State ◽  
Stationary Distribution ◽  
Queueing System ◽  
Embedded Markov Chain ◽  
State Distribution ◽  
Stable Algorithm ◽  
Distribution Calculation

Disaster arrival into a queueing system causes all customers to leave the system instantaneously. We present a numerically stable algorithm for calculating the stationary state distribution of an embedded Markov chain for the BMAP/SM/1 queue with a MAP input of disasters.

Sign in / Sign up

Export Citation Format

Share Document