scholarly journals Strong Stationary Duality and Algebraic Duality for Continuous Time Möbius Monotone Markov Chains

2021 ◽  
Vol 15 (2) ◽  
pp. 69-86
Author(s):  
Pan Zhao ◽  
Keyword(s):  
Markov Chains ◽  
State Space ◽  
Continuous Time ◽  
Two Dimensional ◽  
Partially Ordered ◽  
Continuous Time Markov Chains ◽  
Strong Stationary Duality ◽  
Birth And Death Chain ◽  
Algebraic Duality ◽  
Ordered State

Under the assumption of Möbius monotonicity, we develop the theory of strong stationary duality for continuous time Markov chains on the finite partially ordered state space, we also construct a nonexplosive algebraic duality for continuous time Markov chains on Finally, we present an application to the two-dimensional birth and death chain.

Monotone and associated Markov chains, with applications to reliability theory

1987 ◽  
Vol 24 (03) ◽  
pp. 679-695 ◽  
Author(s):  
Bo Henry Lindqvist
Keyword(s):  
Markov Chains ◽  
Continuous Time ◽  
Reliability Theory ◽  
State Spaces ◽  
Partially Ordered ◽  
Ordered State

We study monotone and associated Markov chains on finite partially ordered state spaces. Both discrete and continuous time, and both time-homogeneous and time-inhomogeneous chains are considered. The results are applied to binary and multistate reliability theory.

scholarly journals Two Approaches to the Construction of Perturbation Bounds for Continuous-Time Markov Chains

Mathematics ◽  
2020 ◽  
Vol 8 (2) ◽  
pp. 253 ◽  
Author(s):  
Alexander Zeifman ◽  
Victor Korolev ◽  
Yacov Satin
Keyword(s):  
Markov Chains ◽  
State Space ◽  
Continuous Time ◽  
Countable State Space ◽  
Perturbation Bounds ◽  
Queuing Models ◽  
Continuous Time Markov Chains ◽  
Quantitative Estimates ◽  
Countable State

This paper is largely a review. It considers two main methods used to study stability and to obtain appropriate quantitative estimates of perturbations of (inhomogeneous) Markov chains with continuous time and a finite or countable state space. An approach is described to the construction of perturbation estimates for the main five classes of such chains associated with queuing models. Several specific models are considered for which the limit characteristics and perturbation bounds for admissible “perturbed” processes are calculated.

Quasi-ergodicity for non-homogeneous continuous-time Markov chains

1989 ◽  
Vol 26 (3) ◽  
pp. 643-648 ◽  
Author(s):  
A. I. Zeifman
Keyword(s):  
Differential Equation ◽  
Markov Chain ◽  
Markov Chains ◽  
State Space ◽  
Continuous Time ◽  
Sufficient Conditions ◽  
Continuous Time Markov Chain ◽  
Countable State Space ◽  
Continuous Time Markov Chains ◽  
Countable State

We consider a non-homogeneous continuous-time Markov chain X(t) with countable state space. Definitions of uniform and strong quasi-ergodicity are introduced. The forward Kolmogorov system for X(t) is considered as a differential equation in the space of sequences l1. Sufficient conditions for uniform quasi-ergodicity are deduced from this equation. We consider conditions of uniform and strong ergodicity in the case of proportional intensities.

Stochastic domination and Markovian couplings

2000 ◽  
Vol 32 (4) ◽  
pp. 1064-1076 ◽  
Author(s):  
F. Javier López ◽  
Servet Martínez ◽  
Gerardo Sanz
Keyword(s):  
Markov Chains ◽  
Continuous Time ◽  
Partially Ordered Set ◽  
Ordered Set ◽  
Sufficient Conditions ◽  
Stochastic Domination ◽  
Jackson Networks ◽  
Partially Ordered ◽  
Continuous Time Markov Chains ◽  
Necessary And Sufficient

For continuous-time Markov chains with semigroups P, P' taking values in a partially ordered set, such that P ≤ stP', we show the existence of an order-preserving Markovian coupling and give a way to construct it. From our proof, we also obtain the conditions of Brandt and Last for stochastic domination in terms of the associated intensity matrices. Our result is applied to get necessary and sufficient conditions for the existence of Markovian couplings between two Jackson networks.

Markovian couplings staying in arbitrary subsets of the state space

2002 ◽  
Vol 39 (01) ◽  
pp. 197-212 ◽  
Author(s):  
F. Javier López ◽  
Gerardo Sanz
Keyword(s):  
Markov Chains ◽  
State Space ◽  
Continuous Time ◽  
Sufficient Conditions ◽  
Transition Rates ◽  
Arbitrary Subset ◽  
State Spaces ◽  
Continuous Time Markov Chains ◽  
Countable State ◽  
Necessary And Sufficient

Let (X t ) and (Y t ) be continuous-time Markov chains with countable state spaces E and F and let K be an arbitrary subset of E x F. We give necessary and sufficient conditions on the transition rates of (X t ) and (Y t ) for the existence of a coupling which stays in K. We also show that when such a coupling exists, it can be chosen to be Markovian and give a way to construct it. In the case E=F and K ⊆ E x E, we see how the problem of construction of the coupling can be simplified. We give some examples of use and application of our results, including a new concept of lumpability in Markov chains.

Monotone and associated Markov chains, with applications to reliability theory

1987 ◽  
Vol 24 (3) ◽  
pp. 679-695 ◽  
Author(s):  
Bo Henry Lindqvist
Keyword(s):  
Markov Chains ◽  
Continuous Time ◽  
Reliability Theory ◽  
State Spaces ◽  
Partially Ordered ◽  
Ordered State

We study monotone and associated Markov chains on finite partially ordered state spaces. Both discrete and continuous time, and both time-homogeneous and time-inhomogeneous chains are considered. The results are applied to binary and multistate reliability theory.

Sign in / Sign up

Export Citation Format

Share Document