scholarly journals Comparison of Cutoffs Between Lazy Walks and Markovian Semigroups

2013 ◽  
Vol 50 (4) ◽  
pp. 943-959 ◽  
Author(s):  
Guan-Yu Chen ◽  
Laurent Saloff-Coste
Keyword(s):  
Markov Chains ◽  
Total Variation ◽  
Discrete Time ◽  
Continuous Time ◽  
Transition Matrix ◽  
Mixing Time ◽  
Total Variation Distance ◽  
Variation Distance ◽  
Markovian Semigroups

We make a connection between the continuous time and lazy discrete time Markov chains through the comparison of cutoffs and mixing time in total variation distance. For illustration, we consider finite birth and death chains and provide a criterion on cutoffs using eigenvalues of the transition matrix.

scholarly journals Comparison of Cutoffs Between Lazy Walks and Markovian Semigroups

2013 ◽  
Vol 50 (04) ◽  
pp. 943-959 ◽  
Author(s):  
Guan-Yu Chen ◽  
Laurent Saloff-Coste
Keyword(s):  
Markov Chains ◽  
Total Variation ◽  
Discrete Time ◽  
Continuous Time ◽  
Transition Matrix ◽  
Mixing Time ◽  
Total Variation Distance ◽  
Variation Distance ◽  
Markovian Semigroups

We make a connection between the continuous time and lazy discrete time Markov chains through the comparison of cutoffs and mixing time in total variation distance. For illustration, we consider finite birth and death chains and provide a criterion on cutoffs using eigenvalues of the transition matrix.

scholarly journals Error Bounds for Augmented Truncations of Discrete-Time Block-Monotone Markov Chains under Geometric Drift Conditions

2015 ◽  
Vol 47 (1) ◽  
pp. 83-105 ◽  
Author(s):  
Hiroyuki Masuyama
Keyword(s):  
Markov Chain ◽  
Markov Chains ◽  
Total Variation ◽  
Discrete Time ◽  
Error Bounds ◽  
Total Variation Distance ◽  
Time Block ◽  
Stationary Distributions ◽  
Variation Distance ◽  
Drift Conditions

In this paper we study the augmented truncation of discrete-time block-monotone Markov chains under geometric drift conditions. We first present a bound for the total variation distance between the stationary distributions of an original Markov chain and its augmented truncation. We also obtain such error bounds for more general cases, where an original Markov chain itself is not necessarily block monotone but is blockwise dominated by a block-monotone Markov chain. Finally, we discuss the application of our results to GI/G/1-type Markov chains.

scholarly journals Error Bounds for Augmented Truncations of Discrete-Time Block-Monotone Markov Chains under Geometric Drift Conditions

2015 ◽  
Vol 47 (01) ◽  
pp. 83-105 ◽  
Author(s):  
Hiroyuki Masuyama
Keyword(s):  
Markov Chain ◽  
Markov Chains ◽  
Total Variation ◽  
Discrete Time ◽  
Error Bounds ◽  
Total Variation Distance ◽  
Time Block ◽  
Stationary Distributions ◽  
Variation Distance ◽  
Drift Conditions

In this paper we study the augmented truncation of discrete-time block-monotone Markov chains under geometric drift conditions. We first present a bound for the total variation distance between the stationary distributions of an original Markov chain and its augmented truncation. We also obtain such error bounds for more general cases, where an original Markov chain itself is not necessarily block monotone but is blockwise dominated by a block-monotone Markov chain. Finally, we discuss the application of our results to GI/G/1-type Markov chains.

A unified stability theory for classical and monotone Markov chains

2019 ◽  
Vol 56 (01) ◽  
pp. 1-22
Author(s):  
Takashi Kamihigashi ◽  
John Stachurski
Keyword(s):  
Markov Chains ◽  
Total Variation ◽  
Stochastic Dominance ◽  
Stability Theory ◽  
Total Variation Distance ◽  
Probability Measures ◽  
General State ◽  
Partially Ordered ◽  
Variation Distance ◽  
Borel Probability

AbstractIn this paper we integrate two strands of the literature on stability of general state Markov chains: conventional, total-variation-based results and more recent order-theoretic results. First we introduce a complete metric over Borel probability measures based on ‘partial’ stochastic dominance. We then show that many conventional results framed in the setting of total variation distance have natural generalizations to the partially ordered setting when this metric is adopted.

Sign in / Sign up

Export Citation Format

Share Document