Optimal stochastic control of discrete-time systems subject to total variation distance uncertainty

2010 ◽  
Author(s):  
Charalambos D. Charalambous ◽  
Farzad Rezaei ◽  
Ioannis Tzortzis
Keyword(s):  
Total Variation ◽  
Stochastic Control ◽  
Discrete Time ◽  
Optimal Stochastic Control ◽  
Total Variation Distance ◽  
Discrete Time Systems ◽  
Variation Distance ◽  
Time Systems

scholarly journals Error Bounds for Augmented Truncations of Discrete-Time Block-Monotone Markov Chains under Geometric Drift Conditions

2015 ◽  
Vol 47 (1) ◽  
pp. 83-105 ◽  
Author(s):  
Hiroyuki Masuyama
Keyword(s):  
Markov Chain ◽  
Markov Chains ◽  
Total Variation ◽  
Discrete Time ◽  
Error Bounds ◽  
Total Variation Distance ◽  
Time Block ◽  
Stationary Distributions ◽  
Variation Distance ◽  
Drift Conditions

In this paper we study the augmented truncation of discrete-time block-monotone Markov chains under geometric drift conditions. We first present a bound for the total variation distance between the stationary distributions of an original Markov chain and its augmented truncation. We also obtain such error bounds for more general cases, where an original Markov chain itself is not necessarily block monotone but is blockwise dominated by a block-monotone Markov chain. Finally, we discuss the application of our results to GI/G/1-type Markov chains.

scholarly journals Comparison of Cutoffs Between Lazy Walks and Markovian Semigroups

2013 ◽  
Vol 50 (4) ◽  
pp. 943-959 ◽  
Author(s):  
Guan-Yu Chen ◽  
Laurent Saloff-Coste
Keyword(s):  
Markov Chains ◽  
Total Variation ◽  
Discrete Time ◽  
Continuous Time ◽  
Transition Matrix ◽  
Mixing Time ◽  
Total Variation Distance ◽  
Variation Distance ◽  
Markovian Semigroups

We make a connection between the continuous time and lazy discrete time Markov chains through the comparison of cutoffs and mixing time in total variation distance. For illustration, we consider finite birth and death chains and provide a criterion on cutoffs using eigenvalues of the transition matrix.

scholarly journals Error Bounds for Augmented Truncations of Discrete-Time Block-Monotone Markov Chains under Geometric Drift Conditions

2015 ◽  
Vol 47 (01) ◽  
pp. 83-105 ◽  
Author(s):  
Hiroyuki Masuyama
Keyword(s):  
Markov Chain ◽  
Markov Chains ◽  
Total Variation ◽  
Discrete Time ◽  
Error Bounds ◽  
Total Variation Distance ◽  
Time Block ◽  
Stationary Distributions ◽  
Variation Distance ◽  
Drift Conditions

In this paper we study the augmented truncation of discrete-time block-monotone Markov chains under geometric drift conditions. We first present a bound for the total variation distance between the stationary distributions of an original Markov chain and its augmented truncation. We also obtain such error bounds for more general cases, where an original Markov chain itself is not necessarily block monotone but is blockwise dominated by a block-monotone Markov chain. Finally, we discuss the application of our results to GI/G/1-type Markov chains.

scholarly journals Bounds in Total Variation Distance for Discrete-time Processes on the Sequence Space

2018 ◽  
Vol 52 (2) ◽  
pp. 223-243
Author(s):  
Ian Flint ◽  
Nicolas Privault ◽  
Giovanni Luca Torrisi
Keyword(s):  
Total Variation ◽  
Discrete Time ◽  
Sequence Space ◽  
Total Variation Distance ◽  
Variation Distance

scholarly journals Comparison of Cutoffs Between Lazy Walks and Markovian Semigroups

2013 ◽  
Vol 50 (04) ◽  
pp. 943-959 ◽  
Author(s):  
Guan-Yu Chen ◽  
Laurent Saloff-Coste
Keyword(s):  
Markov Chains ◽  
Total Variation ◽  
Discrete Time ◽  
Continuous Time ◽  
Transition Matrix ◽  
Mixing Time ◽  
Total Variation Distance ◽  
Variation Distance ◽  
Markovian Semigroups

We make a connection between the continuous time and lazy discrete time Markov chains through the comparison of cutoffs and mixing time in total variation distance. For illustration, we consider finite birth and death chains and provide a criterion on cutoffs using eigenvalues of the transition matrix.

Sign in / Sign up

Export Citation Format

Share Document