Convergence of a transition probability tensor of a higher-order Markov chain to the stationary probability vector

2016 ◽  
Vol 23 (6) ◽  
pp. 972-988 ◽  
Author(s):  
Hassan Bozorgmanesh ◽  
Masoud Hajarian
Keyword(s):  
Markov Chain ◽  
Transition Probability ◽  
Higher Order ◽  
Stationary Probability ◽  
Probability Vector ◽  
Order Markov Chain ◽  
Higher Order Markov Chain ◽  
Stationary Probability Vector

Stationary Probability Vectors of Higher-Order Two-Dimensional Symmetric Transition Probability Tensors

2020 ◽  
Vol 37 (04) ◽  
pp. 2040019
Author(s):  
Zheng-Hai Huang ◽  
Liqun Qi
Keyword(s):  
Transition Probability ◽  
Higher Order ◽  
Stationary Probability ◽  
Two Dimensional ◽  
Probability Vector ◽  
Dimension 2 ◽  
Stationary Probability Vector

In this paper, we investigate stationary probability vectors of higher-order two-dimensional symmetric transition probability tensors. We show that there are two special symmetric transition probability tensors of order [Formula: see text] dimension 2, which have and only have two stationary probability vectors; and any other symmetric transition probability tensor of order [Formula: see text] dimension 2 has a unique stationary probability vector. As a byproduct, we obtain that any symmetric transition probability tensor of order [Formula: see text] dimension 2 has a unique positive stationary probability vector, and that any symmetric irreducible transition probability tensor of order [Formula: see text] dimension 2 has a unique stationary probability vector.

Higher-order Markov chain models for categorical data sequences

2004 ◽  
Vol 51 (4) ◽  
pp. 557-574 ◽  
Author(s):  
Wai Ki Ching ◽  
Eric S. Fung ◽  
Michael K. Ng
Keyword(s):  
Markov Chain ◽  
Categorical Data ◽  
Higher Order ◽  
Markov Chain Models ◽  
Order Markov Chain ◽  
Higher Order Markov Chain

scholarly journals Light-tailed asymptotics of stationary probability vectors of Markov chains of GI/G/1 type

2005 ◽  
Vol 37 (04) ◽  
pp. 1075-1093 ◽  
Author(s):  
Quan-Lin Li ◽  
Yiqiang Q. Zhao
Keyword(s):  
Asymptotic Behavior ◽  
Markov Chain ◽  
Markov Chains ◽  
Asymptotic Analysis ◽  
Positive Solution ◽  
Generating Function ◽  
Spectral Properties ◽  
Stationary Probability ◽  
Probability Vector ◽  
Stationary Probability Vector

In this paper, we consider the asymptotic behavior of stationary probability vectors of Markov chains of GI/G/1 type. The generating function of the stationary probability vector is explicitly expressed by theR-measure. This expression of the generating function is more convenient for the asymptotic analysis than those in the literature. TheRG-factorization of both the repeating row and the Wiener-Hopf equations for the boundary row are used to provide necessary spectral properties. The stationary probability vector of a Markov chain of GI/G/1 type is shown to be light tailed if the blocks of the repeating row and the blocks of the boundary row are light tailed. We derive two classes of explicit expression for the asymptotic behavior, the geometric tail, and the semigeometric tail, based on the repeating row, the boundary row, or the minimal positive solution of a crucial equation involved in the generating function, and discuss the singularity classes of the stationary probability vector.

Geometric bounds on iterative approximations for nearly completely decomposable Markov chains

1990 ◽  
Vol 27 (03) ◽  
pp. 521-529 ◽  
Author(s):  
Guy Louchard ◽  
Guy Latouche
Keyword(s):  
Markov Chain ◽  
Markov Chains ◽  
Perturbation Analysis ◽  
Stochastic Matrix ◽  
Stationary Probability ◽  
Probability Vector ◽  
Finite Markov Chain ◽  
Stationary Probability Vector

We consider a finite Markov chain with nearly-completely decomposable stochastic matrix. We determine bounds for the error, when the stationary probability vector is approximated via a perturbation analysis.

scholarly journals Light-tailed asymptotics of stationary probability vectors of Markov chains of GI/G/1 type

2005 ◽  
Vol 37 (4) ◽  
pp. 1075-1093 ◽  
Author(s):  
Quan-Lin Li ◽  
Yiqiang Q. Zhao
Keyword(s):  
Asymptotic Behavior ◽  
Markov Chain ◽  
Markov Chains ◽  
Asymptotic Analysis ◽  
Positive Solution ◽  
Generating Function ◽  
Spectral Properties ◽  
Stationary Probability ◽  
Probability Vector ◽  
Stationary Probability Vector

In this paper, we consider the asymptotic behavior of stationary probability vectors of Markov chains of GI/G/1 type. The generating function of the stationary probability vector is explicitly expressed by the R-measure. This expression of the generating function is more convenient for the asymptotic analysis than those in the literature. The RG-factorization of both the repeating row and the Wiener-Hopf equations for the boundary row are used to provide necessary spectral properties. The stationary probability vector of a Markov chain of GI/G/1 type is shown to be light tailed if the blocks of the repeating row and the blocks of the boundary row are light tailed. We derive two classes of explicit expression for the asymptotic behavior, the geometric tail, and the semigeometric tail, based on the repeating row, the boundary row, or the minimal positive solution of a crucial equation involved in the generating function, and discuss the singularity classes of the stationary probability vector.

Geometric bounds on iterative approximations for nearly completely decomposable Markov chains

1990 ◽  
Vol 27 (3) ◽  
pp. 521-529 ◽  
Author(s):  
Guy Louchard ◽  
Guy Latouche
Keyword(s):  
Markov Chain ◽  
Markov Chains ◽  
Perturbation Analysis ◽  
Stochastic Matrix ◽  
Stationary Probability ◽  
Probability Vector ◽  
Finite Markov Chain ◽  
Stationary Probability Vector

We consider a finite Markov chain with nearly-completely decomposable stochastic matrix. We determine bounds for the error, when the stationary probability vector is approximated via a perturbation analysis.

Sign in / Sign up

Export Citation Format

Share Document