On Computing the Stationary Probability Vector of a Network of Two Coxian Servers

1982 ◽  
pp. 275-296 ◽  
Author(s):  
William J. Stewart
Keyword(s):  
Stationary Probability ◽  
Probability Vector ◽  
Stationary Probability Vector

scholarly journals Heavy-tailed asymptotics of stationary probability vectors of Markov chains of gi/g/1 type

2005 ◽  
Vol 37 (02) ◽  
pp. 482-509 ◽  
Author(s):  
Quan-Lin Li ◽  
Yiqiang Q. Zhao
Keyword(s):  
Transition Matrix ◽  
Stationary Probability ◽  
Probability Vector ◽  
Necessary And Sufficient Condition ◽  
Hopf Equation ◽  
Novel Approach ◽  
Matrix Sequence ◽  
Heavy Tailed ◽  
Necessary And Sufficient ◽  
Stationary Probability Vector

In this paper, we provide a novel approach to studying the heavy-tailed asymptotics of the stationary probability vector of a Markov chain of GI/G/1 type, whose transition matrix is constructed from two matrix sequences referred to as a boundary matrix sequence and a repeating matrix sequence, respectively. We first provide a necessary and sufficient condition under which the stationary probability vector is heavy tailed. Then we derive the long-tailed asymptotics of the R-measure in terms of the RG-factorization of the repeating matrix sequence, and a Wiener-Hopf equation for the boundary matrix sequence. Based on this, we are able to provide a detailed analysis of the subexponential asymptotics of the stationary probability vector.

scholarly journals The Extrapolation-Accelerated Multilevel Aggregation Method in PageRank Computation

2013 ◽  
Vol 2013 ◽  
pp. 1-8 ◽  
Author(s):  
Bing-Yuan Pu ◽  
Ting-Zhu Huang ◽  
Chun Wen ◽  
Yi-Qin Lin
Keyword(s):  
Stochastic Matrix ◽  
Numerical Results ◽  
Extrapolation Method ◽  
Stationary Probability ◽  
Probability Vector ◽  
Aggregation Method ◽  
Vector Extrapolation ◽  
Stationary Probability Vector

An accelerated multilevel aggregation method is presented for calculating the stationary probability vector of an irreducible stochastic matrix in PageRank computation, where the vector extrapolation method is its accelerator. We show how to periodically combine the extrapolation method together with the multilevel aggregation method on the finest level for speeding up the PageRank computation. Detailed numerical results are given to illustrate the behavior of this method, and comparisons with the typical methods are also made.

scholarly journals Light-tailed asymptotics of stationary probability vectors of Markov chains of GI/G/1 type

2005 ◽  
Vol 37 (04) ◽  
pp. 1075-1093 ◽  
Author(s):  
Quan-Lin Li ◽  
Yiqiang Q. Zhao
Keyword(s):  
Asymptotic Behavior ◽  
Markov Chain ◽  
Markov Chains ◽  
Asymptotic Analysis ◽  
Positive Solution ◽  
Generating Function ◽  
Spectral Properties ◽  
Stationary Probability ◽  
Probability Vector ◽  
Stationary Probability Vector

In this paper, we consider the asymptotic behavior of stationary probability vectors of Markov chains of GI/G/1 type. The generating function of the stationary probability vector is explicitly expressed by theR-measure. This expression of the generating function is more convenient for the asymptotic analysis than those in the literature. TheRG-factorization of both the repeating row and the Wiener-Hopf equations for the boundary row are used to provide necessary spectral properties. The stationary probability vector of a Markov chain of GI/G/1 type is shown to be light tailed if the blocks of the repeating row and the blocks of the boundary row are light tailed. We derive two classes of explicit expression for the asymptotic behavior, the geometric tail, and the semigeometric tail, based on the repeating row, the boundary row, or the minimal positive solution of a crucial equation involved in the generating function, and discuss the singularity classes of the stationary probability vector.

Geometric bounds on iterative approximations for nearly completely decomposable Markov chains

1990 ◽  
Vol 27 (03) ◽  
pp. 521-529 ◽  
Author(s):  
Guy Louchard ◽  
Guy Latouche
Keyword(s):  
Markov Chain ◽  
Markov Chains ◽  
Perturbation Analysis ◽  
Stochastic Matrix ◽  
Stationary Probability ◽  
Probability Vector ◽  
Finite Markov Chain ◽  
Stationary Probability Vector

We consider a finite Markov chain with nearly-completely decomposable stochastic matrix. We determine bounds for the error, when the stationary probability vector is approximated via a perturbation analysis.

Steady State Analysis of Impulse Customers and Cancellation Policy in Queueing-Inventory System

Processes ◽  
2021 ◽  
Vol 9 (12) ◽  
pp. 2146
Author(s):  
V. Vinitha ◽  
N. Anbazhagan ◽  
S. Amutha ◽  
K. Jeganathan ◽  
Gyanendra Prasad Joshi ◽  
...  
Keyword(s):  
Steady State ◽  
Lead Time ◽  
Arrival Process ◽  
Inventory Level ◽  
Stationary Probability ◽  
Probability Vector ◽  
Steady State Analysis ◽  
Proposed Model ◽  
Stationary Probability Vector ◽  
Bernoulli Schedule

This article discusses the queueing-inventory model with a cancellation policy and two classes of customers. The two classes of customers are named ordinary and impulse customers. A customer who does not plan to buy the product when entering the system is called an impulse customer. Suppose the customer enters into the system to buy the product with a plan is called ordinary customer. The system consists of a pool of finite waiting areas of size N and maximum S items in the inventory. The ordinary customer can move to the pooled place if they find that the inventory is empty under the Bernoulli schedule. In such a situation, impulse customers are not allowed to enter into the pooled place. Additionally, the pooled customers buy the product whenever they find positive inventory. If the inventory level falls to s, the replenishment of Q items is to be replaced immediately under the (s, Q) ordering principle. Both arrival streams occur according to the independent Markovian arrival process (MAP), and lead time follows an exponential distribution. In addition, the system allows the cancellation of the purchased item only when there exist fewer than S items in the inventory. Here, the time between two successive cancellations of the purchased item is assumed to be exponentially distributed. The Gaver algorithm is used to obtain the stationary probability vector of the system in the steady-state. Further, the necessary numerical interpretations are investigated to enhance the proposed model.

Stationary Probability Vectors of Higher-Order Two-Dimensional Symmetric Transition Probability Tensors

2020 ◽  
Vol 37 (04) ◽  
pp. 2040019
Author(s):  
Zheng-Hai Huang ◽  
Liqun Qi
Keyword(s):  
Transition Probability ◽  
Higher Order ◽  
Stationary Probability ◽  
Two Dimensional ◽  
Probability Vector ◽  
Dimension 2 ◽  
Stationary Probability Vector

In this paper, we investigate stationary probability vectors of higher-order two-dimensional symmetric transition probability tensors. We show that there are two special symmetric transition probability tensors of order [Formula: see text] dimension 2, which have and only have two stationary probability vectors; and any other symmetric transition probability tensor of order [Formula: see text] dimension 2 has a unique stationary probability vector. As a byproduct, we obtain that any symmetric transition probability tensor of order [Formula: see text] dimension 2 has a unique positive stationary probability vector, and that any symmetric irreducible transition probability tensor of order [Formula: see text] dimension 2 has a unique stationary probability vector.

scholarly journals Light-tailed asymptotics of stationary probability vectors of Markov chains of GI/G/1 type

2005 ◽  
Vol 37 (4) ◽  
pp. 1075-1093 ◽  
Author(s):  
Quan-Lin Li ◽  
Yiqiang Q. Zhao
Keyword(s):  
Asymptotic Behavior ◽  
Markov Chain ◽  
Markov Chains ◽  
Asymptotic Analysis ◽  
Positive Solution ◽  
Generating Function ◽  
Spectral Properties ◽  
Stationary Probability ◽  
Probability Vector ◽  
Stationary Probability Vector

In this paper, we consider the asymptotic behavior of stationary probability vectors of Markov chains of GI/G/1 type. The generating function of the stationary probability vector is explicitly expressed by the R-measure. This expression of the generating function is more convenient for the asymptotic analysis than those in the literature. The RG-factorization of both the repeating row and the Wiener-Hopf equations for the boundary row are used to provide necessary spectral properties. The stationary probability vector of a Markov chain of GI/G/1 type is shown to be light tailed if the blocks of the repeating row and the blocks of the boundary row are light tailed. We derive two classes of explicit expression for the asymptotic behavior, the geometric tail, and the semigeometric tail, based on the repeating row, the boundary row, or the minimal positive solution of a crucial equation involved in the generating function, and discuss the singularity classes of the stationary probability vector.

The caudal characteristic curve of queues

1984 ◽  
Vol 16 (1) ◽  
pp. 7-7 ◽  
Author(s):  
Marcel F. Neuts
Keyword(s):  
Steady State ◽  
Stochastic Models ◽  
Queue Length ◽  
Characteristic Curve ◽  
Stationary Probability ◽  
Traffic Intensity ◽  
Probability Vector ◽  
Asymptotic Rate ◽  
Many Queues ◽  
Stationary Probability Vector

Many queues and related stochastic models, and in particular those that have a matrix-geometric stationary probability vector, have steady-state queue-length densities that are asymptotically geometric. The graph of the asymptotic rate η of these densities as a function of the traffic intensity ρ is the caudal characteristic curve. This is an informative graph from which a number of qualitative inferences about the behavior of the queue may be drawn.

Sign in / Sign up

Export Citation Format

Share Document