scholarly journals Hitting times of Markov chains, with application to state-dependent queues

1977 ◽  
Vol 17 (1) ◽  
pp. 97-107 ◽  
Author(s):  
R.L. Tweedie
Keyword(s):  
Markov Chain ◽  
Waiting Time ◽  
Busy Period ◽  
Hitting Times ◽  
Arrival Process ◽  
General State ◽  
State Dependent ◽  
General State Space ◽  
The Mean ◽  
Number Of Customers

We present in this note a useful extension of the criteria given in a recent paper [Advances in Appl. Probability 8 (1976), 737–771] for the finiteness of hitting times and mean hitting times of a Markov chain on sets in its (general) state space. We illustrate our results by giving conditions for the finiteness of the mean number of customers in the busy period of a queue in which both the service-times and the arrival process may depend on the waiting time in the queue. Such conditions also suffice for the embedded waiting time chain to have a unique stationary distribution.

A new informative embedded Markov renewal process for the PH/G/1 queue

1986 ◽  
Vol 18 (02) ◽  
pp. 533-557 ◽  
Author(s):  
Marcel F. Neuts
Keyword(s):  
Markov Chain ◽  
Statistical Analysis ◽  
Queue Length ◽  
Busy Period ◽  
Waiting Times ◽  
Arrival Process ◽  
Embedded Markov Chain ◽  
Markov Renewal Process ◽  
The Mean ◽  
Busy Cycle

We consider a new embedded Markov chain for the PH/G/1 queue by recording the queue length, the phase of the arrival process and the number of services completed during the current busy period at the successive departure epochs. Algorithmically tractable matrix formulas are obtained which permit the analysis of the fluctuations of the queue length and waiting times during a typical busy cycle. These are useful in the computation of certain profile curves arising in the statistical analysis of queues. In addition, informative expressions for the mean waiting times in the stable GI/G/1 queue and a simple new algorithm to evaluate the waiting-time distributions for the stationary PH/PH/1 queue are obtained.

Analysis of State Dependent Vacation Queues with Threshold Gated Service Policy

2010 ◽  
Vol 1 (2) ◽  
pp. 32-49 ◽  
Author(s):  
Yew Sing
Keyword(s):  
Performance Measures ◽  
Cycle Time ◽  
Busy Period ◽  
Simple Approach ◽  
Second Moment ◽  
State Dependent ◽  
The Mean ◽  
Service Policy ◽  
Set Up ◽  
Number Of Customers

In this article, the authors introduce a simple approach for modeling and analyzing a queue where the server may take repeated vacations. When a busy period ends, the server takes a vacation of random duration. At the end of each vacation, the server may either start a new vacation or resume service. If a queue is found of less than customers, the server will always take a new vacation. If there are at least customers in queue, the server provides services to those customers after a brief set-up time. The authors obtain several performance measures of the system, including the mean and second moment of the cycle time, the number of customers in a cycle of service, and the expected delay experienced by a customer.

Analysis of State Dependent Vacation Queues with Threshold Gated Service Policy

2012 ◽  
pp. 274-291
Author(s):  
Yew Sing
Keyword(s):  
Performance Measures ◽  
Cycle Time ◽  
Busy Period ◽  
Simple Approach ◽  
Second Moment ◽  
State Dependent ◽  
The Mean ◽  
Service Policy ◽  
Set Up ◽  
Number Of Customers

In this article, the authors introduce a simple approach for modeling and analyzing a queue where the server may take repeated vacations. When a busy period ends, the server takes a vacation of random duration. At the end of each vacation, the server may either start a new vacation or resume service. If a queue is found of less than customers, the server will always take a new vacation. If there are at least customers in queue, the server provides services to those customers after a brief set-up time. The authors obtain several performance measures of the system, including the mean and second moment of the cycle time, the number of customers in a cycle of service, and the expected delay experienced by a customer.

scholarly journals Analysis of MAP/PH(1), PH(2)/2 Queue with Bernoulli Vacations

2008 ◽  
Vol 2008 ◽  
pp. 1-20 ◽  
Author(s):  
B. Krishna Kumar ◽  
R. Rukmani ◽  
V. Thangaraj
Keyword(s):  
Waiting Time ◽  
Time Distribution ◽  
Queueing System ◽  
Arrival Process ◽  
Waiting Time Distribution ◽  
Steady State Probability ◽  
Matrix Geometric Method ◽  
Mean Waiting Time ◽  
The Mean ◽  
Number Of Customers

We consider a two-heterogeneous-server queueing system with Bernoulli vacation in which customers arrive according to a Markovian arrival process (MAP). Servers returning from vacation immediately take another vacation if no customer is waiting. Using matrix-geometric method, the steady-state probability of the number of customers in the system is investigated. Some important performance measures are obtained. The waiting time distribution and the mean waiting time are also discussed. Finally, some numerical illustrations are provided.

A new informative embedded Markov renewal process for the PH/G/1 queue

1986 ◽  
Vol 18 (2) ◽  
pp. 533-557 ◽  
Author(s):  
Marcel F. Neuts
Keyword(s):  
Markov Chain ◽  
Statistical Analysis ◽  
Queue Length ◽  
Busy Period ◽  
Waiting Times ◽  
Arrival Process ◽  
Embedded Markov Chain ◽  
Markov Renewal Process ◽  
The Mean ◽  
Busy Cycle

We consider a new embedded Markov chain for the PH/G/1 queue by recording the queue length, the phase of the arrival process and the number of services completed during the current busy period at the successive departure epochs. Algorithmically tractable matrix formulas are obtained which permit the analysis of the fluctuations of the queue length and waiting times during a typical busy cycle. These are useful in the computation of certain profile curves arising in the statistical analysis of queues. In addition, informative expressions for the mean waiting times in the stable GI/G/1 queue and a simple new algorithm to evaluate the waiting-time distributions for the stationary PH/PH/1 queue are obtained.

The busy period of the E k/G/1 queue by finite waiting room

1975 ◽  
Vol 7 (02) ◽  
pp. 416-430
Author(s):  
A. L. Truslove
Keyword(s):  
Markov Chain ◽  
Busy Period ◽  
Waiting Room ◽  
Queueing Process ◽  
Number Of Customers

For the E k /G/1 queue with finite waiting room the phase technique is used to analyse the Markov chain imbedded in the queueing process at successive instants at which customers complete service, and the distribution of the busy period, together with the number of customers who arrive, and the number of customers served, during that period, is obtained. The limit as the size of the waiting room becomes infinite is found.

Criteria for classifying general Markov chains

1976 ◽  
Vol 8 (04) ◽  
pp. 737-771 ◽  
Author(s):  
R. L. Tweedie
Keyword(s):  
Markov Chain ◽  
Markov Chains ◽  
State Space ◽  
The State ◽  
General State ◽  
Classical Work ◽  
The Status ◽  
General State Space

The aim of this paper is to present a comprehensive set of criteria for classifying as recurrent, transient, null or positive the sets visited by a general state space Markov chain. When the chain is irreducible in some sense, these then provide criteria for classifying the chain itself, provided the sets considered actually reflect the status of the chain as a whole. The first part of the paper is concerned with the connections between various definitions of recurrence, transience, nullity and positivity for sets and for irreducible chains; here we also elaborate the idea of status sets for irreducible chains. In the second part we give our criteria for classifying sets. When the state space is countable, our results for recurrence, transience and positivity reduce to the classical work of Foster (1953); for continuous-valued chains they extend results of Lamperti (1960), (1963); for general spaces the positivity and recurrence criteria strengthen those of Tweedie (1975b).

scholarly journals Bounds on the rate of convergence for one class of inhomogeneous Markovian queueing models with possible batch arrivals and services

2018 ◽  
Vol 28 (1) ◽  
pp. 141-154 ◽  
Author(s):  
Alexander Zeifman ◽  
Rostislav Razumchik ◽  
Yacov Satin ◽  
Ksenia Kiseleva ◽  
Anna Korotysheva ◽  
...  
Keyword(s):  
Rate Of Convergence ◽  
Queueing Systems ◽  
Approximation Error ◽  
Linear Operators ◽  
Upper And Lower Bounds ◽  
Logarithmic Norm ◽  
Batch Arrivals ◽  
State Dependent ◽  
The Mean ◽  
Number Of Customers

AbstractIn this paper we present a method for the computation of convergence bounds for four classes of multiserver queueing systems, described by inhomogeneous Markov chains. Specifically, we consider an inhomogeneous M/M/S queueing system with possible state-dependent arrival and service intensities, and additionally possible batch arrivals and batch service. A unified approach based on a logarithmic norm of linear operators for obtaining sharp upper and lower bounds on the rate of convergence and corresponding sharp perturbation bounds is described. As a side effect, we show, by virtue of numerical examples, that the approach based on a logarithmic norm can also be used to approximate limiting characteristics (the idle probability and the mean number of customers in the system) of the systems considered with a given approximation error.

The robustness of positive recurrence and recurrence of Markov chains under perturbations of the transition probabilities

1975 ◽  
Vol 12 (04) ◽  
pp. 744-752 ◽  
Author(s):  
Richard L. Tweedie
Keyword(s):  
Markov Chain ◽  
Markov Chains ◽  
Finite Number ◽  
Transition Probabilities ◽  
General State ◽  
Transition Matrices ◽  
Positive Recurrence ◽  
Markov Chain Models ◽  
Countable Space ◽  
General State Space

In many Markov chain models, the immediate characteristic of importance is the positive recurrence of the chain. In this note we investigate whether positivity, and also recurrence, are robust properties of Markov chains when the transition laws are perturbed. The chains we consider are on a fairly general state space : when specialised to a countable space, our results are essentially that, if the transition matrices of two irreducible chains coincide on all but a finite number of columns, then positivity of one implies positivity of both; whilst if they coincide on all but a finite number of rows and columns, recurrence of one implies recurrence of both. Examples are given to show that these results (and their general analogues) cannot in general be strengthened.

scholarly journals Processor-sharing and random-service queues with semi-Markovian arrivals

2005 ◽  
Vol 42 (02) ◽  
pp. 478-490
Author(s):  
De-An Wu ◽  
Hideaki Takagi
Keyword(s):  
Waiting Time ◽  
Sojourn Time ◽  
Time Distribution ◽  
Arrival Process ◽  
Interarrival Time ◽  
Size Distributions ◽  
Processor Sharing ◽  
Queue Size ◽  
Mean Waiting Time ◽  
The Mean

We consider single-server queues with exponentially distributed service times, in which the arrival process is governed by a semi-Markov process (SMP). Two service disciplines, processor sharing (PS) and random service (RS), are investigated. We note that the sojourn time distribution of a type-lcustomer who, upon his arrival, meetskcustomers already present in the SMP/M/1/PS queue is identical to the waiting time distribution of a type-lcustomer who, upon his arrival, meetsk+1 customers already present in the SMP/M/1/RS queue. Two sets of system equations, one for the joint transform of the sojourn time and queue size distributions in the SMP/M/1/PS queue, and the other for the joint transform of the waiting time and queue size distributions in the SMP/M/1/RS queue, are derived. Using these equations, the mean sojourn time in the SMP/M/1/PS queue and the mean waiting time in the SMP/M/1/RS queue are obtained. We also consider a special case of the SMP in which the interarrival time distribution is determined only by the type of the customer who has most recently arrived. Numerical examples are also presented.

Sign in / Sign up

Export Citation Format

Share Document