A martingale approach to the slow server problem

1991 ◽  
Vol 28 (2) ◽  
pp. 480-486 ◽  
Author(s):  
Richard H. Stockbridge

A Markov queueing system having heterogeneous servers under a long-run average criterion is analyzed. A direct proof of the optimality of a stationary, Markov policy is given using martingale methods. Simultaneously, the problem is reduced to a linear programming problem. Analysis of the LP for a system having finite queueing length shows the optimal policy is not always of threshold type.

1991 ◽  
Vol 28 (02) ◽  
pp. 480-486 ◽  
Author(s):  
Richard H. Stockbridge

A Markov queueing system having heterogeneous servers under a long-run average criterion is analyzed. A direct proof of the optimality of a stationary, Markov policy is given using martingale methods. Simultaneously, the problem is reduced to a linear programming problem. Analysis of the LP for a system having finite queueing length shows the optimal policy is not always of threshold type.


1990 ◽  
Vol 27 (03) ◽  
pp. 693-700 ◽  
Author(s):  
Matthew J. Sobel

Assigning each arriving customer to the fastest idle server is shown to maximize throughput (equivalently, minimize blocking probability) in a queueing model with Poisson arrivals, heterogeneous exponential servers, and no waiting room. If a cost structure is imposed on this model, under specified conditions the same policy minimizes the expected discounted cost and the long-run average cost per unit time.


1990 ◽  
Vol 27 (3) ◽  
pp. 693-700 ◽  
Author(s):  
Matthew J. Sobel

Assigning each arriving customer to the fastest idle server is shown to maximize throughput (equivalently, minimize blocking probability) in a queueing model with Poisson arrivals, heterogeneous exponential servers, and no waiting room. If a cost structure is imposed on this model, under specified conditions the same policy minimizes the expected discounted cost and the long-run average cost per unit time.


2015 ◽  
Vol 52 (02) ◽  
pp. 473-489
Author(s):  
Yonit Barron

We consider a production-inventory model operating in a stochastic environment that is modulated by a finite state continuous-time Markov chain. When the inventory level reaches zero, an order is placed from an external supplier. The costs (purchasing and holding costs) are modulated by the state at the order epoch time. Applying a matrix analytic approach, fluid flow techniques, and martingales, we develop methods to obtain explicit equations for these cost functionals in the discounted case and under the long-run average criterion. Finally, we extend the model to allow backlogging.


2018 ◽  
Vol 6 (1) ◽  
pp. 69-84
Author(s):  
Jia Xu ◽  
Liwei Liu ◽  
Taozeng Zhu

AbstractWe consider anM/M/2 queueing system with two-heterogeneous servers and multiple vacations. Customers arrive according to a Poisson process. However, customers become impatient when the system is on vacation. We obtain explicit expressions for the time dependent probabilities, mean and variance of the system size at timetby employing probability generating functions, continued fractions and properties of the modified Bessel functions. Finally, two special cases are provided.


2019 ◽  
Vol 1333 ◽  
pp. 032039
Author(s):  
L I Korolkova ◽  
N Mashrabov ◽  
A M Murzin ◽  
A V Panfilov ◽  
Ju L Siuskina

2015 ◽  
Vol 52 (02) ◽  
pp. 473-489 ◽  
Author(s):  
Yonit Barron

We consider a production-inventory model operating in a stochastic environment that is modulated by a finite state continuous-time Markov chain. When the inventory level reaches zero, an order is placed from an external supplier. The costs (purchasing and holding costs) are modulated by the state at the order epoch time. Applying a matrix analytic approach, fluid flow techniques, and martingales, we develop methods to obtain explicit equations for these cost functionals in the discounted case and under the long-run average criterion. Finally, we extend the model to allow backlogging.


2002 ◽  
Vol 39 (01) ◽  
pp. 20-37 ◽  
Author(s):  
Mark E. Lewis ◽  
Hayriye Ayhan ◽  
Robert D. Foley

We consider a finite-capacity queueing system where arriving customers offer rewards which are paid upon acceptance into the system. The gatekeeper, whose objective is to ‘maximize’ rewards, decides if the reward offered is sufficient to accept or reject the arriving customer. Suppose the arrival rates, service rates, and system capacity are changing over time in a known manner. We show that all bias optimal (a refinement of long-run average reward optimal) policies are of threshold form. Furthermore, we give sufficient conditions for the bias optimal policy to be monotonic in time. We show, via a counterexample, that if these conditions are violated, the optimal policy may not be monotonic in time or of threshold form.


2015 ◽  
Vol 52 (2) ◽  
pp. 473-489 ◽  
Author(s):  
Yonit Barron

We consider a production-inventory model operating in a stochastic environment that is modulated by a finite state continuous-time Markov chain. When the inventory level reaches zero, an order is placed from an external supplier. The costs (purchasing and holding costs) are modulated by the state at the order epoch time. Applying a matrix analytic approach, fluid flow techniques, and martingales, we develop methods to obtain explicit equations for these cost functionals in the discounted case and under the long-run average criterion. Finally, we extend the model to allow backlogging.


Sign in / Sign up

Export Citation Format

Share Document