On the Asymptotic Insensitivity of the Supermarket Model in Processor Sharing Systems

Author(s):  
Grzegorz Kielanski ◽  
Benny Van Houdt

The supermarket model is a popular load balancing model where each incoming job is assigned to a server with the least number of jobs among d randomly selected servers. Several authors have shown that the large scale limit in case of processor sharing servers has a unique insensitive fixed point, which naturally leads to the belief that the queue length distribution in such a system is insensitive to the job size distribution as the number of servers tends to infinity. Simulation results that support this belief have also been reported. However, global attraction of the unique fixed point of the large scale limit was not proven except for exponential job sizes, which is needed to formally prove asymptotic insensitivity. The difficulty lies in the fact that with processor sharing servers, the limiting system is in general not monotone. In this paper we focus on the class of hyperexponential distributions of order 2 and demonstrate that for this class of distributions global attraction of the unique fixed point can still be established using monotonicity by picking a suitable state space and partial order. This allows us to formally show that we have asymptotic insensitivity within this class of job size distributions. We further demonstrate that our result can be leveraged to prove asymptotic insensitivity within this class of distributions for other load balancing systems.

Author(s):  
Nikki Sonenberg ◽  
Grzegorz Kielanski ◽  
Benny Van Houdt

Randomized work stealing is used in distributed systems to increase performance and improve resource utilization. In this article, we consider randomized work stealing in a large system of homogeneous processors where parent jobs spawn child jobs that can feasibly be executed in parallel with the parent job. We analyse the performance of two work stealing strategies: one where only child jobs can be transferred across servers and the other where parent jobs are transferred. We define a mean-field model to derive the response time distribution in a large-scale system with Poisson arrivals and exponential parent and child job durations. We prove that the model has a unique fixed point that corresponds to the steady state of a structured Markov chain, allowing us to use matrix analytic methods to compute the unique fixed point. The accuracy of the mean-field model is validated using simulation. Using numerical examples, we illustrate the effect of different probe rates, load, and different child job size distributions on performance with respect to the two stealing strategies, individually, and compared to each other.


1989 ◽  
Vol 3 (3) ◽  
pp. 417-433 ◽  
Author(s):  
David L. Jagerman ◽  
Bhaskar Sengupta

Our primary aim in this paper is to study a functional equation that arises in a problem of queueing. Consider a queue with compound Poisson arrivals and general service times with a gating mechanism. The gating mechanism takes in at most m(≤∞) customers at a time for service and serves these customers according to the processor-sharing discipline. In this paper, we examine various performance characteristics for this queue. The characteristics include waiting-time distribution, queue-length distribution, time spent with the server, and batch-size distribution for service.


Sign in / Sign up

Export Citation Format

Share Document