Load sharing in heterogeneous queueing systems
- 1 January 1989
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 731-739 vol.2
- https://doi.org/10.1109/infcom.1989.101521
Abstract
The problem of sharing jobs among a set of parallel queues is discussed. The system is heterogeneous in the sense that different servers may have different speeds. Socially optimal policies that minimize the mean response time of all jobs ar of interest. Using semi-Markov decision processes, it is shown that an optimal policy that uses the instantaneous queue length independent of system utilization does not exist. Rather, the optimal decision of assigning a job to a server depends on the workload intensity. At light loads, the optimal policy tends to assign most jobs to fast servers. At heavy loads, slower servers are used to offload fast ones. Simulation results indicate that a simple heuristic, i.e., a generalization of the optimal policy for homogeneous systems derived from the analytic results, yields substantial performance improvement compared with no load sharing and outperforms the join-shortest-queue policy.Keywords
This publication has 11 references indexed in Scilit:
- Stochastic ProcessesPublished by Society for Industrial & Applied Mathematics (SIAM) ,1999
- A symptotic analysis of large heterogeneous queueing systemsPublished by Association for Computing Machinery (ACM) ,1988
- Load-balancing heuristics and process behaviorACM SIGMETRICS Performance Evaluation Review, 1986
- Optimal control of admission to a quenching systemIEEE Transactions on Automatic Control, 1985
- Optimal static load balancing in distributed computer systemsJournal of the ACM, 1985
- Optimal control of a queueing system with two heterogeneous serversIEEE Transactions on Automatic Control, 1984
- Load balancing in homogeneous broadcast distributed systemsACM SIGMETRICS Performance Evaluation Review, 1982
- Dynamic behavior of shortest path routing algorithms for communication networksIEEE Transactions on Automatic Control, 1982
- Optimality of the shortest line disciplineJournal of Applied Probability, 1977
- On direct sums of Markovian decision processJournal of Mathematical Analysis and Applications, 1969