Skip to main content Accessibility help

Markov-modulated single-server queueing systems

  • N. U. Prabhu and L. C Tang


We consider single-server queueing systems that are modulated by a discrete-time Markov chain on a countable state space. The underlying stochastic process is a Markov random walk (MRW) whose increments can be expressed as differences between service times and interarrival times. We derive the joint distributions of the waiting and idle times in the presence of the modulating Markov chain. Our approach is based on properties of the ladder sets associated with this MRW and its time-reversed counterpart. The special case of a Markov-modulated M/M/1 queueing system is then analysed and results analogous to the classical case are obtained.



Hide All
[1] Arjas, E. (1972) On the use of a fundamental identity in the theory of semi-Markov queues. Adv. Appl. Prob. 4, 271284.
[2] Asmussen, S. (1991) Ladder heights and the Markov-modulated M/G/1 queue. Stoch. Proc. Appl. 37, 313326.
[3] Feller, W. (1971) An Introduction to Probability Theory and Its Applications , Vol. II, 2nd edn. Wiley, New York.
[4] Heyde, C. C. (1967) A limit theorem for random walks with drift. J. Appl. Prob. 6, 129134.
[5] Newbould, M. (1973) A classification of a random walk defined on a finite Markov chain. Z. Wahrscheinlichkeitsth. 26, 95104.
[6] Prabhu, N. U. (1981) Stochastic Storage Processes. Springer-Verlag, New York.
[7] Prabhu, N. U. and Zhu, Y. (1989) Markov-modulated queueing systems. QUESTA 5, 215245.
[8] Prabhu, N. U., Tang, L. C. and Zhu, Y. (1991) Some new results for the Markov random walk. J. Math. Phys. Sci. 25, 635663.
[9] Presman, E. L. (1969) Factorization methods and boundary problems for sums of random variables given on Markov chains. Math. USSR Izvestija 3, 815852.
[10] Takács, L. (1976) On fluctuation problems in the theory of queues. Adv. Appl. Prob. 8, 548583.
[11] Takács, L. (1978) On fluctuations of sums of random variables. In Studies in Probability and Ergodic Theory , ed. Rota, G.-C. Academic Press, New York.
[12] Tang, L. C. (1992) Limit theorems for Markov random walks. Technical report No. 1013, School of ORIE, Cornell University.


MSC classification

Markov-modulated single-server queueing systems

  • N. U. Prabhu and L. C Tang


Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed