Hostname: page-component-77c89778f8-fv566 Total loading time: 0 Render date: 2024-07-21T00:44:54.058Z Has data issue: false hasContentIssue false

Some theorems on the transient covariance of Markov chains

Published online by Cambridge University Press:  14 July 2016

John F. Reynolds*
Affiliation:
University College, Cardiff

Abstract

Several authors have considered the covariance structure of continuous parameter Markov chains. Most of this work has dealt with particular process ses, notably Morse (1955) who analysed the simple M/M/1 queue and Bene-(1961) who considered a telephone trunking model. Furthermore, the results obtained apply only when the process has attained its limiting (stationary) distribution. A recent paper by Reynolds (1968) gave some general results for finite chains, still assuming stationarity. This note generalises the results obtained therein, and considers the covariance structure during the transient period prior to attaining the stationary distribution where this exists. In the case where no such distribution exists, the results are valid throughout the whole lifetime of the process.

Type
Short Communications
Copyright
Copyright © Applied Probability Trust 1972 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Beneš, V. E. (1961) The covariance function of a simple trunk group, with applications to traffic measurement. Bell Syst. Tech. J. 40, 117148.Google Scholar
Cox, D. R. and Miller, H. D. (1965) The Theory of Stochastic Processes. Methuen. London.Google Scholar
Morse, P. M. (1955) Stochastic properties of waiting lines, Operat. Res. 3, 255261.Google Scholar
Reynolds, J. F. (1968) On the autocorrelation and spectral functions of queues. J. Appl. Prob. 5, 467475.Google Scholar