Hostname: page-component-848d4c4894-ndmmz Total loading time: 0 Render date: 2024-05-24T07:29:21.764Z Has data issue: false hasContentIssue false
  • English
  • Français

Reversibility, invariance and μ-invariance

Published online by Cambridge University Press:  01 July 2016

P. K. Pollett
P. K. Pollett*
Affiliation:
Murdoch University
*
∗Present address: Department of Mathematics, The University of Queensland, St Lucia, QLD 4067, Australia.
Get access Rights & Permissions [Opens in a new window]

Abstract

In this paper we consider a number of questions relating to the problem of determining quasi-stationary distributions for transient Markov processes. First we find conditions under which a measure or vector that is µ-invariant for a matrix of transition rates is also μ-invariant for the family of transition matrices of the minimal process it generates. These provide a means for determining whether or not the so-called stationary conditional quasi-stationary distribution exists in the λ-transient case. The process is not assumed to be regular, nor is it assumed to be uniform or irreducible. In deriving the invariance conditions we reveal a relationship between μ-invariance and the invariance of measures for related processes called the μ-reverse and the μ-dual processes. They play a role analogous to the time-reverse process which arises in the discussion of stationary distributions. Secondly we bring the related notions of detail-balance and reversibility into the realm of quasi-stationary processes. For example, if a process can be identified as being μ-reversible, the problem of determining quasi-stationary distributions is made much simpler. Finally, we consider some practical problems that emerge when calculating quasi-stationary distributions directly from the transition rates of the process. Our results are illustrated with reference to a variety of processes including examples of birth and death processes and the birth, death and catastrophe process.

Keywords

INVARIANT MEASURESQUASI-STATIONARY DISTRIBUTIONS
Type
Research Article
Information
Advances in Applied Probability , Volume 20 , Issue 3 , September 1988 , pp. 600 - 621
Copyright
Copyright © Applied Probability Trust 1988 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Brockwell, P. J., Gani, J., and Resnick, S. I. (1982) Birth immigration and catastrophe processes. Adv. Appl. Prob. 14, 709–731.Google Scholar
Cavender, J. A. (1978) Quasistationary distributions for birth-and-death processes. Adv. Appl. Prob. 10, 570–586.Google Scholar
Darroch, J. N. and Seneta, E. (1967) On quasi-stationary distributions in absorbing continuous-time finite Markov chains. J. Appl. Prob. 4, 192–196.Google Scholar
Dobrušin, R. L. (1952) On conditions of regularity of stationary Markov processes with a denumerable number of possible states. Uspehi Mat. Nauk (N.S.) 7, 185–191.Google Scholar
Flaspohler, D. C. (1974) Quasi-stationary distributions for absorbing continuous-time denumerable Markov chains. Ann. Inst. Statist. Math. 26, 351–356.Google Scholar
Kelly, F. P. (1976) Networks of queues. Adv. Appl. Prob. 8, 416–432.CrossRefGoogle Scholar
Kelly, F. P. (1979) Reversibility and Stochastic Networks. Wiley, London.Google Scholar
Kelly, F. P. (1983) Invariant measures and the q-matrix. In Probability, Statistics and Analysis, eds. Kingman, J. F. C. and Reuter, G. E. H., London Mathematical Society Lecture Notes Series 79, Cambridge University Press, 143–160.Google Scholar
Kendall, D. G. (1959) Unitary dilations of one-parameter semigroups of Markov transition operators, and the corresponding integral representations for Markov processes with a countable infinity of states. Proc. London. Math. Soc. (3) 9, 417–431.Google Scholar
Kendall, D. G. (1975) Some problems in mathematical genealogy. In Perspectives in Probability and Statistics: Papers in honour of M. S. Bartlett, ed. Gani, J., J. Applied Probability Trust, Sheffield, 325–345.Google Scholar
Kent, J. T. (1978) Time reversible diffusions. Adv. Appl. Prob. 10, 819–835.Google Scholar
Kingman, J. F. C. (1963) The exponential decay of Markov transition probabilities. Proc. London Math. Soc. (3) 13, 337–358.CrossRefGoogle Scholar
Kingman, J. F. C. (1969) Markov population processes. J. Appl. Prob. 6, 1–18.Google Scholar
Kolmogorov, A. (1936) Zur Theorie der Markoffschen Ketten. Math. Annalen 112, 155–160.Google Scholar
Miller, R. C. (1963) Stationary equations in continuous-time Markov chains. Trans. Amer. Math. Soc. 109, 35–44.Google Scholar
Pakes, A. G. (1987) Limit theorems for the population size of a birth and death process allowing catastrophes. J. Math. Biol. 25, 307–325.CrossRefGoogle ScholarPubMed
Parsons, R. W. and Pollett, P. K. (1987) Quasistationary distributions for autocatalytic reactions. J. Statist. Phys. 46, 249–254.Google Scholar
Pollett, P. K. (1986a) On the equivalence of µ-invariant measures for the minimal process and its q-matrix. Stoch. Proc. Appl. 22, 203–221.Google Scholar
Pollett, P. K. (1986b) Connecting reversible Markov processes. Adv. Appl. Prob. 18, 880–900.Google Scholar
Pollett, P. K. (1986c) Quasistationary distributions and the Kolmogorov criterion. Report, Murdoch University.Google Scholar
Pollett, P. K. (1987) Preserving partial balance in continuous time Markov chains. Adv. Appl. Prob. 19, 431–453.Google Scholar
Reich, E. (1957) Waiting times when queues are in tandem. Ann. Math. Statist. 28, 768–773.Google Scholar
Reuter, G. E. H. (1957) Denumerable Markov processes and the associated contraction semigroups on l . Acta. Math. 97, 1–46.Google Scholar
Senata, E. (1966) Quasi-stationary behaviour in the random walk with continuous time. Austral. J. Statist. 8, 92–98.Google Scholar
Tweedie, R. L. (1974) Some ergodic properties of the Feller minimal process. Quart. J. Math. Oxford (2) 25, 485–495.Google Scholar
Vere-Jones, D. (1969) Some limit theorems for evanescent processes. Austral. J. Statist. 11, 67–78.Google Scholar
Whittle, P. (1975) Reversibility and acyclicity. In Perspectives in Probability and Statistics: Papers in Honour of M. S. Bartlett ed. Gani, J., Applied Probability Trust, Sheffield, 217–224.Google Scholar
Ziedens, I. (1987) Quasi-stationary distributions and one-dimensional circuit-switched networks. J. Appl. Prob. 24, 965–977.CrossRefGoogle Scholar