Hostname: page-component-8448b6f56d-xtgtn Total loading time: 0 Render date: 2024-04-23T19:51:40.617Z Has data issue: false hasContentIssue false

Existence and Uniqueness of a Quasistationary Distribution for Markov Processes with Fast Return from Infinity

Published online by Cambridge University Press:  30 January 2018

Servet Martínez*
Affiliation:
Universidad de Chile
Jaime San Martín*
Affiliation:
Universidad de Chile
Denis Villemonais*
Affiliation:
Université de Lorraine
*
Postal address: Departemento Ingeniería, Matemática and Centro de Modelamiento Matemático, Universidad de Chile, UMI 2807, CNRS, Universidad de Chile, Santiago, Chile.
∗∗ Postal address: Departemento Ingeniería, Matemática and Centro de Modelamiento Matemático, Universidad de Chile, UMI 2807, CNRS, Universidad de Chile, Santiago, Chile.
∗∗∗ Postal address: Institut Élie Cartan de Lorraine, Université de Lorraine, Site de Nancy, B.P. 70239, F-54506 Vandoeuvre-lès-Nancy Cedex, France. Email address: denis.villemonais@inria.fr
Rights & Permissions [Opens in a new window]

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the ‘Save PDF’ action button.

We study the long-time behaviour of a Markov process evolving in N and conditioned not to hit 0. Assuming that the process comes back quickly from ∞, we prove that the process admits a unique quasistationary distribution (in particular, the distribution of the conditioned process admits a limit when time goes to ∞). Moreover, we prove that the distribution of the process converges exponentially fast in the total variation norm to its quasistationary distribution and we provide a bound for the rate of convergence. As a first application of our result, we bring a new insight on the speed of convergence to the quasistationary distribution for birth-and-death processes: we prove that starting from any initial distribution the conditional probability converges in law to a unique distribution ρ supported in N* if and only if the process has a unique quasistationary distribution. Moreover, ρ is this unique quasistationary distribution and the convergence is shown to be exponentially fast in the total variation norm. Also, considering the lack of results on quasistationary distributions for nonirreducible processes on countable spaces, we show, as a second application of our result, the existence and uniqueness of a quasistationary distribution for a class of possibly nonirreducible processes.

Type
Research Article
Copyright
© Applied Probability Trust 

References

Darroch, J. N. and Seneta, E. (1967). On quasi-stationary distributions in absorbing continuous-time finite Markov chains. J. Appl. Prob. 4, 192196.Google Scholar
Down, D., Meyn, S. P. and Tweedie, R. L. (1995). Exponential and uniform ergodicity of Markov processes. Ann. Prob. 23, 16711691.Google Scholar
Ferrari, P. A. and Marić, N. (2007). Quasi stationary distributions and Fleming–Viot processes in countable spaces. Electron. J. Prob. 12, 684702.Google Scholar
Ferrari, P. A., Kesten, H., Martínez, S. and Picco, P. (1995). Existence of quasi-stationary distributions. A renewal dynamical approach. Ann. Prob. 23, 501521.Google Scholar
Hart, A. G. and Pollett, P. K. (1996). Direct analytical methods for determining quasistationary distributions for continuous-time Markov chains. In Athens Conference on Applied Probability and Time Series Analysis (Lecture Notes Statist. 114), Vol. I, Springer, New York, pp. 116126.Google Scholar
{Méléard, S. and Villemonais, D.} (2012). Quasi-stationary distributions and population processes. Prob. Surveys 9, 340410.Google Scholar
Van Doorn, E. A. (1991). Quasi-stationary distributions and convergence to quasi-stationarity of birth–death processes. Adv. Appl. Prob. 23, 683700.Google Scholar
Van Doorn, E. A. and Pollett, P. K. (2013). Quasi-stationary distributions for discrete state models. Europ. J. Operat. Res. 230, 114.Google Scholar
Vere-Jones, D. (1969). Some limit theorems for evanescent processes. Austral. J. Statist. 11, 6778.Google Scholar
Villemonais, D. and Del Moral, P. (2011). Strong mixing properties for time inhomogeneous diffusion processes with killing. Distributions quasi-stationnaires et méthodes particulaires pour l'approximation de processus conditionnés, , pp. 149166.Google Scholar
Yaglom, A. M. (1947). Certain limit theorems of the theory of branching random processes. Doklady Akad. Nauk SSSR (N.S.) 56, 795798 (in Russian).Google Scholar
Zhang, H. and Zhu, Y. (2013). Domain of attraction of the quasistationary distribution for birth-and-death processes. J. Appl. Prob. 50, 114126.Google Scholar