Hostname: page-component-848d4c4894-2xdlg Total loading time: 0 Render date: 2024-06-22T03:53:36.107Z Has data issue: false hasContentIssue false
  • English
  • Français

Markov Chains Conditioned Never to Wait Too Long at the Origin

Part of: Markov processes Probability theory on algebraic and topological structures

Published online by Cambridge University Press:  14 July 2016

Saul Jacka
Saul Jacka*
Affiliation:
University of Warwick
*
∗Postal address: Department of Statistics, University of Warwick, Coventry CV4 7AL, UK. Email address: s.d.jacka@warwick.ac.uk
Rights & Permissions [Opens in a new window]

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the ‘Save PDF’ action button.

Motivated by Feller's coin-tossing problem, we consider the problem of conditioning an irreducible Markov chain never to wait too long at 0. Denoting by τ the first time that the chain, X, waits for at least one unit of time at the origin, we consider conditioning the chain on the event (τ›T). We show that there is a weak limit as T→∞ in the cases where either the state space is finite or X is transient. We give sufficient conditions for the existence of a weak limit in other cases and show that we have vague convergence to a defective limit if the time to hit zero has a lighter tail than τ and τ is subexponential.

Keywords

Subexponential tailevanescent processFeller's coin-tossing constantshitting probabilitiesconditioned process

MSC classification

Secondary: 60J27: Continuous-time Markov processes on discrete state spaces 60J80: Branching processes (Galton-Watson, birth-and-death, etc.) 60J50: Boundary theory 60B10: Convergence of probability measures
Type
Research Article
Information
Journal of Applied Probability , Volume 46 , Issue 3 , September 2009 , pp. 812 - 826
Copyright
Copyright © Applied Probability Trust 2009 

Footnotes

I am grateful to an anonymous referee for many helpful suggestions on improving the presentation of this paper.

References

[1] Doney, R. A. and Bertoin, J. (1996). Some asymptotic results for transient random walks. Adv. App. Prob. 28, 207–226.Google Scholar
[2] Doney, R. A. and Bertoin, J. (1997). Spitzer's condition for random walks and Lévy processes. Ann. Inst. H. Poincaré Prob. Statist. 33, 167–178.Google Scholar
[3] Doney, R. A. and Chaumont, L. (2005). On Lévy processes conditioned to stay positive. Electron. J. Prob. 10, 948–961.Google Scholar
[4] Feller, W. (1968). An Introduction To Probability Theory and Its Applications, Vol. I, 3rd edn. John Wiley, New York.Google Scholar
[5] Feller, W. (1971). An Introduction To Probability Theory and Its Applications, Vol. II, 2nd edn. John Wiley, New York.Google Scholar
[6] Ferrari, P. A., Kesten, H., Martinez, S. and Picco, P. (1995). Existence of quasi-stationary distributions. A renewal dynamical approach. Ann. Prob. 23, 501–521.Google Scholar
[7] Jacka, S. D. and Roberts, G. O. (1994). Strong forms of weak convergence. Stoch. Process. Appl. 67, 41–53.CrossRefGoogle Scholar
[8] Jacka, S. D. and Roberts, G. O. (1995). Weak convergence of conditioned processes on a countable state space. J. Appl. Prob. 32, 902–916.CrossRefGoogle Scholar
[9] Jacka, S. and Warren, J. (2002). Examples of convergence and non-convergence of Markov chains conditioned not to die. Electron. J. Prob. 7, 22pp.Google Scholar
[10] Jacka, S., Lazic, Z. and Warren, J. (2005). Conditioning an additive functional of a Markov chain to stay nonnegative. I. Survival for a long time. Adv. Appl. Prob. 37, 1015–1034.Google Scholar
[11] Jacka, S., Lazic, Z. and Warren, J. (2005). Conditioning an additive functional of a Markov chain to stay nonnegative. II. Hitting a high level. Adv. Appl. Prob. 37, 1035–1055.Google Scholar
[12] Kesten, H. (1995). A ratio limit theorem for (sub) Markov chains on {1,2,…} with bounded Jumps. Adv. Appl. Prob. 27, 652–691.Google Scholar
[13] Kyprianou, A. E. and Palmowski, Z. (2006). Quasi-stationary distributions for Lévy processes. Bernoulli 12, 571–581.Google Scholar
[14] Roberts, G. O. and Jacka, S. D. (1994). Weak convergence of conditioned birth and death processes. J. Appl. Prob. 31, 90–100.Google Scholar
[15] Roberts, G. O., Jacka, S. D. and Pollett, P. K. (1997). Non-explosivity of limits of conditioned birth and death processes. J. Appl. Prob. 34, 35–45.Google Scholar
[16] Seneta, E. (1981). Nonnegative Matrices and Markov Chains. Springer, New York.CrossRefGoogle Scholar
[17] Seneta, E. and Vere-Jones, D. (1966). On quasi-stationary distributions in discrete-time Markov chains with a denumerable infinity of states. J. Appl. Prob. 3, 403–434.Google Scholar
[18] Sigman, K. (1999). Appendix: a primer on heavy-tailed distributions. Queues with heavy-tailed distributions. Queueing Systems 33, 261–275.Google Scholar
[19] Williams, D. (1979). Diffusions, Markov Processes, and Martingales, Vol. I. John Wiley, Chichester.Google Scholar