Hostname: page-component-76fb5796d-25wd4 Total loading time: 0 Render date: 2024-04-26T15:08:33.763Z Has data issue: false hasContentIssue false
  • English
  • Français

Bayesian Quickest Detection Problems for Some Diffusion Processes

Part of: Inference from stochastic processes Stochastic processes Markov processes Functional-differential and differential-difference equations Sequential methods Decision theory

Published online by Cambridge University Press:  04 January 2016

Pavel V. Gapeev  and
Albert N. Shiryaev
Pavel V. Gapeev*
Affiliation:
London School of Economics
Albert N. Shiryaev*
Affiliation:
Steklov Institute of Mathematics
*
∗ Postal address: Department of Mathematics, London School of Economics, Houghton Street, London, WC2A 2AE, UK. Email address: p.v.gapeev@lse.ac.uk
∗∗ Postal address: Steklov Institute of Mathematics, Russian Academy of Sciences, Gubkina Street 8, Moscow 119991, Russia. Email address: albertsh@mi.ras.ru
Rights & Permissions [Opens in a new window]

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the ‘Save PDF’ action button.

We study the Bayesian problems of detecting a change in the drift rate of an observable diffusion process with linear and exponential penalty costs for a detection delay. The optimal times of alarms are found as the first times at which the weighted likelihood ratios hit stochastic boundaries depending on the current observations. The proof is based on the reduction of the initial problems into appropriate three-dimensional optimal stopping problems and the analysis of the associated parabolic-type free-boundary problems. We provide closed-form estimates for the value functions and the boundaries, under certain nontrivial relations between the coefficients of the observable diffusion.

Keywords

disorder detectiondiffusion processmultidimensional optimal stoppingstochastic boundarya change-of-variable formula with local time on surfacesparabolic-type free-boundary problem

MSC classification

Primary: 60G40: Stopping times; optimal stopping problems; gambling theory 62M20: Prediction 34K10: Boundary value problems
Secondary: 62C10: Bayesian problems; characterization of Bayes procedures 62L15: Optimal stopping 60J60: Diffusion processes
Type
General Applied Probability
Information
Advances in Applied Probability , Volume 45 , Issue 1 , March 2013 , pp. 164 - 185
Copyright
© Applied Probability Trust 

Footnotes

Supported by the Alexander von Humboldt Fellowship for Experienced Researchers.

References

Bayraktar, E. and Dayanik, S. (2006). Poisson disorder problem with exponential penalty for delay. Math. Operat. Res. 31, 217–233.Google Scholar
Bayraktar, E., Dayanik, S. and Karatzas, I. (2005). The standard Poisson disorder problem revisited. Stoch. Process. Appl. 115, 1437–1450.Google Scholar
Bayraktar, E., Dayanik, S. and Karatzas, I. (2006). Adaptive Poisson disorder problem. Ann. Appl. Prob. 16, 1190–1261.Google Scholar
Beibel, M. (2000). A note on sequential detection with exponential penalty for the delay. Ann. Statist. 28, 1696–1701.Google Scholar
Bensoussan, A. and Lions, J.-L. (1982). Applications of Variational Inequalities in Stochastic Control. North-Holland, Amsterdam.Google Scholar
Dayanik, S. (2010). Compound Poisson disorder problems with nonlinear detection delay penalty cost functions. Sequent. Anal. 29, 193–216.Google Scholar
Dayanik, S. and Sezer, S. O. (2006). Compound Poisson disorder problem. Math. Operat. Res. 31, 649–672.CrossRefGoogle Scholar
Dynkin, E. B. (1963). The optimum choice of the instant for stopping a Markov process. Soviet Math. Dokl. 4, 627–629.Google Scholar
Friedman, A. (1976). Stochastic Differential Equations and Applications, Vol. 2. Academic Press, New York.Google Scholar
Gapeev, P. V. and Peskir, G. (2006). The Wiener disorder problem with finite horizon. Stoch. Process. Appl. 116, 1770–1791.Google Scholar
Gapeev, P. V. and Shiryaev, A. N. (2011). On the sequential testing problem for some diffusion processes. Stochastics 83, 519–535.CrossRefGoogle Scholar
Grigelionis, B. I. and Shiryaev, A. N. (1966). On Stefan's problem and optimal stopping rules for Markov processes. Theory Prob. Appl. 11, 541–558.Google Scholar
Kolmogorov, A. N. (1992). On analytical methods in probability theory. In Selected Works of A. N. Kolmogorov, Vol. II, ed. Shiryaev, A. N., Kluwer, Dordrecht, pp. 62–108.Google Scholar
Krylov, N. V. (1980). Controlled Diffusion Processes. Springer, New York.Google Scholar
Liptser, R. S. and Shiryaev, A. N. (1977). Statistics of Random Processes I. Springer, Berlin.Google Scholar
Øksendal, B. (1998). Stochastic Differential Equations. Springer, Berlin.CrossRefGoogle Scholar
Peskir, G. (2007). A change-of-variable formula with local time on surfaces. In Séminaire de Probababilité XL (Lecture Notes Math. 1899). Springer, Berlin, pp. 69–96.Google Scholar
Peskir, G. and Shiryaev, A. N. (2006). Optimal Stopping and Free-Boundary Problems. Birkhäuser, Basel.Google Scholar
Poor, H. V. (1998). Quickest detection with exponential penalty for delay. Ann. Statist. 26, 2179–2205.CrossRefGoogle Scholar
Poor, H. V. and Hadjiliadis, O. (2008). Quickest Detection. Cambridge University Press.Google Scholar
Pospisil, L., Vecer, J. and Hadjiliadis, O. (2009). Formulas for stopped diffusion processes with stopping times based on drawdowns and drawups. Stochastic Process. Appl. 119, 2563–2578.Google Scholar
Revuz, D. and Yor, M. (1999). Continuous Martingales and Brownian Motion. Springer, Berlin.Google Scholar
Shiryaev, A. N. (1961). The problem of the most rapid detection of a disturbance in a stationary process. Soviet Math. Dokl. 2, 795–799.Google Scholar
Shiryaev, A. N. (1963). On optimum methods in quickest detection problems. Theory Prob. Appl. 8, 22–46.CrossRefGoogle Scholar
Shiryaev, A. N. (1964). On Markov sufficient statistics in nonadditive Bayes problems of sequential analysis. Theory Prob. Appl. 9, 670–686.Google Scholar
Shiryaev, A. N. (1965). Some exact formulas in a ‘disorder’ problem. Theory Prob. Appl. 10, 348–354.Google Scholar
Shiryaev, A. N. (1967). Two problems of sequential analysis. Cybernetics 3, 63–69.Google Scholar
Shiryaev, A. N. (1978). Optimal Stopping Rules. Springer, Berlin.Google Scholar
Shiryaev, A. N. (2002). Quickest detection problems in the technical analysis of the financial data. In Mathematical Finance—Bachelier Congress 2000 (Paris, June/July 2000), eds. Geman, H. et al., Springer, Berlin, pp. 487–521.Google Scholar
Shiryaev, A. N. (2008). Generalized Bayesian nonlinear quickest detection problems: on Markov family of sufficient statistics. In Mathematical Control Theory and Finance (Lisbon, April 2007), eds. Sarychev, A. et al., Springer, Berlin, pp. 377–386.Google Scholar
Shiryaev, A. N. and Zryumov, P. Y. (2009). On the linear and nonlinear generalized Bayesian disorder problem (discrete time case). In Optimality and Risk—Modern Trends in Mathematical Finance, eds. Delbaen, F. et al., Springer, Berlin, pp. 227–235.Google Scholar
Veretennikov, A. Yu. (1980). On the strong solutions of stochastic differential equations. Theory Prob. Appl. 24, 354–366.Google Scholar