Skip to main content Accessibility help
×
Home
Hostname: page-component-564cf476b6-scc96 Total loading time: 0.182 Render date: 2021-06-23T06:42:32.684Z Has data issue: true Feature Flags: { "shouldUseShareProductTool": true, "shouldUseHypothesis": true, "isUnsiloEnabled": true, "metricsAbstractViews": false, "figures": true, "newCiteModal": false, "newCitedByModal": true, "newEcommerce": true }

On controlled one-dimensional diffusion processes with unknown parameter

Published online by Cambridge University Press:  01 July 2016

Věra Dufková
Affiliation:
Institute of Information Theory and Automation, Czechoslovakian Academy of Sciences, Prague

Abstract

We consider a controlled diffusion process, the description of which depends on an unknown parameter α, and investigate the following control policy. To each α an optimal stationary control is associated. α is estimated recurrently from the trajectory by Bayes' method, and the optimal stationary control corresponding to the estimate is used. We establish the consistency of the estimate, and present asymptotic properties of the criterion function. They follow from the central limit theorem, from the law of large numbers and from the law of the iterated logarithm for local martingales.

Type
Research Article
Copyright
Copyright © Applied Probability Trust 1977 

Access options

Get access to the full version of this content by using one of the access options below.

References

Liptser, R. S. and Shiryayev, A. N. (1974) Statistics of Random Processes (Russian). Nauka, Moskva.Google Scholar
Loève, M. (1963) Probability Theory. Van Nostrand, Princeton, N.J. Google Scholar
Mandl, P. (1972) An application of Itô's formula to stochastic control systems. Stability of Stochastic Dynamical Systems, Proc. Int. Symposium, Springer-Verlag, Berlin, 815.CrossRefGoogle Scholar
Mandl, P. (1968) Analytical Treatment of One-Dimensional Markov Processes. Academia, Prague; Springer-Verlag, Berlin.Google Scholar
McKean, H. P. (1969) Stochastic Integrals. Academic Press, New York and London.Google Scholar
Morton, R. (1971) On the optimal control of stationary diffusion processes with inaccessible boundaries and no discounting. J. Appl. Prob. 8, 551560.CrossRefGoogle Scholar
Wong, E. (1973) Recent progress in stochastic processes — A survey. IEEE Trans. Inf. Theory 19, 262275.CrossRefGoogle Scholar
2
Cited by

Send article to Kindle

To send this article to your Kindle, first ensure no-reply@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about sending to your Kindle. Find out more about sending to your Kindle.

Note you can select to send to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be sent to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

On controlled one-dimensional diffusion processes with unknown parameter
Available formats
×

Send article to Dropbox

To send this article to your Dropbox account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Dropbox.

On controlled one-dimensional diffusion processes with unknown parameter
Available formats
×

Send article to Google Drive

To send this article to your Google Drive account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Google Drive.

On controlled one-dimensional diffusion processes with unknown parameter
Available formats
×
×

Reply to: Submit a response

Please enter your response.

Your details

Please enter a valid email address.

Conflicting interests

Do you have any conflicting interests? *