Hostname: page-component-77c89778f8-vsgnj Total loading time: 0 Render date: 2024-07-17T03:59:21.262Z Has data issue: false hasContentIssue false

Optimal control of a finite dam: average-cost case

Published online by Cambridge University Press:  14 July 2016

Lam Yeh*
Affiliation:
The Chinese University of Hong Kong
*
Postal address: Department of Statistics, The Chinese University of Hong Kong, Shatin, N.T., Hong Kong.

Abstract

We consider the problem of minimizing the long-run average cost per unit time of operating a finite dam in the class of the policies of the following type. Assume that the dam is initially empty, the release rate is kept at 0 until the dam storage increases to λ, and as soon as this occurs, water is released at rate M, then the output rate is kept at M as long as the dam storage is more than τ and it must be decreased to 0 if the dam storage becomes τ. We assume that the input of water into the finite dam is a Wiener process with non-negative drift μ and variance parameter σ2. There is a cost in increasing the output rate from 0 to M as well as in decreasing the rate from M to 0 and whenever the dam storage is below level a, there is a penalty cost per unit time depending on the level. A reward is given for each unit of water released. In this paper, the long-run average cost per unit time is determined, and therefore the optimal policy can be found numerically.

Type
Short Communications
Copyright
Copyright © Applied Probability Trust 1985 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Attia, F. A. and Brockwell, P. J. (1982) The control of a finite dam. J. Appl. Prob. 19, 815825.CrossRefGoogle Scholar
Faddy, M. J. (1974) Optimal control of finite dams: discrete (2-stage) output procedure. J. Appl. Prob. 11, 111121.CrossRefGoogle Scholar
Karlin, S. and Taylor, H. M. (1981) A Second Course in Stochastic Processes. Academic Press, New York.Google Scholar
Ross, S. M. (1970) Applied Probability Models with Optimization Applications. Holden-Day, San Francisco.Google Scholar
Zuckerman, D. (1977) Two-stage output procedure of a finite dam. J. Appl. Prob. 14, 421425.CrossRefGoogle Scholar