Hostname: page-component-76fb5796d-dfsvx Total loading time: 0 Render date: 2024-04-28T03:08:38.751Z Has data issue: false hasContentIssue false
  • English
  • Français

Optimal Control of a Stochastic Processing System Driven by a Fractional Brownian Motion Input

Part of: Operations research and management science Computer system organization Special processes

Published online by Cambridge University Press:  01 July 2016

Arka P. Ghosh ,
Alexander Roitershtein  and
Ananda Weerasinghe
Arka P. Ghosh*
Affiliation:
Iowa State University
Alexander Roitershtein*
Affiliation:
Iowa State University
Ananda Weerasinghe*
Affiliation:
Iowa State University
*
∗ Postal address: Department of Statistics, Iowa State University, 3216 Snedecor Hall, Ames, IA 50011, USA. Email address: apghosh@iastate.edu
∗∗ Postal address: Department of Mathematics, Iowa State University, 420 Carver Hall, Ames, IA 50011, USA. Email address: roiterst@iastate.edu
∗∗∗ Postal address: Department of Mathematics, Iowa State University, 414 Carver Hall, Ames, IA 50011, USA. Email address: ananda@iastate.edu
Rights & Permissions [Opens in a new window]

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the ‘Save PDF’ action button.

We consider a stochastic control model driven by a fractional Brownian motion. This model is a formal approximation to a queueing network with an ON-OFF input process. We study stochastic control problems associated with the long-run average cost, the infinite-horizon discounted cost, and the finite-horizon cost. In addition, we find a solution to a constrained minimization problem as an application of our solution to the long-run average cost problem. We also establish Abelian limit relationships among the value functions of the above control problems.

Keywords

Stochastic controlcontrolled queueing networkheavy traffic analysisfractional Brownian motionself-similaritylong-range dependence

MSC classification

Primary: 60K25: Queueing theory 68M20: Performance evaluation; queueing; scheduling 90B22: Queues and service
Secondary: 90B18: Communication networks
Type
General Applied Probability
Information
Advances in Applied Probability , Volume 42 , Issue 1 , March 2010 , pp. 183 - 209
Copyright
Copyright © Applied Probability Trust 2010 

References

Ata, B., Harrison, J. M. and Shepp, L. A. (2005). Drift rate control of a Brownian processing system. Ann. Appl. Prob. 15, 1145–1160.Google Scholar
Bell, S. L. and Williams, R. J. (2001). Dynamic scheduling of a system with two parallel servers in heavy traffic with resource pooling: asymptotic optimality of a threshold policy. Ann. Appl. Prob. 11, 608–649.Google Scholar
Biagini, F., Hu, Y., Oksendal, B. and Sulem, A. (2002). A stochastic maximum principle for processes driven by fractional Brownian motion. Stoch. Process. Appl. 100, 233–253.Google Scholar
Biagini, F., Hu, Y., Oksendal, B. and Zhang, T. (2008). Stochastic Calculus for Fractional Brownian Motion and Applications. Springer, London.Google Scholar
Budhiraja, A. and Ghosh, A. P. (2005). A large deviations approach to asymptotically optimal control of crisscross network in heavy traffic. Ann. Appl. Prob. 15, 1887–1935.Google Scholar
Budhiraja, A. and Ghosh, A. P. (2006). Diffusion approximations for controlled stochastic networks: an asymptotic bound for the value function. Ann. Appl. Prob. 16, 1962–1962.Google Scholar
Duffield, N. G. and O'Connell, N. (1995). Large deviations and overflow probabilities for the general single-server queue, with applications. Math. Proc. Camb. Phil. Soc. 118, 363–374.Google Scholar
Duncan, T. E. (2007). Some stochastic systems with a fractional Brownian motion and applications to control. In Proc. American Control Conference (New York, July 2007), pp. 1110–1114.Google Scholar
Ghosh, A. P. and Weerasinghe, A. (2008). Optimal buffer size and dynamic rate control for a queueing network with impatient customers in heavy traffic. Submitted. Available at http://www.public.iastate.edu/∼apghosh/reneging_queue.pdf.Google Scholar
Gong, W.-B. Liu, Y., Misra, V., and Towsley, D. (2005). Self-similarity and long range dependence on the Internet: a second look at the evidence, origins and implications. Comput. Networks 48, 377–399.Google Scholar
Hairer, M. (2005). Ergodicity of stochastic differential equations driven by fractional Brownian motion. Ann. Prob. 33, 703–758.Google Scholar
Harrison, J. M. (1985). Brownian Motion and Stochastic Flow Systems. John Wiley, New York.Google Scholar
Harrison, J. M. (2003). A broader view of Brownian networks. Ann. Appl. Prob. 13, 119–1150.CrossRefGoogle Scholar
Heath, D., Resnick, S. and Samorodnitsky, G. (1997). Patterns of buffer overflow in a class of queues with long memory in the input stream. Ann. Appl. Prob. 7, 1021–1057.Google Scholar
Heath, D., Resnick, S. and Samorodnitsky, G. (1998). Heavy tails and long range dependence in ON/OFF processes and associated fluid models. Math. Oper. Res. 23, 145–165.Google Scholar
Hu, Y. and Zhou, X.-Y. (2005). Stochastic control for linear systems driven by fractional noises. SIAM J. Control Optimization 43, 2245–2277.CrossRefGoogle Scholar
Kleptsyna, M. L., Le Breton, A. and Viot, M. (2003). About the linear-quadratic regulator problem under a fractional Brownian perturbation. ESAIM Prob. Statist. 7, 161–170.Google Scholar
Konstantopoulos, T. and Last, G. (2000). On the dynamics and performance of stochastic fluid systems. J. Appl. Prob. 37, 652–667.Google Scholar
Konstantopoulos, T. and Lin, S.-J. (1996). Fractional Brownian approximations of queueing networks. In Stochastic Networks (Lecture Notes Statist. 117), Springer, New York, pp. 257–273.Google Scholar
Konstantopoulos, T., Zazanis, M. and De Veciana, G. (1996). Conservation laws and reflection mappings with an application to multi-class mean value analysis for stochastic fluid queues. Stoch. Process. Appl. 65, 139–146.Google Scholar
Kruk, L., Lehoczky, J., Ramanan, K. and Shreve, S. (2007). An explicit formula for the Skorohod map on 0,a . Ann. Prob. 35, 1740–1768.Google Scholar
Leland, W. E., Taqqu, M. S., Willinger, W. and Wilson, D. V. (1994). On the self-similar nature of Ethernet traffic (extended version). IEEE/ACM Trans. Networking 2, 1–15.Google Scholar
Mandelbrot, B. B. and Van Ness, J. W. (1968). Fractional Brownian motions, fractional noises and applications. SIAM Rev. 10, 422–437.Google Scholar
Norros, I. (1994). A storage model with self-similar input. Queueing Systems 16, 387–396.Google Scholar
Nualart, D. (2006). The Malliavin Calculus and Related Topics, 2nd edn. Springer, Berlin.Google Scholar
Paxson, V. and Floyd, S. (1995). Wide-area traffic: the failure of Poisson modeling. IEEE/ACM Trans. Networking 3, 226–244.Google Scholar
Sahinoglu, Z. and Tekinay, S. (1999). Self-similar traffic and network performance. IEEE Commun. Mag. 37, 48–52.Google Scholar
Samorodnitsky, G. and Taqqu, M. S. (1994). Stable Non-Gaussian Random Processes. Chapman and Hall, New York.Google Scholar
Shiryaev, A. N. (1999). Essentials of Stochastic Finance. World Scientic, River Edge, NJ.Google Scholar
Taqqu, M., Willinger, W. and Sherman, R. (1997). Proof of a fundamental result in self-similar traffic modeling. Comput. Commun. Rev. 27, 5–23.Google Scholar
Taqqu, M. S., Willinger, W., Sherman, R. and Wilson, D. V. (1997). Self-similarity through high-variability: statistical analysis of Ethernet LAN traffic at the source level. IEEE ACM Trans. Networking 5, 71–86.Google Scholar
Weerasinghe, A. (2005). An Abelian limit approach to a singular ergodic control problem. SIAM J. Control Optimization 44, 714–737.Google Scholar
Whitt, W. (2000). An overview of Brownian and non-Brownian FCLTs for the single-server queue. Queueing Systems 36, 39–70.Google Scholar
Whitt, W. (2002). Stochastic-Process Limits. Springer, New York.Google Scholar
Willinger, W., Paxson, V. and Taqqu, M. S. (1998). Self-similarity and heavy tails: structural modeling of network traffic. In A Practical Guide to Heavy Tails: Statistical Techniques and Applications, eds Adler, R., Feldman, R., and Taqqu, M. S., Birkhauser, Boston, MA, pp. 27–53.Google Scholar
Willinger, W., Taqqu, M. S. and Erramilli, A. (1996). A bibliographical guide to self-similar traffic and performance modeling for modern high-speed networks. In Stochastic Networks: Theory and Applications (R. Statist. Soc. Lecture Notes Ser. 4), Oxford University Press, pp. 339–366.Google Scholar
Zeevi, A. J. and Glynn, P. W. (2000). On the maximum workload of a queue fed by fractional Brownian motion. Ann. Appl. Prob. 10, 1084–1099.Google Scholar