Hostname: page-component-77c89778f8-rkxrd Total loading time: 0 Render date: 2024-07-21T00:42:12.456Z Has data issue: false hasContentIssue false
  • English
  • Français

A formula for singular perturbations of Markov chains

Part of: Markov processes

Published online by Cambridge University Press:  14 July 2016

Jean B. Lasserre
Jean B. Lasserre*
Affiliation:
LAAS-CNRS
*
∗ Postal address: LAAS-CNRS, 7 Avenue du Colonel Roche, 31 077 Toulouse Cédex, France.
Get access Rights & Permissions [Opens in a new window]

Abstract

We give formulas for updating both the steady-state probability distribution and the fundamental matrices of a singularly perturbed Markov chain. This formula generalizes Schweitzer's regular perturbation formulas to the case of singular perturbations.

Keywords

TRANSITION PROBABILITY MATRIXREGULAR PERTURBATION

MSC classification

Primary: 60J10: Markov chains (discrete-time Markov processes on discrete state spaces)
Type
Short Communications
Information
Journal of Applied Probability , Volume 31 , Issue 3 , September 1994 , pp. 829 - 833
Copyright
Copyright © Applied Probability Trust 1994 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

[1] Abbad, M. and Filar, J. (1992) Algorithms for singularly perturbed limiting average cost control problems. IEEE Trans. Autom. Control. 37, 1421–1425.CrossRefGoogle Scholar
[2] Delebecque, F. and Quadrat, J. P. (1981) Optimal control of Markov chains admitting strong and weak interactions. Automatica 17, 281–296.Google Scholar
[3] Schweitzer, P. J. (1968) Perturbation theory and finite Markov chains. J. Appl. Prob. 5, 401–413.CrossRefGoogle Scholar
[4] Schweitzer, P. J. (1968) Perturbation theory and undiscounted Markov renewal programming. Operat. Res. 17, 716–727.Google Scholar
[5] Kemeny, J. G. and Snell, J. L. (1960) Finite Markov Chains. Van Nostrand, Princeton, NJ.Google Scholar
[6] Yosida, K. (1980) Functional Analysis. Springer-Verlag, New York.Google Scholar