Skip to main content Accessibility help
×
Home
Hostname: page-component-768dbb666b-x9ds4 Total loading time: 0.259 Render date: 2023-02-02T16:27:57.564Z Has data issue: true Feature Flags: { "useRatesEcommerce": false } hasContentIssue true

ASYMPTOTIC BEHAVIOUR OF RANDOM MARKOV CHAINS WITH TRIDIAGONAL GENERATORS

Published online by Cambridge University Press:  30 March 2012

PETER E. KLOEDEN*
Affiliation:
Institut für Mathematik, Goethe Universität, D-60054 Frankfurt am Main, Germany (email: kloeden@math.uni-frankfurt.de)
VICTOR S. KOZYAKIN
Affiliation:
Institute for Information Transmission Problems, Russian Academy of Sciences, Bolshoj Karetny lane, 19, 101447 Moscow, Russia (email: kozyakin@iitp.ru)
*
For correspondence; e-mail: kloeden@math.uni-frankfurt.de
Rights & Permissions[Opens in a new window]

Abstract

HTML view is not available for this content. However, as you have access to this content, a full PDF is available via the ‘Save PDF’ action button.

Continuous-time discrete-state random Markov chains generated by a random linear differential equation with a random tridiagonal matrix are shown to have a random attractor consisting of singleton subsets, essentially a random path, in the simplex of probability vectors. The proof uses comparison theorems for Carathéodory random differential equations and the fact that the linear cocycle generated by the Markov chain is a uniformly contractive mapping of the positive cone into itself with respect to the Hilbert projective metric. It does not involve probabilistic properties of the sample path and is thus equally valid in the nonautonomous deterministic context of Markov chains with, say, periodically varying transition probabilities, in which case the attractor is a periodic path.

Type
Research Article
Copyright
Copyright © Australian Mathematical Publishing Association Inc. 2012

Footnotes

P. E. Kloeden is partially supported by DFG grant KL 1203/7-1, the Spanish Ministerio de Ciencia e Innovación project MTM2011-22411, the Consejería de Innovación, Ciencia y Empresa (Junta de Andalucía) under the Ayuda 2009/FQM314 and the Proyecto de Excelencia P07-FQM-02468. V. S. Kozyakin is partially supported by the Russian Foundation for Basic Research, project no. 10-01-93112.

References

[1]Allen, L. J. S., An Introduction to Stochastic Processes with Applications to Biology, 2nd edn (CRC Press, Boca Raton, FL, 2011).Google Scholar
[2]Arnold, L., Random Dynamical Systems, Springer Monographs in Mathematics (Springer, Berlin, 1998).CrossRefGoogle Scholar
[3]Chueshov, I., Monotone Random Systems Theory and Applications, Lecture Notes in Mathematics, 1779 (Springer, Berlin, 2002).CrossRefGoogle Scholar
[4]Hutzenthaler, A. E., Mathematical Models for Cell-cell Communication on Different Time Scales, PhD Thesis, Zentrum Mathematik, Technische Universität München, 2009.Google Scholar
[5]Kloeden, P. E. and Kozyakin, V. S., ‘Asymptotic behaviour of random tridiagonal Markov chains in biological applications’, Discrete Contin. Dyn. Syst. Ser. B. to appear.Google Scholar
[6]Kloeden, P. E. and Lorenz, J., ‘Stable attracting sets in dynamical systems and in their one-step discretizations’, SIAM J. Numer. Anal. 23(5) (1986), 986995.CrossRefGoogle Scholar
[7]Krasnosel’skiĭ, M. A., The Operator of Translation along the Trajectories of Differential Equations, Translations of Mathematical Monographs, 19 (American Mathematical Society, Providence, RI, 1968), translated from the Russian by Scripta Technica.Google Scholar
[8]Krasnosel’skij, M. A., Lifshits, Je. A. and Sobolev, A. V., Positive Linear Systems: The Method of Positive Operators, Sigma Series in Applied Mathematics, 5 (Heldermann, Berlin, 1989), translated from the Russian by Jürgen Appell.Google Scholar
[9]Nussbaum, R. D., ‘Some nonlinear weak ergodic theorems’, SIAM J. Math. Anal. 21(2) (1990), 436460.CrossRefGoogle Scholar
[10]Nussbaum, R. D., ‘Finsler structures for the part metric and Hilbert’s projective metric and applications to ordinary differential equations’, Differ. Integral Equ. 7(5–6) (1994), 16491707.Google Scholar
[11]Smith, H. L., Monotone Dynamical Systems: An Introduction to the Theory of Competitive and Cooperative Systems, Mathematical Surveys and Monographs, 41 (American Mathematical Society, Providence, RI, 1995).Google Scholar
[12]Stuart, A. M. and Humphries, A. R., Dynamical Systems and Numerical Analysis, Cambridge Monographs on Applied and Computational Mathematics, 2 (Cambridge University Press, Cambridge, 1996).Google Scholar
[13]Szarski, J., Differential Inequalities, Monografie Matematyczne, Tom 43 (Państwowe Wydawnictwo Naukowe, Warsaw, 1965).Google Scholar
[14]Walter, W., ‘Differential inequalities’, in: Inequalities (Birmingham, 1987), Lecture Notes in Pure and Applied Mathematics, 129 (Dekker, New York, 1991), pp. 249283.Google Scholar
[15]Wodarz, D. and Komarova, N., Computational Biology of Cancer: Lecture Notes and Mathematical Modeling (World Scientific, Singapore, 2005).CrossRefGoogle Scholar
You have Access
2
Cited by

Save article to Kindle

To save this article to your Kindle, first ensure coreplatform@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

ASYMPTOTIC BEHAVIOUR OF RANDOM MARKOV CHAINS WITH TRIDIAGONAL GENERATORS
Available formats
×

Save article to Dropbox

To save this article to your Dropbox account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you used this feature, you will be asked to authorise Cambridge Core to connect with your Dropbox account. Find out more about saving content to Dropbox.

ASYMPTOTIC BEHAVIOUR OF RANDOM MARKOV CHAINS WITH TRIDIAGONAL GENERATORS
Available formats
×

Save article to Google Drive

To save this article to your Google Drive account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you used this feature, you will be asked to authorise Cambridge Core to connect with your Google Drive account. Find out more about saving content to Google Drive.

ASYMPTOTIC BEHAVIOUR OF RANDOM MARKOV CHAINS WITH TRIDIAGONAL GENERATORS
Available formats
×
×

Reply to: Submit a response

Please enter your response.

Your details

Please enter a valid email address.

Conflicting interests

Do you have any conflicting interests? *