Skip to main content Accessibility help
×
Hostname: page-component-7479d7b7d-m9pkr Total loading time: 0 Render date: 2024-07-12T08:22:58.582Z Has data issue: false hasContentIssue false

14 - Semi-Markov and Markov Regenerative Models

from Part IV - State-Space Models with Non-Exponential Distributions

Published online by Cambridge University Press:  30 August 2017

Kishor S. Trivedi
Affiliation:
Duke University, North Carolina
Andrea Bobbio
Affiliation:
Università degli Studi del Piemonte Orientale, Italy
Get access

Summary

Image of the first page of this content. For PDF version, please use the ‘Save PDF’ preceeding this image.'
Type
Chapter
Information
Reliability and Availability Engineering
Modeling, Analysis, and Applications
, pp. 509 - 550
Publisher: Cambridge University Press
Print publication year: 2017

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

[1] R., Pyke, “Markov renewal processes: Definitions and preliminary properties,Annals of Mathematical Statistics, vol. 32, pp. 1231–1242, 1961.Google Scholar
[2] R., Pyke, “Markov renewal processes with finitely many states,Annals of Mathematical Statistics, vol. 32, pp. 1243–1259, 1961.Google Scholar
[3] E., Cinlar, Introduction to Stochastic Processes. Prentice-Hall, 1975.
[4] Y., Cao, H., Sun, K., Trivedi, and J., Han, “System availability with non-exponentially distributed outages,IEEE Transactions on Reliability, vol. 51, no. 2, pp. 193–198, Jun. 2002.Google Scholar
[5] J., Girtler, “The semi-Markov model of the process of appearance of sea-going ship propulsion system ability and inability states in application to determining the reliablity of these systems,Polish Maritime Research, vol. 20, no. 4, pp. 18–24, Dec. 2013.Google Scholar
[6] D., Chen and K., Trivedi, “Analysis of periodic preventive maintenance with general system failure distribution,” in Proc. Pacific Rim Int.Symp. on Dependable Computing (PRDC), 2001, pp. 103–107.Google Scholar
[7] R., Barlow and R., Campo, “Total time on test processes and application to failure data analysis,” Research report No. ORC 75-8, University of California, 1975.
[8] J., Zhao, Y., Wang, G., Ning, K. S., Trivedi, R., Matias, and K., Cai, “A comprehensive approach to optimal software rejuvenation,Performance Evaluation, vol. 70, no. 11, pp. 917–933, 2013.Google Scholar
[9] R Core Team, R: A Language and Environment for Statistical Computing, R Foundation for Statistical Computing, Vienna, Austria, 2012. [Online]. Available: www.R-project.org/
[10] G., Ciardo, J., Muppala, and K., Trivedi, “On the solution of GSPN reward models,Performance Evaluation, vol. 12, pp. 237–253, 1991.Google Scholar
[11] C., Hirel, B., Tuffin, and K. S., Trivedi, “SPNP: Stochastic Petri Nets. Version 6,” in Proc. Int. Conf. on Computer Performance Evaluation: Modelling Techniques and Tools (TOOLS 2000), eds. B., Haverkort and H., Bohnenkamp, LNCS 1786, Springer Verlag, 2000, pp. 354–357.
[12] L., Yin, R., Fricks, and K., Trivedi, “Application of semi-Markov process and CTMC to evaluation of UPS system availability,” in Proc. Reliability and Maintainability Symp., 2002, pp. 584–591.Google Scholar
[13] A., Pievatolo and I., Valadè, “﹛UPS﹜ reliability analysis with non-exponential duration distribution,Reliability Engineering and System Safety, vol. 81, no. 2, pp. 183–189, 2003.Google Scholar
[14] B. B., Madan, K., Goševa-Popstojanova, K., Vaidyanathan, and K. S., Trivedi, “A method for modeling and quantifying the security attributes of intrusion tolerant systems,Performance Evaluation, vol. 56, pp. 167–186, 2004.Google Scholar
[15] K., Vaidyanathan and K., Trivedi, “A comprehensive model for software rejuvenation,IEEE Transactions on Dependable and Secure Computing, vol. 2, no. 2, pp. 124–137, Apr. 2005.Google Scholar
[16] Y., Huang, C. M. R., Kintala, N., Kolettis, and N. D., Fulton, “Software rejuvenation: Analysis, module and applications,” in Proc. Int. Symp. on Fault-Tolerant Computing (FTCS), 1995, pp. 381–390.Google Scholar
[17] S., Garg, A., vanMoorsel, K., Vaidyanathan, and K., Trived, “A methodology for detection and estimation of software aging,” in Proc. 9th Intl. Symp. on Software Reliability Engineering, 1998, pp. 282–292.Google Scholar
[18] J., Hartigan, Clustering Algorithms. John Wiley & Sons, 1975.
[19] W., Xie, Y., Hong, and K., Trivedi, “Analysis of a two-level software rejuvenation policy,Reliability Engineering and System Safety, vol. 87, no. 1, pp. 13–22, 2005.Google Scholar
[20] A., Bobbio, M., Sereno, and C., Anglano, “Fine-grained software degradation models for optimal rejuvenation policies,” Performance Evaluation, vol. 46, pp. 45–62, Sep. 2001.Google Scholar
[21] J., Alonso, R., Matias, E., Vicente, A., Maria, and K. S., Trivedi, “A comparative experimental study of software rejuvenation overhead,Performance Evaluation, vol. 70, no. 3, pp. 231–250, 2013.Google Scholar
[22] X., Yin, X., Ma, and K., Trivedi, “An interacting stochastic models approach for the performance evaluation of DSRC vehicular safety communication,IEEE Transactions on Computers, vol. 62, no. 5, pp. 873–885, May 2013.Google Scholar
[23] B. R., Haverkort, R., Marie, G., Rubino, and K. S., Trivedi (eds.), Performability Modelling: Techniques and Tools. John Wiley & Sons, 2001.
[24] R., Smith, K., Trivedi, and A., Ramesh, “Performability analysis: Measures, an algorithm and a case study,IEEE Transactions on Computers, vol. C-37, pp. 406–417, 1988.Google Scholar
[25] E. P. C., Kao, “A note on the first two moments of times in transient states in a semi-Markov process,” Journal of Applied Probability, vol. 11, no. 1, pp. pp. 193–198, 1974.Google Scholar
[26] J. G., Kemeny and J. L., Snell, Finite Markov Chains: With a New Appendix “Generalization of a Fundamental Matrix.” Springer, 12 1983.
[27] K., Trivedi, Probability and Statistics with Reliability, Queueing and Computer Science Applications, 2nd edn. John Wiley & Sons, 2001.
[28] Y., Ma, J., Han, and K., Trivedi, “Transient analysis of minimum duration outage for RF channel in cellular systems,” in IEEE Vehicular Technology Conference, vol. 2, Jul. 1999, pp. 1698–1702.Google Scholar
[29] N. B., Mandayam, P. C., Chen, and J., Holtzman, “Minimum duration outage for cellular systems: A level crossing analysis,” in Proc. IEEE 46th Vehicular Technology Conf., 1996. Mobile Technology for the Human Race, vol. 2, Apr. 1996, pp. 879–883.Google Scholar
[30] M., Grottke, D. S., Kim, R. K., Mansharamani, M. K., Nambiar, R., Natella, and K. S., Trivedi, “Recovery from software failures caused by Mandelbugs,IEEE Transactions on Reliability, vol. 65, no. 1, pp. 70–87, 2016.Google Scholar
[31] M., Grottke and K. S., Trivedi, “Fighting bugs: Remove, retry, replicate, and rejuvenate,IEEE Computer, vol. 40, no. 2, pp. 107–109, 2007.Google Scholar
[32] U., Bhat and G. K., Miller, Elements of Applied Stochastic Processes, 3rd edn. John Wiley & Sons, 2002.
[33] C., Davis, “The norm of the Schur product operation,Numerische Mathematik, vol. 4, no. 1, pp. 343–344, 1962.Google Scholar
[34] B., Margolis, SOA for the Business Developer: Concepts, BPEL, and SCA. MC Press, LLC, 2007.
[35] L., Gönczy, S., Chiaradonna, F. D., Giandomenico, A., Pataricza, A., Bondavalli, and T., Bartha, Dependability Evaluation of Web Service-Based Processes. Springer, 2006, pp. 166–180.
[36] S., Gokhale and K. S., Trivedi, “Reliability prediction and sensitivity analysis based on software architecture,” in Proc. 13th Int, Symp. on Software Reliability Engineering (ISSRE), 2002, pp. 64–78.Google Scholar
[37] S., Gokhale, “Quantifying the variance in application reliability,” in Proc. 10th IEEE Pacific Rim Int. Symp. on Dependable Computing (PRDC 2004), 2004, pp. 113–121.Google Scholar
[38] Z., Zheng, K., Trivedi, K., Qiu, and R., Xia, “Semi-Markov models of composite web services for their performance, reliability and bottlenecks,” IEEE Transactions on Services Computing, vol. 6, no. 1, 2016.Google Scholar
[39] J., Medhi, Stochastic Processes. New Age International, 1994.
[40] G., Ciardo, R., Marie, B., Sericola, and K., Trivedi, “Performability analysis using semi-Markov reward processes,IEEE Transactions on Computers, vol. 39, no. 10, pp. 1252–1264, 1990.Google Scholar
[41] V. G., Kulkarni, Modeling and Analysis of Stochastic Systems. Chapman & Hall, 1995.
[42] R., Fricks, M., Telek, A., Puliafito, and K., Trivedi, “Markov renewal theory applied to performability evaluation,” in Modeling and Simulation of Advanced Computer Systems: Applications and Systems, ser. State-of-the Art in Performance Modeling and Simulation, eds. K., Bagchi and G., Zobrist. Gordon and Breach Publishers, 1996, ch. 11, pp. 193–236.
[43] A., Bobbio, A., Puliafito, and M., Telek, “A modeling framework to implement preemption policies in non-Markovian SPN,IEEE Transactions Software Engineering, vol. 26, pp. 36–54, 2000.Google Scholar
[44] H., Choi, V., Kulkarni, and K., Trivedi, “Transient analysis of deterministic and stochastic Petri nets,” in Application and Theory of Petri Nets 1993, ser. Lecture Notes in Computer Science, ed. M. Ajmone, Marsan, vol. 691. Springer, 1993, pp. 166–185.
[45] D., Jagerman, “An inversion technique for the Laplace transform,” The Bell System Technical Journal, vol. 61, pp. 1995–2002, Oct. 1982.Google Scholar
[46] P., Chimento and K., Trivedi, “The completion time of programs on processors subject to failure and repair,IEEE Transactions on Computers, vol. 42, pp. 1184–1194, 1993.Google Scholar
[47] A., Bobbio and M., Telek, “Computational restrictions for SPN with generally distributed transition times,” in First European Dependable Computing Conf. (EDCC-1), LNCS 852, eds. D. H. K., Echtle and D., Powell. Springer Verlag, 1994, pp. 131–148.
[48] H., Choi, V., Kulkarni, and K., Trivedi, “Markov regenerative stochastic Petri nets,Performance Evaluation, vol. 20, pp. 337–357, 1994.Google Scholar
[49] R., German, D., Logothetis, and K., Trivedi, “Transient analysis of Markov regenerative stochastic Petri nets: A comparison of approaches,” in Proc. 6th Int. Conf. on Petri Nets and Performance Models, PNPM95. IEEE Computer Society, 1995, pp. 103–112.
[50] S., Dharmaraja, K. S., Trivedi, and D., Logothetis, “Performance modelling of wireless networks with generally distributed hand-off interarrival times,Computer Communications, vol. 26, pp. 1747–1755, 2003.Google Scholar
[51] R., German, Performance Analysis of Communication Systems: Modeling with Non-Markovian Stochastic Petri Nets. John Wiley & Sons, 2000.
[52] D., Logothetis and K. S., Trivedi, “Transient analysis of the leaky bucket rate control scheme under poisson and ON–OFF sources,” in Proc. IEEE INFOCOM '94, 13th Annual Joint Conf. of the IEEE Computer and Communications Societies, 1994, pp. 490–497.Google Scholar
[53] D., Logothetis and K. S., Trivedi, “The effect of detection and restoration times on error recovery in communication networks,Journal of Network System Management, vol. 5, no. 2, pp. 173–195, 1997.Google Scholar
[54] W., Xie, H., Sun, Y., Cao, and K. S., Trivedi, “Modeling of user perceived webserver availability,” in Proc. IEEE Int. Conf. on Communications, 2003, pp. 1796–1800.Google Scholar
[55] D., Logothetis and K. S., Trivedi, “Time-dependent behavior of redundant systems with deterministic repair,” in Proc. 2nd Int. Workshop on the Numerical Solution of Markov Chains, ed. W. J., Stewart. Kluwer Acedemic Publishers, 1995.
[56] K., Vaidyanathan, S., Dharmaraja, and K. S., Trivedi, “Analysis of inspection-based preventive maintenance in operational software systems,” in Proc. 21st Symp. on Reliable Distributed Systems, 2002, pp. 286–295.Google Scholar
[57] D., Wang, W., Xie, and K. S., Trivedi, “Performability analysis of clustered systems with rejuvenation under varying workload,Performance Evaluation, vol. 64, no. 3, pp. 247–265, 2007.Google Scholar
[58] D., Logothetis, V., Mainkar, and K. S., Trivedi, “Transient analysis of non-Markovian queues via Markov regenerative processes,” in Probability Models and Statistics: A. J. Medhi Festschrift, eds. A. C., Borthakur and H., Choudhury. New Age International Limited, 1996, pp. 109–131.
[59] R., Howard, Dynamic Probabilistic Systems, Volume II: Semi-Markov and Decision Processes. John Wiley & Sons, 1971.
[60] N., Limnios and G., Oprisan, Semi-Markov Processes and Reliability. Birkhäuser Engineering, 2001.
[61] A., Bobbio and L., Roberti, “Distribution of the minimal completion time of parallel tasks in multi-reward semi-Markov models,Performance Evaluation, vol. 14, pp. 239–256, 1992.Google Scholar
[62] G., Rubino and B., Sericola, “Sojourn times in semi-Markov reward processes: Application to fault-tolerant systems modeling,Reliability Engineering and System Safety, vol. 41, no. 1, pp. 1–4, 1993.Google Scholar
[63] M., Carravetta, R. D., Dominicis, and M., D'Esposito, “Semi-Markov processes in modelling and reliability: A new approach,Applied Mathematical Modelling, vol. 5, no. 4, pp. 269–274, 1981.Google Scholar
[64] A., Bobbio and M., Telek, “Markov regenerative SPN with non-overlapping activity cycles,” in Int. Computer Performance and Dependability Symp., IPDS95. IEEE Computer Society Press, 1995, pp. 124–133.
[65] R., German, A. van, Moorsel, M., Qureshi, and W., Sanders, “Expected impulse rewards in Markov regenerative stochastic Petri nets,” in Application and Theory of Petri Nets, Lecture Notes in Computer Science, vol. 1091, eds. J., Billington and W., Reisig. Springer, 1996, pp. 172–191.
[66] L., Malhis and W., Sanders, “An efficient two-stage iterative method for the steady-state analysis of Markov regenerative stochastic Petri net models,Performance Evaluation, vol. 27–28, pp. 583–601, 1996.Google Scholar
[67] A., Bobbio, A., Puliafito, M., Telek, and K., Trivedi, “Recent developments in non-Markovian stochastic Petri nets,Journal of Systems Circuits and Computers, vol. 8, no. 1, pp. 119–158, Feb. 1998.Google Scholar

Save book to Kindle

To save this book to your Kindle, first ensure coreplatform@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×