Hostname: page-component-cd9895bd7-dzt6s Total loading time: 0 Render date: 2024-12-28T00:07:12.188Z Has data issue: false hasContentIssue false
  • English
  • Français

The variance of duration of stay in an absorbing Markov process

Published online by Cambridge University Press:  14 July 2016

Philip F. Rust
Philip F. Rust*
Affiliation:
University of Missouri–Columbia
Get access Rights & Permissions [Opens in a new window]

Abstract

Given a stationary Markov process with s transient states and r absorbing states, a matrix infinite series solution is presented for the variance of duration of stay in state j within the interval [0, t), given initial state i. Closed forms are derived for absorbing states, and for transient states if eigenvalues are real and distinct. Several relationships among Markov matrices are presented.

Keywords

ABSORBING MARKOV PROCESSDURATION OF STAYSOJOURN TIMESVARIANCE
Type
Short Communications
Information
Journal of Applied Probability , Volume 15 , Issue 2 , June 1978 , pp. 420 - 425
Copyright
Copyright © Applied Probability Trust 1978 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Bellman, R. (1960) Introduction to Matrix Analysis. McGraw-Hill, New York.Google Scholar
Britney, R. R. (1974) The reliability of complex systems with dependent subsystem failures: An absorbing Markov chain model. Technometrics 16, 245–250.Google Scholar
Chiang, C. L. (1968) Introduction to Stochastic Processes in Biostatistics. Wiley, New York.Google Scholar
Howard, R. A. (1971) Dynamic Probabilistic Systems. Wiley, New York.Google Scholar
Kao, E. P. C. (1974) A note on the first two moments of times in transient states in a semi-Markov process. J. Appl. Prob. 11, 193–198.Google Scholar
Kemeny, J. G. and Snell, J. L. (1960) Finite Markov Chains. Van Nostrand, Princeton, N.J.Google Scholar
Rust, P. F. (1976) On the Estimation and Variances of Basic and Derived Parameters in a Continuous Time Markov Process with an Example. Ph.D. Thesis, University of California, Berkeley.Google Scholar
Takács, L. (1974) Sojourn time problems. Ann. Prob. 2, 420–431.CrossRefGoogle Scholar
Weiss, G. H. and Zelen, M. (1965) A semi-Markov model for clinical trials. J. Appl. Prob. 2, 269–285.CrossRefGoogle Scholar