Hostname: page-component-78c5997874-ndw9j Total loading time: 0 Render date: 2024-11-10T15:47:31.370Z Has data issue: false hasContentIssue false
  • English
  • Français

Simple derivations of properties of counting processes associated with Markov renewal processes

Part of: Markov processes Stochastic processes Special processes

Published online by Cambridge University Press:  14 July 2016

Frank Ball  and
Robin K. Milne
Frank Ball*
Affiliation:
The University of Nottingham
Robin K. Milne*
Affiliation:
The University of Western Australia
*
∗Postal address: School of Mathematical Sciences, The University of Nottingham, Nottingham NG7 2RD, UK. Email address: frank.ball@nottingham.ac.uk
∗∗Postal address: School of Mathematics and Statistics, The University of Western Australia, Crawley, WA 6009, Australia. Email address: milne@maths.uwa.edu.au
Rights & Permissions [Opens in a new window]

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the ‘Save PDF’ action button.

A simple, widely applicable method is described for determining factorial moments of N̂t, the number of occurrences in (0,t] of some event defined in terms of an underlying Markov renewal process, and asymptotic expressions for these moments as t → ∞. The factorial moment formulae combine to yield an expression for the probability generating function of N̂t, and thereby further properties of such counts. The method is developed by considering counting processes associated with events that are determined by the states at two successive renewals of a Markov renewal process, for which it both simplifies and generalises existing results. More explicit results are given in the case of an underlying continuous-time Markov chain. The method is used to provide novel, probabilistically illuminating solutions to some problems arising in the stochastic modelling of ion channels.

Keywords

Continuous-time Markov chaincounting processfactorial momentfactorial moment measureion channel modellingMarkov renewal processpoint processsemi-Markov processtime interval omission

MSC classification

Primary: 60K15: Markov renewal processes, semi-Markov processes
Secondary: 60G55: Point processes 60J27: Continuous-time Markov processes on discrete state spaces 60K20: Applications of Markov renewal processes (reliability, queueing networks, etc.)
Type
Research Papers
Information
Journal of Applied Probability , Volume 42 , Issue 4 , December 2005 , pp. 1031 - 1043
Copyright
© Applied Probability Trust 2005 

References

Asmussen, S. (2003). Applied Probability and Queues (Appl. Math. 51), 2nd edn. Springer, New York.Google Scholar
Ball, F. G. (1997). Empirical clustering of bursts of openings in Markov and semi-Markov models of single channel gating incorporating time interval omission. Adv. Appl. Prob. 29, 909–946.Google Scholar
Ball, F. G. and Davies, S. S. (1997). Clustering of bursts of openings in Markov and semi-Markov models of single channel gating. Adv. Appl. Prob. 29, 92–113.Google Scholar
Ball, F. G. and Sansom, M. S. P. (1987). Temporal clustering of ion channel openings incorporating time interval omission. IMA J. Math. Appl. Med. Biol. 4, 333–361.Google Scholar
Ball, F. G., Milne, R. K. and Yeo, G. F. (1993). On the exact distribution of observed open times in single ion channel models. J. Appl. Prob. 30, 529–537.Google Scholar
Ball, F. G., Milne, R. K. and Yeo, G. F. (1994). Continuous-time Markov chains in a random environment, with applications to ion channel modelling. Adv. Appl. Prob. 26, 919–946.CrossRefGoogle Scholar
Bellman, R. (1970). Introduction to Matrix Analysis, 2nd edn. McGraw-Hill, New York.Google Scholar
Çinlar, E. (1969). Markov renewal theory. Adv. Appl. Prob. 1, 123–187.Google Scholar
Çinlar, E. (1975a). Introduction to Stochastic Processes. Prentice-Hall, Englewood Cliffs, NJ.Google Scholar
Çinlar, E. (1975b). Markov renewal theory: a survey. Manag. Sci. 31, 727–752.Google Scholar
Colquhoun, D. and Hawkes, A. G. (1982). On the stochastic properties of bursts of single ion channel openings and of clusters of bursts. Phil. Trans. R. Soc. London B 300, 1–59.Google Scholar
Csenki, A. (1991). Some renewal-theoretic investigations in the theory of sojourn times in finite Markov processes. J. Appl. Prob. 28, 822–832.Google Scholar
Csenki, A. (1994). Dependability for Systems with a Partitioned State Space. Markov and Semi-Markov Theory and Computational Implementation (Lecture Notes Statist. 90). Springer, New York.Google Scholar
Csenki, A. (1995). The number of visits to a subset of the state space by a discrete-parameter semi-Markov process. Statist. Prob. Lett. 22, 71–77.Google Scholar
Daley, D. J. and Vere-Jones, D. (2003). An Introduction to the Theory of Point Processes, Vol 1, Elementary Theory and Methods, 2nd edn. Springer, New York.Google Scholar
Darroch, J. N. and Morris, K. W. (1967). Some passage-time generating functions for discrete-time and continuous-time finite Markov chains. J. Appl. Prob. 4, 496–507.Google Scholar
Hawkes, A. G., Jalali, A. and Colquhoun, D. (1990). The distributions of the apparent open times and shut times in a single channel record when brief events cannot be detected. Phil. Trans. R. Soc. London A 332, 511–538.Google Scholar
Hunter, J. J. (1969). On the moments of Markov renewal processes. Adv. Appl. Prob. 1, 188–210.CrossRefGoogle Scholar
Keilson, J. (1969). On the matrix renewal function for Markov renewal processes. Ann. Math. Statist. 40, 1901–1901.Google Scholar
Keilson, J. (1979). Markov Chain Models—Rarity and Exponentiality. Springer, New York.CrossRefGoogle Scholar
Kemeny, J. G. and Snell, J. L. (1976). Finite Markov Chains. Springer, New York.Google Scholar
Masuda, Y. and Sumita, U. (1987). Analysis of a counting process associated with a semi-Markov process: number of entries into a subset of the state space. Adv. Appl. Prob. 19, 767–783.Google Scholar
Neuts, M. (1995). Algorithmic Probability: a Collection of Problems. Chapman and Hall, London.Google Scholar
Zheng, Q. (2001). On the dispersion index of a Markovian molecular clock. Math. Biosci. 172, 115–128.Google Scholar