Hostname: page-component-cd9895bd7-dzt6s Total loading time: 0 Render date: 2024-12-30T20:35:31.929Z Has data issue: false hasContentIssue false
  • English
  • Français

A note on the first emptiness time of an infinite reservoir with inputs forming a Markov chain

Published online by Cambridge University Press:  14 July 2016

J. P. Lehoczky
J. P. Lehoczky*
Affiliation:
Carnegie-Mellon University
Get access Rights & Permissions [Opens in a new window]

Summary

The first emptiness time of an infinite reservoir with unit release and discrete input forming a stationary. Markov chain is investigated. The exact distribution of the first emptiness time is derived without the use of moment generating functions. The first and second moments of this distribution are given explicity. The close relationship between the process with stationary independent input and Markov chain input is emphasized.

The first moment of the area beneath the sample path up to first emptiness is computed. This area is often used as a measure of total delay in traffic flow theory.

Type
Research Papers
Information
Journal of Applied Probability , Volume 8 , Issue 2 , June 1971 , pp. 276 - 284
Copyright
Copyright © Applied Probability Trust 1971 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

[1] Ali Khan, M. S. and Gani, J. (1968) Infinite dams with inputs forming a Markov chain. J. Appl. Prob. 5, 72–84.Google Scholar
[2] Chung, K. L. (1967) Markov Chains with Stationary Transition Probabilities. Springer-Verlag, New York.Google Scholar
[3] Gani, J. (1969) A note on the first emptiness of dams with Markovian inputs. J. Math. Anal. Appl. 26, 270–274.CrossRefGoogle Scholar
[4] Gani, J. (1969) Recent advances in storage and flooding theory. Adv. Appl. Prob. 1, 90–110.Google Scholar
[5] Kendall, D. G. (1957) Some problems in the theory of dams. J. R. Statist. Soc. B 19, 207–212.Google Scholar
[6] Lehoczky, J. P. (1969) Stochastic models in traffic flow theory: intersection control. Technical Report, Stanford University.Google Scholar
[7] Lloyd, E. H. (1967) Stochastic reservoir theory. Advances in Hydroscience 4. Academic Press, New York.Google Scholar
[8] Lloyd, E. H. (1963) Reservoirs with serially correlated inflows. Technometrics 5, 85–93.Google Scholar
[9] Lloyd, E. H. (1963) A probability theory of reservoirs with serially correlated inputs. J. Hydrol. 1, 99–128.CrossRefGoogle Scholar
[10] Lloyd, E. H. (1963) The epochs of emptiness of a semi-infinite discrete reservoir. J. R. Statist. Soc. B 25, 131–136.Google Scholar
[11] Odoom, S. and Lloyd, E. H. (1965) A note on the equilibrium distribution of levels in a semi-infinite reservoir subject to Markovian inputs and unit withdrawals. J. Appl. Prob. 2, 215–222.CrossRefGoogle Scholar