Hostname: page-component-cd9895bd7-8ctnn Total loading time: 0 Render date: 2024-12-27T21:10:16.377Z Has data issue: false hasContentIssue false

Conditions for the non-ergodicity of Markov chains with application to a communication system

Published online by Cambridge University Press:  14 July 2016

Linn I. Sennott*
Affiliation:
Illinois State University
*
Postal address: Department of Mathematics, Illinois State University, Normal, IL 61761, USA.

Abstract

We obtain a sufficient condition for the transience of a Markov chain, and a sufficient condition for its null recurrence. These are applied to characterize the stability of a multiple-access communication system. Performance bounds for the system are also obtained.

Type
Research Papers
Copyright
Copyright © Applied Probability Trust 1987 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Fayolle, G., Gelenbe, E. and Labetoulle, J. (1977) Stability and optimal control of the packet switching broadcast channel. J. Assoc. Comput. Mach. 24, 375386.Google Scholar
Foster, F. G. (1953) On stochastic matrices associated with certain queueing processes. Ann. Math. Statist. 24, 355360.CrossRefGoogle Scholar
Kaplan, M. (1979) A sufficient condition for nonergodicity of a Markov chain. IEEE Trans. Inf. Theory 25, 470471.Google Scholar
Mertens, J.-F., Samuel-Cahn, E. and Zamir, S. (1978) Necessary and sufficient conditions for recurrence and transience of Markov chains in terms of inequalities. J. Appl. Prob. 15, 848851.CrossRefGoogle Scholar
Pakes, A. G. (1969) Some conditions for ergodicity and recurrence of Markov chains. Operat. Res. 17, 10581061.Google Scholar
Rosenkrantz, W. and Towsley, D. (1983) On the instability of slotted ALOHA multiaccess algorithm. IEEE Trans. Auto. Control 28, 994996.Google Scholar
Sennott, L. Humblet, P. and Tweedie, R. (1983) Mean drifts and the non-ergodicity of Markov chains. Operat. Res. 31, 783789.Google Scholar
Szpankowski, W. (1985) Some sufficient conditions for non-ergodicity of Markov chains. J. Appl. Prob. 22, 138147.Google Scholar
Tweedie, R. (1975) Relations between ergodicity and mean drift for Markov chains. Austral. J. Statist 17, 96106.Google Scholar