Hostname: page-component-78c5997874-94fs2 Total loading time: 0 Render date: 2024-11-10T15:05:45.333Z Has data issue: false hasContentIssue false
  • English
  • Français

Conditioning an additive functional of a Markov chain to stay nonnegative. I. Survival for a long time

Part of: Markov processes Probability theory on algebraic and topological structures

Published online by Cambridge University Press:  01 July 2016

Saul D. Jacka ,
Zorana Lazic  and
Jon Warren
Saul D. Jacka*
Affiliation:
University of Warwick
Zorana Lazic*
Affiliation:
University of Warwick
Jon Warren*
Affiliation:
University of Warwick
*
∗ Postal address: Department of Statistics, University of Warwick, Coventry CV4 7AL, UK.
∗ Postal address: Department of Statistics, University of Warwick, Coventry CV4 7AL, UK.
∗ Postal address: Department of Statistics, University of Warwick, Coventry CV4 7AL, UK.
Rights & Permissions [Opens in a new window]

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the ‘Save PDF’ action button.

Let (Xt)t≥0 be a continuous-time irreducible Markov chain on a finite state space E, let v be a map v: E→ℝ\{0}, and let (φt)t≥0 be an additive functional defined by φt=∫0tv(Xs)d s. We consider the case in which the process (φt)t≥0 is oscillating and that in which (φt)t≥0 has a negative drift. In each of these cases, we condition the process (Xt,φt)t≥0 on the event that (φt)t≥0 is nonnegative until time T and prove weak convergence of the conditioned process as T→∞.

Keywords

Markov chainconditional lawweak convergencesurvival

MSC classification

Primary: 60J27: Continuous-time Markov processes on discrete state spaces
Secondary: 60B10: Convergence of probability measures
Type
General Applied Probability
Information
Advances in Applied Probability , Volume 37 , Issue 4 , December 2005 , pp. 1015 - 1034
Copyright
Copyright © Applied Probability Trust 2005 

References

Barlow, M. T., Rogers, L. C. G. and Williams, D. (1980). Wiener–Hopf factorization for matrices. In Seminar on Probability XIV (Lecture Notes Math. 784), Springer, Berlin, pp. 324–331.Google Scholar
Bertoin, J. and Doney, R. A. (1994). On conditioning a random walk to stay nonnegative. Ann. Prob. 22, 2152–2167.CrossRefGoogle Scholar
Cohen, J. C. (1981). Convexity of the dominant eigenvalue of an essentially nonnegative matrix. Proc. Amer. Math. Soc. 81, 656–658.Google Scholar
Feller, W. (1971). An Introduction to Probability Theory and Its Applications, Vol. 2. John Wiley, New York.Google Scholar
Iglehart, D. L. (1974). Random walks with negative drift conditioned to stay positive. J. Appl. Prob. 11, 742–751.CrossRefGoogle Scholar
Jacka, S. D. and Roberts, G. O. (1988). Conditional diffusions: their infinitesimal generators and limit laws. Res. Rep., Department of Res. Rep..Google Scholar
Jacka, S. D. and Roberts, G. O. (1997). On strong forms of weak convergence. Stoch. Process. Appl. 67, 41–53.CrossRefGoogle Scholar
Jacka, S. D. and Warren, J. (2002). Examples of convergence and non-convergence of Markov chains conditioned not to die. Electron. J. Prob. 7, 22 pp.CrossRefGoogle Scholar
Jacka, S. D., Lazic, Z. and Warren, J. (2005). Conditioning an additive functional of a Markov chain to stay nonnegative. II. Hitting a high level. Adv. Appl. Prob. 37, 1035–1055.CrossRefGoogle Scholar
Knight, F. B. (1969). Brownian local times and taboo processes. Trans. Amer. Math. Soc. 143, 173–185.CrossRefGoogle Scholar
Najdanovic, Z. (2003). Conditioning a Markov chain upon the behaviour of an additive functional. , University of Warwick.Google Scholar
Pinsky, R. G. (1985). On the convergence of diffusion processes conditioned to remain in a bounded region for large time to limiting positive recurrent diffusion processes. Ann. Prob. 13, 363–378.CrossRefGoogle Scholar
Seneta, E. (1981). Nonnegative Matrices and Markov Chains, 2nd edn. Springer, New York.CrossRefGoogle Scholar
Wilkinson, J. H. (1965). The Algebraic Eigenvalue Problem. Clarendon Press, Oxford.Google Scholar