Hostname: page-component-78c5997874-s2hrs Total loading time: 0 Render date: 2024-11-10T16:40:44.218Z Has data issue: false hasContentIssue false
  • English
  • Français

Stopping the maximum of a correlated random walk, with cost for observation

Part of: Sequential methods Stochastic processes

Published online by Cambridge University Press:  14 July 2016

Pieter Allaart
Pieter Allaart*
Affiliation:
University of North Texas
*
∗ Postal address: Mathematics Department, University of North Texas, PO Box 311430, Denton, TX 76203-1430, USA. Email address: allaart@unt.edu
Get access Rights & Permissions [Opens in a new window]

Abstract

Let (S n ) n≥0 be a correlated random walk on the integers, let M 0 ≥ S 0 be an arbitrary integer, and let M n = max{M 0, S 1,…, S n }. An optimal stopping rule is derived for the sequence M n - nc, where c > 0 is a fixed cost. The optimal rule is shown to be of threshold type: stop at the first time that M n - S n ≥ Δ, where Δ is a certain nonnegative integer. An explicit expression for this optimal threshold is given.

Keywords

Correlated random walkmomentumstopping ruleoptimality principlelinear difference equation

MSC classification

Primary: 60G40: Stopping times; optimal stopping problems; gambling theory 62L15: Optimal stopping
Secondary: 60G50: Sums of independent random variables; random walks
Type
Research Papers
Information
Journal of Applied Probability , Volume 41 , Issue 4 , December 2004 , pp. 998 - 1007
Copyright
Copyright © Applied Probability Trust 2004 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Allaart, P. C. (2004). Optimal stopping rules for correlated random walks with a discount. J. Appl. Prob. 41, 483–496.Google Scholar
Allaart, P. C., and Monticino, M. G. (2001). Optimal stopping rules for directionally reinforced processes. Adv. Appl. Prob. 33, 483–504.CrossRefGoogle Scholar
Chow, Y. S., Robbins, H., and Siegmund, D. (1971). Great Expectations: The Theory of Optimal Stopping. Houghton Mifflin, Boston, MA.Google Scholar
Ferguson, T. S., and MacQueen, J. B. (1992). Some time-invariant stopping rule problems. Optimization 23, 155–169.CrossRefGoogle Scholar
Gillis, J. (1955). Correlated random walk. Proc. Camb. Phil. Soc. 51, 639–651.CrossRefGoogle Scholar
Goldstein, S. (1951). On diffusion by discontinuous movements, and on the telegraph equation. Quart. J. Mech. 4, 129–156.CrossRefGoogle Scholar
Henderson, R., and Renshaw, E. (1980). Spatial stochastic models and computer simulation applied to the study of tree root systems. Compstat. 80, 389–395.Google Scholar
Kiefer, J., and Wolfowitz, J. (1956). On the characteristics of the general queueing process, with applications to random walk. Ann. Math. Statist. 27, 147–161.CrossRefGoogle Scholar
Mauldin, R. D., Monticino, M. G. and von Weizsäcker, H. (1996). Directionally reinforced random walks. Adv. Math. 117, 239–252.CrossRefGoogle Scholar
Mohan, C. (1955). The gambler's ruin problem with correlation. Biometrika 42, 486–493.Google Scholar
Mohanty, S. G. (1966). On a generalized two-coin tossing problem. Biometrische Z. 8, 266–272.Google Scholar
Renshaw, E., and Henderson, R. (1981). The correlated random walk. J. Appl. Prob. 18, 403–414.CrossRefGoogle Scholar