We compare a general controlled diffusion process with a deterministic systemwhere a second controller drives the disturbance against the firstcontroller. We show that the two models are equivalent withrespect to two properties: the viability (or controlledinvariance, or weak invariance) of closed smooth sets, and theexistence of a smooth control Lyapunov function ensuring thestabilizability of the system at an equilibrium.


Let (S n ) n≥0 be a correlated random walk on the integers, let M 0 ≥ S 0 be an arbitrary integer, and let M n = max{M 0, S 1,…, S n }. An optimal stopping rule is derived for the sequence M n - nc, where c > 0 is a fixed cost. The optimal rule is shown to be of threshold type: stop at the first time that M n - S n ≥ Δ, where Δ is a certain nonnegative integer. An explicit expression for this optimal threshold is given.

Optimal stopping rules are developed for the correlated random walk when future returns are discounted by a constant factor per unit time. The optimal rule is shown to be of dual threshold form: one threshold for stopping after an up-step, and another for stopping after a down-step. Precise expressions for the thresholds are given for both the positively and the negatively correlated cases. The optimal rule is illustrated by several numerical examples.