The long-run average cost per unit time of operating a finite dam controlled by a policy (Lam Yeh (1985)) is determined when the cumulative input process is the integral of a Markov chain. A penalty cost which accrues continuously at a rate g(X(t)), where g is a bounded measurable function of the content, is also introduced. An example where the input rate is a two-state Markov chain is considered in detail to illustrate the computations.

The long-run average cost per unit time of operating a finite dam controlled by a PlM policy (Faddy (1974), Zuckerman (1977)) is determined when the cumulative input process is (a) a Wiener process with drift and (b) the integral of a Markov chain. It is shown how the cost for (a) can be obtained as the limit of the costs associated with a sequence of input processes of the type (b).

The method of invariant imbedding, used extensively in astrophysics and in neutron transport theory, is applied to the analysis of dams whose input rate is a finite state-space continuous-parameter Markov chain. Passage-time distributions are considered as functions of the dam capacity. When the release rate is constant the method yields first-order non-linear differential equations with initial conditions obtained from the easily derived behaviour of a dam with zero capacity. Solutions of these equations are given. Some possible correlation functions for the increments of the cumulative input process are examined when the underlying Markov chain is stationary. Finally the analysis is extended to deal with dams having content-dependent release-rate of the form