This paper is concerned with the problem of controlling a simple immigration–birth process, which represents a pest population, by the introduction of catastrophes which, when they occur, reduce the population size to zero. The optimality criterion is that of minimising the long-term average cost per unit time of the process. Firstly, an optimal policy is found within a restricted class of stationary policies, which introduce catastrophes if and only if the population size is greater than or equal to some critical value x. The optimality of this policy within the wider class of all stationary policies is then verified by applying the general results of Bather (1976).

The decision-maker drives a car along a straight highway towards his destination and looks for a parking place. When he finds a parking place, he can either park there and walk the distance to his destination or continue driving. Parking places are assumed to occur in accordance with a Poisson process along the highway. The decision-maker does not know the distance Y to his destination exactly in advance. Only an a priori distribution is assumed for Y and cases of typically important distribution are examined. When we take as loss the distance the decision-maker must walk and wish to minimize the expected loss, the optimal stopping rule and the minimum expected loss are obtained. In Section 3 a generalization to the cases of a non-homogeneous Poisson process and a renewal process is considered.

This paper is concerned with the problem of selecting the transition intensities for a Markov chain in continuous time so as to minimise the long-term average cost. Sufficient conditions are established for an optimal stationary policy using unbounded solutions of the optimality equation. This is a development of recent work on Markovian decision processes in discrete time. The theory is illustrated by considering a simple birth and death process with controlled immigration.