This paper studies a revenue management problem in which a finite number of substitutable commodities are sold to two different market segments at respective prices. It is required that a certain number of commodities are reserved for the high-price segment to ensure a minimum service level. The two segments are served concurrently at the beginning of the season. To improve revenues, management may choose to close the low-price segment at a time when the chance of selling all items at the high price is promising. The difficulty is determining when such a decision should be made. We derive the exact solution in closed form using the theory of optimal stopping time. We show that the optimal decision is made in reference to a sequence of thresholds in time. These time thresholds take both remaining sales season and inventory into account and exhibit a useful monotone property.

In this paper, optimal stopping problems for semi-Markov processes are studied in a fairly general setting. In such a process transitions are made from state to state in accordance with a Markov chain, but the amount of time spent in each state is random. The times spent in each state follow a general renewal process. They may depend on the present state as well as on the state into which the next transition is made.

Our goal is to maximize the expected net return, which is given as a function of the state at time t minus some cost function. Discounting may or may not be considered. The main theorems (Theorems 3.5 and 3.11) are expressions for the optimal stopping time in the undiscounted and discounted case. These theorems generalize results of Zuckerman [16] and Boshuizen and Gouweleeuw [3]. Applications are given in various special cases.

The results developed in this paper can also be applied to semi-Markov shock models, as considered in Taylor [13], Feldman [6] and Zuckerman [15].

A device is subject to a sequence of shocks occurring randomly at times n = 1, 2, ⃛. At each point in time, shocks occur according to a Poisson distribution with parameter λ. Shocks cause damage and damage accumulates additively. They can cause the device to fail, and the probability of such a failure depends on the accumulated damage. Failure occurs because of shocks and can occur only at times n = 1, 2, ⃛. The device can be replaced before or at failure. If the device fails it is immediately replaced at a fixed cost. Replacement before failure can only occur at times n = 1, 2, ⃛, and is done at a lower cost depending on the amount of accumulated damage at replacement. In this paper we determine the optimal replacement policy that minimizes the expected cost per unit time.

The optimality of the one step look-ahead stopping rule is shown to hold under conditions different from those discussed by Chow, Robbins and Seigmund [5]. These results are corollaries of the following theorem: Let {Xn, n = 0, 1, …}; X0 = x be a discrete-time homogeneous Markov process with state space (E, ℬ). For any ℬ-measurable function g and α in (0, 1], define Aαg(x) = αExg(X1) – g(x) to be the infinitesimal generator of g. If τ is any stopping time satisfying the conditions: Ex[αNg(XN)I(τ > N)]→0 as as N → ∞, then Applications of the results are considered.