In clinical trials with two treatment arms, Efron's biased coin design, Efron (1971), sequentially assigns a patient to the underrepresented arm with probability p > ½. Under this design the proportion of patients in any arm converges to ½, and the convergence rate is n-1, as opposed to n-½ under some other popular designs. The generalization of Efron's design to K ≥ 2 arms and an unequal target allocation ratio (q1, . . ., qK) can be found in some papers, most of which determine the allocation probabilities ps in a heuristic way. Nonetheless, it has been noted that by using inappropriate ps, the proportion of patients in the K arms never converges to the target ratio. We develop a general theory to answer the question of what allocation probabilities ensure that the realized proportions under a generalized design still converge to the target ratio (q1, . . ., qK) with rate n-1.

This paper considers Markov decision processes (MDPs) with unbounded rates, as a function of state. We are especially interested in studying structural properties of optimal policies and the value function. A common method to derive such properties is by value iteration applied to the uniformised MDP. However, due to the unboundedness of the rates, uniformisation is not possible, and so value iteration cannot be applied in the way we need. To circumvent this, one can perturb the MDP. Then we need two results for the perturbed sequence of MDPs: 1. there exists a unique solution to the discounted cost optimality equation for each perturbation as well as for the original MDP; 2. if the perturbed sequence of MDPs converges in a suitable manner then the associated optimal policies and the value function should converge as well. We can model both the MDP and perturbed MDPs as a collection of parametrised Markov processes. Then both of the results above are essentially implied by certain continuity properties of the process as a function of the parameter. In this paper we deduce tight verifiable conditions that imply the necessary continuity properties. The most important of these conditions are drift conditions that are strongly related to nonexplosiveness.