We consider a single-server queueing system at which customers arrive according to a Poisson process. The service times of the customers are independent and follow a Coxian distribution of order r. The system is subject to costs per unit time for holding a customer in the system. We give a closed-form expression for the average cost and the corresponding value function. The result can be used to derive nearly optimal policies in controlled queueing systems in which the service times are not necessarily Markovian, by performing a single step of policy iteration. We illustrate this in the model where a controller has to route to several single-server queues. Numerical experiments show that the improved policy has a close-to-optimal value.

For a class of renewal queueing processes characterized by a rational Laplace–Stieltjes transform of the arrival inter-occurrence time distribution, the Laplace–Stieltjes transform of the equilibrium (actual) waiting time distribution is re-expressed in a manner which facilitates explicit inversion under certain conditions. The results are of interest in other contexts as well, as for example in insurance ruin theory. Various analytic properties of these quantities are then obtained as a result.

One result that is of both theoretical and practical importance regarding point processes is the method of thinning. The basic idea of this method is that under some conditions, there exists an embedded Poisson process in any point process such that all its arrival points form a sub-sequence of the Poisson process. We extend this result by showing that on the embedded Poisson process of a uni- or multi-variable marked point process in which interarrival time distributions may depend on the marks, one can define a Markov chain with a discrete state that characterizes the stage of the interarrival times. This implies that one can construct embedded Markov chains with countable state spaces for the state processes of many practical systems that can be modeled by such point processes.