Consider the GI/G/1 queue in which the interarrival/service times are parameterized. The derivatives (with respect to the parameter) of the expected delay of the nth job and its limit are derived and expressed in terms of the expectation of certain stochastic derivatives. Applications of these derivatives in stochastic optimization and random walk are illustrated.

There are described in the literature many spaces of what are variously described as generalized functions, distributions, or improper functions. This article introduces another. The new space is like that of M. J. Lighthill in containing the Fourier transform of every element and in having a particularly simple theory of trigonometric and Fourier series; also it is constructed in a somewhat similar way. The new space breaks away from the tradition of every element being, for some n, the nth derivative of an ordinary function, and, for example, the exponential function and its Fourier transform are in the space.

A carrier-borne epidemic is considered in which the carriers, subject to a death process, infect susceptibles by random allocation rather than the classical homogeneous mixing process. An explicit solution for the probability generating function (p.g.f.) of the process is obtained, and a probabilistic analysis of carrier models provided. The sizes and durations of the random allocation and classical carrier epidemics are compared. The strongest comparisons concern sample path results based on the probabilistic analysis; this also gives a sounder basis for computational work.

In this paper, we develop the probabilistic foundations of the dynamic continuous choice problem. The underlying choice set is a compact metric space E such as the unit interval or the unit square. At each time point t, utilities for alternatives are given by a random function . To achieve a model of dynamic continuous choice, the theory of classical vector-valued extremal processes is extended to super-extremal processesY= {Yt, t > 0}. At any t > 0, Yt is a random upper semicontinuous function on a locally compact, separable, metric space E. General path properties of Y are discussed and it is shown that Y is Markov with state-space US(E). For each t > 0, Yt is associated.

For a compact metric E, we consider the argmax process M = {Mt, t > 0}, where . In the dynamic continuous choice application, the argmax process M represents the evolution of the set of random utility maximizing alternatives. M is a closed set-valued random process, and its path properties are investigated.

We show that the horizontal position of a random walk on a two-dimensional anisotropic lattice converges weakly to a diffusion process.

In this paper we consider a network of queues with batch services, customer coalescence and state-dependent signaling. That is, customers are served in batches at each node, and coalesce into a single unit upon service completion. There are signals circulating in the network and, when a signal arrives at a node, a batch of customers is either deleted or triggered to move as a single unit within the network. The transition rates for both customers and signals are quite general and can depend on the state of the whole system. We show that this network possesses a product form solution. The existence of a steady state distribution is also discussed. This result generalizes some recent results of Henderson et al. (1994), as well as those of Chao et al. (1996).

At which (random) sample size will every population element have been drawn at least m times? This special coupon collector's problem is often referred to as the Dixie cup problem. Some asymptotic properties of the Dixie cup problem with unequal sampling probabilities are described.

We study the existence of moments and the tail behavior of the densities of storage processes. We give sufficient conditions for existence and nonexistence of moments using the integrability conditions of submultiplicative functions with respect to Lévy measures. We then study the asymptotical behavior of the tails of these processes using the concave or convex envelope of the release rate function.

This article studies the expected occupancy probabilities on an alphabet. Unlike the standard situation, where observations are assumed to be independent and identically distributed, we assume that they follow a regime-switching Markov chain. For this model, we (1) give finite sample bounds on the expected occupancy probabilities, and (2) provide detailed asymptotics in the case where the underlying distribution is regularly varying. We find that in the regularly varying case the finite sample bounds are rate optimal and have, up to a constant, the same rate of decay as the asymptotic result.

We consider the adaptive control of Markov chains under the weak accessibility condition with a view to minimizing the learning loss. A certainty equivalence control with a forcing scheme is constructed. We use a stationary randomized control scheme for forcing and compute a maximum likelihood estimate of the unknown parameter from the resulting observations. We obtain an exponential upper bound on the rate of decay of the probability of error. This allows us to choose the rate of forcing appropriately, whereby we achieve a o(f(n) log n) learning loss for any function as .

In this paper, we study the classification of matrix GI/M/1-type Markov chains with a tree structure. We show that the Perron–Frobenius eigenvalue of a Jacobian matrix provides information for classifying these Markov chains. A fixed-point approach is utilized. A queueing application is presented to show the usefulness of the classification method developed in this paper.

We define a new family of multivariate stochastic processes over a finite time horizon that we call generalised Liouville processes (GLPs). GLPs are Markov processes constructed by splitting Lévy random bridges into non-overlapping subprocesses via time changes. We show that the terminal values and the increments of GLPs have generalised multivariate Liouville distributions, justifying their name. We provide various other properties of GLPs and some examples.

In this paper, we consider Galton–Watson trees conditioned by size. We show that the number of k-ancestors (ancestors that have k children) of a node u is (almost) proportional to its depth. The k, j-ancestors are also studied. The methods rely on the study of ladder variables on an associated random walk. We also give an application to finite branching random walks.

By an argument which involves matching sample paths, some useful equations for the probability distribution of the fundamental period in the MAP/G/1 queue are derived with less calculational effort than in earlier proofs. It is further shown that analogous equations hold for the MAP/SM/1 queueing model. These results are then used to derive explicit formulas for the mean vectors of the number served during and the duration of the fundamental period.

We derive the Laplace transforms of sums and weighted sums of random variables forming a Markov chain whose stationary distribution is gamma. Both seasonal and non-seasonal cases are considered. The results are applied to two problems in stochastic reservoir theory.

A security of supply model for energy is described. The energy demand is a non-random periodic function of time and the supply model is a continuous-time Markov chain. Asymptotic normality is proved for the two important reliability quantities: the amount of energy not supplied and the time the demand is not met within a time interval.

Results on asymptotic normality for the maximum likelihood estimate in hidden Markov models are extended in two directions. The stationarity assumption is relaxed, which allows for a covariate process influencing the hidden Markov process. Furthermore, a class of estimating equations is considered instead of the maximum likelihood estimate. The basic ingredients are mixing properties of the process and a general central limit theorem for weakly dependent variables.

In this note, a representation, originally due to Smith, of the stationary waiting time distribution in the queue GI/G/1 is obtained under the least restrictive conditions possible.