We provide an algorithm to find the value and an optimal strategy of the Ten Thousand dice game solitaire variant in the framework of Markov control processes. Once an optimal critical threshold is found, the set of nonstopping states of the game becomes finite and the solution is found by a backwards algorithm that gives the values for each one of these states of the game. The algorithm is finite and exact. The strategy to find the critical threshold comes from the continuous pasting condition used in optimal stopping problems for continuous-time processes with jumps.

Results similar to those in [3] are obtained for one-dimensional diffusion processes with discounted cost. The stronger assumption that at least one of the inaccessible boundaries is natural enables us to identify the solution of a differential equation corresponding to the future expected cost function.

To optimize the performance of an M/M/s queue, Moder and Phillips [1] have studied the problem in which there are always n1 open counters ready to offer service. The actual number of open counters increases by one, up to a maximum n2, every time the number of waiting customers exceeds a certain critical number; it decreases by one every time the queue length becomes smaller than another critical number.

We follow the terminology of Khintchine's monograph [4].

Let us consider a random stream of calls entering a service system which consists of n lines. The service durations are assumed to be identically distributed random variables which are independent both of each other and of the course of the incoming stream.

Consider a fork-join queue, where each job upon arrival splits into k tasks and each joins a separate queue that is attended by a single server. Service times are independent, exponentially distributed random variables. Server i works at rate , where μ is constant. We prove that the departure process becomes stochastically faster as the service rates become more homogeneous in the sense of stochastic majorization. Consequently, when all k servers work with equal rates the departure process is stochastically maximized.

We find a ‘natural' measure on the set of convex infinite cylinders touching a convex body K in En. Using the curvature measures, we can calculate the probability that a convex infinite cylinder and a convex body K are tangent in some previously determined regions. As a particular case we obtain a measure on all q-planes touching K.

For many years the modified Mercalli (MM) scale has been used to describe earthquake damage and effects observed at scattered locations. In the next stage of an analysis involving MM data, isoseismal lines based on the observations have been added to maps by hand, i.e. subjectively. However a few objective methods have been proposed (by e.g. De Rubeis et al., Brillinger, Wald et al. and Pettenati et al.). The work presented here develops objective methods further. In particular the ordinal character of the MM scale is specifically taken into account. Numerical smoothing is basic to the approach and methods involving splines, local polynomial regression and wavelets are illustrated. The approach also allows the inclusion of explanatory variables, for example site effects. The procedure is implemented for data from the 17 October 1989 Loma Prieta earthquake.

Over a finite interval, a Gaussian stationary process can be approximated by a finite trigonometric sum, and the error introduced by the approximation can be exactly bounded, as far as the distribution of the upper tail of the maximum is concerned. A simple case is exhibited, where a narrow band process is well approximated by means of a two-term trigonometric representation.

Some recent results of Oxley and Welsh (1979) and McDiarmid (1981) concerning Bernoulli percolation on clutters are generalized. Our results allow to consider quantitative aspects of percolation on graphs and clutters.

A new representation for the characteristic function of the multivariate strictly geo-stable distribution is presented. The representation is appealing from a parametric viewpoint: its parameters have an intuitive probabilistic interpretation; and it is particularly useful for estimating the parameters of the geo-stable distribution.

Asymptotic expansions are obtained for the distribution function of a studentized estimator of the offspring mean sequence in an array branching process with immigration. The expansion result is shown to hold in a test function topology. As an application of this result, it is shown that the bootstrapping distribution of the estimator of the offspring mean in a sub-critical branching process with immigration also admits the same expansion (in probability). From these considerations, it is concluded that the bootstrapping distribution provides a better approximation asymptotically than the normal distribution.

We prove concentration inequality results for geometric graph properties of an instance of the Cooper–Frieze [5] preferential attachment model with edge-steps. More precisely, we investigate a random graph model that at each time $t\in \mathbb{N}$ , with probability p adds a new vertex to the graph (a vertex-step occurs) or with probability $1-p$ an edge connecting two existent vertices is added (an edge-step occurs). We prove concentration results for the global clustering coefficient as well as the clique number. More formally, we prove that the global clustering, with high probability, decays as $t^{-\gamma(p)}$ for a positive function $\gamma$ of p, whereas the clique number of these graphs is, up to subpolynomially small factors, of order $t^{(1-p)/(2-p)}$ .

It is well known and readily seen that the maximum of n independent and uniformly on [0, 1] distributed random variables, suitably standardised, converges in total variation distance, as n increases, to the standard negative exponential distribution. We extend this result to higher dimensions by considering copulas. We show that the strong convergence result holds for copulas that are in a differential neighbourhood of a multivariate generalised Pareto copula. Sklar’s theorem then implies convergence in variational distance of the maximum of n independent and identically distributed random vectors with arbitrary common distribution function and (under conditions on the marginals) of its appropriately normalised version. We illustrate how these convergence results can be exploited to establish the almost-sure consistency of some estimation procedures for max-stable models, using sample maxima.

Two non-identical units are to be issued sequentially. The optimal policy determines the issuing sequence which maximizes the expected lifetime of the pair of units. The units each have non-decreasing hazard rates which depend on whether the unit is in service or in storage. Sufficient conditions are obtained for optimal issuing policies in a variety of examples.

A random stream of convex particles in , all moving uniformly in the same direction, is given. A convex test body is brought into the stream by means of a random rigid motion, independent of the stream. The number of particles that hit the test body at a preassigned boundary set within unit time is a random variable. Its expected value is determined under different model assumptions.

An array of points {Z1, Z2, …, Zn–1} in the interval V = [0, L], is such that 0 ≦ Z1, ≦ Z2 ≦ … ≦ Zn–1, ≦ L. One of the points is chosen at random (Zk, say, with probability pk) and displaced to a new position within the interval [Zk–1, Zk+ 1], the position again chosen at random according to a probability distribution Gk. We derive some results concerning the limiting distribution of the array after a succession of such displacements. If Gk is a uniform distribution, it appears that the number of displacements necessary to open up a gap between at least one pair of adjacent points of size at least γ is O(ρ n), n →∞, where ρ = L/(L – γ).

Based on pathwise duality constructions, several new results on truncated queues and storage systems of the G/M/1 type are derived by transforming the workload (content) processes into certain ‘dual’ M/G/1-type processes. We consider queueing systems in which (a) any service requirement that would increase the total workload beyond the capacity is truncated so as to keep the associated sojourn time below a certain constant, or (b) new arrivals do not enter the system if they have to wait more than one time unit in line. For these systems, we derive the steady-state distributions of the workload and the numbers of customers present in the systems as well as the distributions of the lengths of busy and idle periods. Moreover, we use the duality approach to study finite capacity storage systems with general state-dependent outflow rates. Here our duality leads to a Markovian finite storage system with state-dependent jump sizes whose content level process can be analyzed using level crossing techniques. We also derive a connection between the steady-state densities of the non-Markovian continuous-time content level process of the G/M/1 finite storage system with state-dependent outflow rule and the corresponding embedded sequence of peak points (local maxima).

Random digits are collected one at a time until a pattern with given digits is obtained. Blom (1982) and others have determined the mean waiting time for such a pattern. It is proved that when a given pattern has larger mean waiting time than another pattern, then the waiting time for the former is stochastically larger than that for the latter. An application is given to a coin-tossing game.

The problem of the optimal control of the Wiener process in Rn is considered. The optimal value of the control is obtained from the mathematical expectation of a quantity defined in terms of the moment and the place where the uncontrolled process hits the boundary of the continuation region for the first time. Explicit results are presented.