Stress release processes are special Markov models attempting to describe the behaviour of stress and occurrence of earthquakes in seismic zones. The stress is built up linearly by tectonic forces and released spontaneously when earthquakes occur. Assuming that the risk is an exponential function of the stress, we derive closed form expressions for the stationary distribution of such processes, the moments of the risk, and the autocovariance function of the reciprocal risk process.

A martingale is used to study extinction probabilities of the Galton-Watson process using a stopping time argument. This same martingale defines a martingale function in its argument s; consequently, its derivative is also a martingale. The argument s can be classified as regular or irregular and this classification dictates very different behavior of the Galton-Watson process. For example, it is shown that irregularity of a point s is equivalent to the derivative martingale sequence at s being closable, (i.e., it has limit which, when attached to the original sequence, the martingale structure is retained). It is also shown that for irregular points the limit of the derivative is the derivative of the limit, and two different types of norming constants for the asymptotics of the Galton-Watson process are asymptotically equivalent only for irregular points.

The classical technique of uniformization (or randomization) for bounded continuous-time Markov chains and Markov reward structures is extended to dynamic systems generated by arbitrary non-negative generators. Most notably, these include so-called input-output models in economic analysis. The results are of practical interest for both computational and theoretical purposes. Particularly, the recursive computation and the limiting behaviour of cumulative reward structures for non-negative dynamic systems is concluded as a special application. Two numerical examples are included to illustrate the conditions and the results.

We consider adaptive importance sampling for a Markov chain with scoring. It is shown that convergence to the zero-variance importance sampling chain for the mean total score occurs exponentially fast under general conditions. These results extend previous work in Kollman (1993) and in Kollman et al. (1999) for finite state spaces.

In this paper we give bounds on the total variation distance from convergence of a continuous time positive recurrent Markov process on an arbitrary state space, based on Foster-Lyapunov drift and minorisation conditions. Considerably improved bounds are given in the stochastically monotone case, for both discrete and continuous time models, even in the absence of a reachable minimal element. These results are applied to storage models and to diffusion processes.

We study a random record model where the observation Xi has continuous distribution function Fαi (αi > 0) and the number of available observations is random and independent of the observations. We obtain the joint distribution of the record values and inter-record times for our model. We investigate the distribution of the number of records when the number of observations has one of the common distributions and the α's increase geometrically or linearly. A particularly interesting case arises when the observations arrive at time points paced by a Poisson point process. For this model we obtain distributional results for the inter-arrival times of records for a large class of combinations of α structures and intensity functions.

Let I1,I2,…,In be a sequence of independent indicator functions defined on a probability space (Ω, A, P). We say that index k is a success time if Ik = 1. The sequence I1,I2,…,In is observed sequentially. The objective of this article is to predict the lth last success, if any, with maximum probability at the time of its occurrence. We find the optimal rule and discuss briefly an algorithm to compute it in an efficient way. This generalizes the result of Bruss (1998) for l = 1, and is equivalent to the problem of (multiple) stopping with l stops on the last l successes. We then extend the model to a larger class allowing for an unknown number N of indicator functions, and present, in particular, a convenient method for an approximate solution if the success probabilities are small. We also discuss some applications of the results.

We prove that, under rather general conditions, the law of a continuous Gaussian process represented by a stochastic integral of a deterministic kernel, with respect to a standard Wiener process, can be weakly approximated by the law of some processes constructed from a standard Poisson process. An example of a Gaussian process to which this result applies is the fractional Brownian motion with any Hurst parameter.

In this paper we consider the optimal control of an infinite dam using policies assuming that the input process is a compound Poisson process with a non-negative drift term, and using the total discounted cost and long-run average cost criteria. The results of Lee and Ahn (1998) as well as other well-known results are shown to follow from our results.

This paper describes the limiting asymptotic behaviour of a long cascade of linear reservoirs fed by stationary inflows into the first reservoir. We show that the storage in the nth reservoir becomes asymptotically deterministic as n → ∞, and establish a central limit theorem for the random fluctuations about the deterministic approximation. In addition, we prove a large deviations theorem that provides precise logarithmic asymptotics for the tail probabilities associated with the storage in the nth reservoir when n is large.

Lamperti's transformation, an isometry between self-similar and stationary processes, is used to solve some problems of linear estimation of continuous-time, self-similar processes. These problems include causal whitening and innovations representations on the positive real line, as well as prediction from certain finite and semi-infinite intervals. The method is applied to the specific case of fractional Brownian motion (FBM), yielding alternate derivations of known prediction results, along with some novel whitening and interpolation formulae. Some associated insights into the problem of discrete prediction are also explored. Closed-form expressions for the spectra and spectral factorization of the stationary processes associated with the FBM are obtained as part of this development.

The lifelengths of components of a system are usually dependent due to the common random production and operating environments. In this paper, we introduce a multi-variate pure jump Markov process to describe a large class of damage processes on various system components driven by common environmental shocks, and establish some dependence properties (association) for such a process and its multivariate increment process. These strong association properties describe both spatial dependence and temporal dependence of a multivariate pure jump process, and also provide a vehicle to derive some structural properties of component lifelengths of the systems operating in such an environment. Some bounds for the joint survival functions of component lifelengths are also obtained.

The transition functions for the correlated random walk with two absorbing boundaries are derived by means of a combinatorial construction which is based on Krattenthaler's theorem for counting lattice paths with turns. Results for walks with one boundary and for unrestricted walks are presented as special cases. Finally we give an asymptotic formula, which proves to be useful for computational purposes.

We study strong asymptotic properties of two types of integral functionals of geometric stochastic processes. These integral functionals are of interest in financial modelling, yielding various option pricings, annuities, etc., by appropriate selection of the processes in their respective integrands. We show that under fairly general conditions on the latter processes the logs of the integral functionals themselves asymptotically behave like appropriate sup functionals of the processes in the exponents of their respective integrands. We illustrate the possible use and applications of these strong invariance theorems by listing and elaborating on several examples.

Partitioning algorithms for the Euclidean matching and for the semi-matching problem in the plane are introduced and analysed. The algorithms are analogues of Karp's well-known dissection algorithm for the travelling salesman problem. The algorithms are proved to run in time nlogn and to approximate the optimal matching in the probabilistic sense. The analysis is based on the techniques developed in Karp (1977) and on the limit theorem of Redmond and Yukich (1993) for quasiadditive functionals.

A generalization of the delta method is proposed. The asymptotic distribution of g(Y n ) is obtained when g is not necessarily a differentiable function but verifies some weaker regularity conditions. An application to diversity profiles is also presented.

Let (Xt) be a one-dimensional Ornstein-Uhlenbeck process with initial density function f : ℝ+ → ℝ+, which is a regularly varying function with exponent -(1 + η), η ∊ (0,1). We prove the existence of a probability measure ν with a Lebesgue density, depending on η, such that for every A ∊ B(R+):

Lifetime distributions for multicomponent systems are developed through the interplay of ageing and stress shocks to the system. The ageing process is explicitly modeled by an exponential function with rate affected by the magnitude of stresses from a compound Poisson process shock model. Applications of these life distributions and associated failure rates towards the study of multicomponent system survival are discussed. In particular, we illustrate the behavior of these survival functions in relevant subsets of the parameter space.

Extending the cascade model for food webs, we introduce a cyclic cascade model which is a random generation model of cyclic dominance relations. Put n species as n points Q1,Q2,…, Qn on a circle. If the counterclockwise way from Qi to Qj on the circle is shorter than the clockwise way, we say Qi dominates Qj. Consider a tournament whose dominance relations are generated from the points on a circle by this rule. We show that when we take n mutually independently distributed points on the circle, the probability of getting a regular tournament of order 2r+1 as the largest regular tournament is equal to (n/(2r+1))/2n-1. This probability distribution is for the number of existing species after a sufficiently long period, assuming a Lotka-Volterra cyclic cascade model.

Nash's generalization of Gittins’ classic index result to so-called generalized bandit problems (GBPs) in which returns are dependent on the states of all arms (not only the one which is pulled) has proved important for applications. The index theory for special cases of this model in which all indices are positive is straightforward. However, this is not a natural restriction in practice. An earlier proposal for the general case did not yield satisfactory index-based suboptimality bounds for policies — a central feature of classical Gittins index theory. We develop such bounds via a notion of duality for GBPs which is of independent interest. The index which emerges naturally from this analysis is the reciprocal of the one proposed by Nash.