It is shown that, in a superposition of finitely many independent renewal processes, an observation from the limiting (when t →∞) joint distribution of backward and forward recurrence times at t can be simulated by simulating an observation of the pair (UW, (1 – U)W), where U and Ware independent random variables with U ~ uniform(0, 1) and W distributed according to the limiting total life distribution of the superposition process.

We consider a system that gradually deteriorates. At random times Tn the system is inspected and may or may not be replaced, but it must be if its state is too bad. The process of deterioration is described by a Markovian renewal process. Under some monotonicity conditions we derive a policy for the finite and the infinite horizon which minimizes the total discounted costs. This paper is a generalization of a result of Feldman (1977).

Nanosystems are devices that are in the size range of a billionth of a meter (1 x 10-9) and therefore are built necessarily from individual atoms. The one-dimensional nanosystems or linear nanosystems cover all the nanosized systems which possess one dimension that exceeds the other two dimensions, i.e. extension over one dimension is predominant over the other two dimensions. Here only two of the dimensions have to be on the nanoscale (less than 100 nanometers). In this paper we consider the structural relationship between a linear nanosystem and its atoms acting as components of the nanosystem. Using such information, we then assess the nanosystem's limiting reliability which is, of course, probabilistic in nature. We consider the linear nanosystem at a fixed moment of time, say the present moment, and we assume that the present state of the linear nanosystem depends only on the present states of its atoms.

Recently Gani (1965) has considered a stochastic model for the attachment of phages to bacteria. In this paper we study some of the basic properties of this model. These results will be used in a subsequent paper dealing with the estimation of the parameter which occurs in this model.

Investigations into time-slotted communication channels for transmission of data packets led us to analyze the stochastic behavior of the next-fit bin packing algorithm. In this paper we obtain results for general piece-size distributions and truncated distributions, we calculate explicit solutions for the case of the truncated exponential, and we apply the results to calculate the maximal throughput of the time-slotted communication channel.

We prove that a nonstationary random field indexed by ℝn with moments at least of order 2 can always be viewed as second-order stationary in ℝ2n.

In 1979, Melamed proved that, in an open migration process, the absence of ‘loops' is necessary and sufficient for the equilibrium flow along a link to be a Poisson process. In this paper, we prove approximation theorems with the same flavour: the difference between the equilibrium flow along a link and a Poisson process with the same rate is bounded in terms of expected numbers of loops. The proofs are based on Stein's method, as adapted for bounds on the distance of the distribution of a point process from a Poisson process in Barbour and Brown (1992b). Three different distances are considered, and illustrated with an example consisting of a system of tandem queues with feedback. The upper bound on the total variation distance of the process grows linearly with time, and a lower bound shows that this can be the correct order of approximation.

We introduce and analyze a random tree model associated to Hoppe's urn. The tree is built successively by adding nodes to the existing tree when starting with the single root node. In each step a node is added to the tree as a child of an existing node, where these parent nodes are chosen randomly with probabilities proportional to their weights. The root node has weight ϑ>0, a given fixed parameter, all other nodes have weight 1. This resembles the stochastic dynamic of Hoppe's urn. For ϑ=1, the resulting tree is the well-studied random recursive tree. We analyze the height, internal path length, and number of leaves of the Hoppe tree with n nodes as well as the depth of the last inserted node asymptotically as n→∞. Mainly expectations, variances, and asymptotic distributions of these parameters are derived.

In this paper we are interested in bounding or calculating the additive functionals of the first return time on a set for discrete-time Markov chains on a countable state space, which is motivated by investigating ergodic theory and central limit theorems. To do so, we introduce the theory of the minimal nonnegative solution. This theory combined with some other techniques is proved useful for investigating the additive functionals. This method is used to study the functionals for discrete-time birth-death processes, and the polynomial convergence and a central limit theorem are derived.

Consider a discrete time Markov chain {Zn} whose state space is the non-negative integers and whose transition probability matrix ║Pij║ possesses the representation where {Pr}, r = 1,2,…, is a finite or denumerably infinite sequence of non-negative real numbers satisfying , and , is a corresponding sequence of probability generating functions. It is assumed that Z0 = k, a finite positive integer.

In this paper we consider the stochastic wave equation in one spatial dimension driven by a two-parameter Gaussian noise which is white in time and has general spatial covariance. We give conditions on the spatial covariance of the driving noise sufficient for the string to have finite expected energy and calculate this energy as a function of time. We show that these same conditions on the spatial covariance of the driving noise are also sufficient to guarantee that the energy of the string has a version which is continuous almost surely.

In this note, we consider G/G/1 queues with stationary and ergodic inputs. We show that if the service times are independent and identically distributed with unbounded supports, then for a given mean of interarrival times, the number of sequences (distributions) of interarrival times that induce identical distributions on interdeparture times is at most 1. As a direct consequence, among all the G/M/1 queues with stationary and ergodic inputs, the M/M/1 queue is the only queue whose departure process is identically distributed as the input process.

We rigorously prove that for a stochastic process, , the existence of a first regeneration time, R1, implies the existence of an infinite sequence of such times, {R1, R2, · ·· }, and hence that the definition of regenerative process need only demand the existence of a first regeneration time. Here we include very general processes up to and including processes where cycles are stationary but not necessarily independent and identically distributed.

Suppose that in a ballot candidate A scores a votes and candidate B scores b votes and that all the possible voting records are equally probable. Denote by α r and β r, the number of votes registered for A and B respectively among the first r votes recorded. Let µ, be a nonnegative integer. Denote by Pj(a, b) the probability that the inequality holds for exactly j subscripts r=1,2,..,a + b.

This paper considers risk-sensitive average optimization for denumerable continuous-time Markov decision processes (CTMDPs), in which the transition and cost rates are allowed to be unbounded, and the policies can be randomized history dependent. We first derive the multiplicative dynamic programming principle and some new facts for risk-sensitive finite-horizon CTMDPs. Then, we establish the existence and uniqueness of a solution to the risk-sensitive average optimality equation (RS-AOE) through the results for risk-sensitive finite-horizon CTMDPs developed here, and also prove the existence of an optimal stationary policy via the RS-AOE. Furthermore, for the case of finite actions available at each state, we construct a sequence of models of finite-state CTMDPs with optimal stationary policies which can be obtained by a policy iteration algorithm in a finite number of iterations, and prove that an average optimal policy for the case of infinitely countable states can be approximated by those of the finite-state models. Finally, we illustrate the conditions and the iteration algorithm with an example.

This paper studies the reversibility conditions of stationary Markov chains (discrete-time Markov processes) with general state space. In particular, we investigate the Markov chains having atomic points in the state space. Such processes are often seen in storage models, for example waiting time in a queue, insurance risk reserve, dam content and so on. The necessary and sufficient conditions for reversibility of these processes are obtained. Further, we apply these conditions to some storage models and present some interesting results for single-server queues and a finite insurance risk model.

We study asymptotically optimal simulation algorithms for approximating the tail probability of P(eX1+⋯+ eXd>u) as u→∞. The first algorithm proposed is based on conditional Monte Carlo and assumes that (X1,…,Xd) has an elliptical distribution with very mild assumptions on the radial component. This algorithm is applicable to a large class of models in finance, as we demonstrate with examples. In addition, we propose an importance sampling algorithm for an arbitrary dependence structure that is shown to be asymptotically optimal under mild assumptions on the marginal distributions and, basically, that we can simulate efficiently (X1,…,Xd|Xj >b) for large b. Extensions that allow us to handle portfolios of financial options are also discussed.

We study the average nearest-neighbour degree a(k) of vertices with degree k. In many real-world networks with power-law degree distribution, a(k) falls off with k, a property ascribed to the constraint that any two vertices are connected by at most one edge. We show that a(k) indeed decays with k in three simple random graph models with power-law degrees: the erased configuration model, the rank-1 inhomogeneous random graph, and the hyperbolic random graph. We find that in the large-network limit for all three null models, a(k) starts to decay beyond $n^{(\tau-2)/(\tau-1)}$ and then settles on a power law $a(k)\sim k^{\tau-3}$, with $\tau$ the degree exponent.

A class of two-node queueing networks with general stationary ergodic governing sequence is considered. This means that, in particular, a non-Poissonian arrival process and dependent service times, as well as a non-Bernoulli feedback mechanism are admitted. A mixing condition ensures that the limiting distributions of the number of customers in the nodes observed in continuous time as well as at certain embedded epochs can be expressed by the Palm distributions of appropriately chosen marked point processes. This gives the possibility of connecting the classical concept of embedding with a general point-process approach. Furthermore, it leads to simple proofs of relationships between the limiting distributions. An example is given to illustrate how these relationships can be used to derive explicit formulas for various stationary queueing characteristics.

Let X and Y be two simple symmetric continuous-time random walks on the vertices of the n-dimensional hypercube, Z2n. We consider the class of co-adapted couplings of these processes, and describe an intuitive coupling which is shown to be the fastest in this class.