We consider the optimal wagers to be made by a gambler facing cointossing games who desires to maximize the expected value of the utility of his final fortune in a fixed number n of plays. In the case of fixed probability of a win, the optimal bet is shown to be increasing in the probability. In the case of unknown probability of a win, the wager is shown to be monotone in the prior distribution under the monotone likelihood ratio ordering of these distributions.

We consider degenerate limit laws for the sequence {Xn, n}n(N of successive maxima of identically distributed random variables. It turns out that the concentration of Xn, n for large n can be determined in terms of a tail ratio of the underlying distribution function F. Applications to the outlier-behaviour of probability distributions are given.

Conditions that have been widely used to establish stochastic ordering of random vectors include those given by Kamae et al. (1977), Barlow and Proschan (1975) and Langberg (1988). In this note we offer conditions that are weaker than those above, thus providing potential application to a wider class of problems.

In recent publications of Hadwiger, Bokowski, and Wills it has been shown that it is possible to evaluate the average distance between a fixed and a randomly distributed convex set in terms of the mean projection measures of these sets. In the present note it is pointed out that these and more general results can be obtained from a theorem concerning the relationship between integrals over arbitrary measure spaces and corresponding Lebesgue–Stieltjes integrals.

We consider a bivariate Markov counting process with transition probabilities having a particular structure, which includes a number of useful population processes. Using a suitable random time-scale transformation, we derive some probability statements about the process and some asymptotic results. These asymptotic results are also derived using martingale methods. Further, it is shown that these methods and results can be used for inference on the rate parameters for the process. The general epidemic model and the square law conflict model are used as illustrative examples.

An optimal allocation of subsystems depending on the system structure and reliability ordering of inherent subsystem components is determined, in the presence of various external influences on the reliability of components in different locations. It is carried out with the help of L-superadditive functions and Schur-convex functions.

Stochastic optimization of semimartingales which permit a dynamic description, like a stochastic differential equation, leads normally to dynamic programming procedures. The resulting Bellman equation is often of a very genera! nature, and analytically hard to solve. The models in the present paper are formulated in terms of the relative change, and the optimality criterion is to maximize the expected rate of growth. We show how this can be done in a simple way, where we avoid using the Bellman equation. An application is indicated.

This paper examines the infinitely high dam with seasonal (periodic) Lévy input under the unit release rule. We show that a periodic limiting distribution of dam content exists whenever the mean input over a seasonal cycle is less than 1. The Laplace transform of dam content at a finite time and the Laplace transform of the periodic limiting distribution are derived in terms of the probability of an empty dam. Necessary and sufficient conditions for the periodic limiting distribution to have finite moments are given. Convergence rates to the periodic limiting distribution are obtained from the moment results. Our methods of analysis lean heavily on the coupling method and a stochastic monotonicity result.

Let Wn be a simple Markov chain on the integers. Suppose that Xn is a simple Markov chain on the integers whose transition probabilities coincide with those of Wn off a finite set. We prove that there is an M > 0 such that the Markov chain Wn and the joint distributions of the first hitting time and first hitting place of Xn started at the origin for the sets {-M, M} and {-(M + 1), (M + 1)} algorithmically determine the transition probabilities of Xn.

We deal with a random graph model evolving in discrete time steps by duplicating and deleting the edges of randomly chosen vertices. We prove the existence of an almost surely asymptotic degree distribution, with stretched exponential decay; more precisely, the proportion of vertices of degree d tends to some positive number cd > 0 almost surely as the number of steps goes to ∞, and cd ~ (eπ)1/2d1/4e-2√d holds as d → ∞.

In an optimal variance stopping problem the goal is to determine the stopping time at which the variance of a sequentially observed stochastic process is maximized. A solution method for such a problem has been recently provided by Pedersen (2011). Using the methodology developed by Pedersen and Peskir (2012), our aim is to show that the solution to the initial problem can be equivalently obtained by constraining the variance stopping problem to the expected size of the stopped process and then by maximizing the solution to the latter problem over all the admissible constraints. An application to a diffusion process used for modeling the dynamics of interest rates illustrates the proposed technique.

In this note, we consider discrete-time finite Markov chains and assume that they are only partly observed. We obtain finite-dimensional normalized filters for basic statistics associated with such processes. Recursive equations for these filters are derived by means of simple computations involving conditional expectations. An application to the estimation of parameters of the so-called discrete-time batch Markovian arrival process is outlined.

We generalize, in terms of power series, the celebrated Geman-Yor formula for the pricing of Asian options in the framework of spectrally negative Lévy-driven assets. We illustrate our result by providing some new examples.

Optimal control of stochastic bandwidth-sharing networks is typically difficult. In order to facilitate the analysis, deterministic analogues of stochastic bandwidth-sharing networks, the so-called fluid models, are often taken for analysis, as their optimal control can be found more easily. The tracking policy translates the fluid optimal control policy back to a control policy for the stochastic model, so that the fluid optimality can be achieved asymptotically when the stochastic model is scaled properly. In this work we study the efficiency of the tracking policy, that is, how fast the fluid optimality can be achieved in the stochastic model with respect to the scaling parameter. In particular, our result shows that, under certain conditions, the tracking policy can be as efficient as feedback policies.

We present a new and straightforward algorithm that simulates exact sample paths for a generalized stress-release process. The computation of the exact law of the joint inter-arrival times is detailed and used to derive this algorithm. Furthermore, the martingale generator of the process is derived, and induces theoretical moments which generalize some results of [3] and are used to demonstrate the validity of our simulation algorithm.

Consider n random intervals I1, …, IN chosen by selecting endpoints independently from the uniform distribution. A packing of I1, …, IN is a disjoint sub-collection of these intervals: its wasted space is the measure of the set of points not covered by the packing. We investigate the random variable WN equal to the smallest wasted space among all packings. Coffman, Poonen and Winkler proved that EWN is of order (log N)2/N. We provide a sharp estimate of log P(WN ≥ t (log N)2 / N) and log P(WN ≤ t (log N)2 / N) for all values of t.

Two non-identical units are to be issued sequentially. The optimal policy determines the issuing sequence which maximizes the expected lifetime of the pair of units. The units each have non-decreasing hazard rates which depend on whether the unit is in service or in storage. Sufficient conditions are obtained for optimal issuing policies in a variety of examples.

As stated elsewhere [9], the two experimenter-controlled events learning model of Bush and Mosteller [1] may be described by a Markov process X0,X1, ···satisfying the following conditions.

1. (i) Xo has an arbitrary distribution on (0, 1).

2. (ii) If Xn is given, then with probability π1 and with probability π2

3. (ii)

We call `bits' a sequence of devices indexed by positive integers, where every device can be in two states: 0 (idle) and 1 (active). Start from the `ground state' of the system when all bits are in 0-state. In our first binary flipping (BF) model the evolution of the system behaves as follows. At each time step choose one bit from a given distribution P on the positive integers independently of anything else, then flip the state of this bit to the opposite state. In our second damaged bits (DB) model a `damaged' state is added: each selected idling bit changes to active, but selecting an active bit changes its state to damaged in which it then stays forever. In both models we analyse the recurrence of the system's ground state when no bits are active. We present sufficient conditions for both the BF and DB models to show recurrent or transient behaviour, depending on the properties of the distribution P. We provide a bound for fractional moments of the return time to the ground state for the BF model, and prove a central limit theorem for the number of active bits for both models.

The explosion probability before time t of a branching diffusion satisfies a nonlinear parabolic partial differential equation. This equation, along with the natural boundary and initial conditions, has only the trivial solution, i.e. explosion in finite time does not occur, provided the creation rate does not grow faster than the square power at ∞.