It is well known that Monte Carlo integration with variance reduction by means of control variates can be implemented by the ordinary least squares estimator for the intercept in a multiple linear regression model. A central limit theorem is established for the integration error if the number of control variates tends to infinity. The integration error is scaled by the standard deviation of the error term in the regression model. If the linear span of the control variates is dense in a function space that contains the integrand, the integration error tends to zero at a rate which is faster than the square root of the number of Monte Carlo replicates. Depending on the situation, increasing the number of control variates may or may not be computationally more efficient than increasing the Monte Carlo sample size.

We show that several machine learning estimators, including square-root least absolute shrinkage and selection and regularized logistic regression, can be represented as solutions to distributionally robust optimization problems. The associated uncertainty regions are based on suitably defined Wasserstein distances. Hence, our representations allow us to view regularization as a result of introducing an artificial adversary that perturbs the empirical distribution to account for out-of-sample effects in loss estimation. In addition, we introduce RWPI (robust Wasserstein profile inference), a novel inference methodology which extends the use of methods inspired by empirical likelihood to the setting of optimal transport costs (of which Wasserstein distances are a particular case). We use RWPI to show how to optimally select the size of uncertainty regions, and as a consequence we are able to choose regularization parameters for these machine learning estimators without the use of cross validation. Numerical experiments are also given to validate our theoretical findings.

In this paper we introduce the multivariate Brownian semistationary (BSS) process and study the joint asymptotic behaviour of its realised covariation using in-fill asymptotics. First, we present a central limit theorem for general multivariate Gaussian processes with stationary increments, which are not necessarily semimartingales. Then, we show weak laws of large numbers, central limit theorems, and feasible results for BSS processes. An explicit example based on the so-called gamma kernels is also provided.

Let X1, …, Xn be independent random points drawn from an absolutely continuous probability measure with density f in ℝd. Under mild conditions on f, wederive a Poisson limit theorem for the number of large probability nearest-neighbour balls. Denoting by Pn the maximum probability measure of nearest-neighbour balls, this limit theorem implies a Gumbel extreme value distribution for nPn − ln n as n → ∞. Moreover, we derive a tight upper bound on the upper tail of the distribution of nPn − ln n, which does not depend on f.

We consider an infinitely divisible random field in ℝd given as an integral of a kernel function with respect to a Lévy basis. Under mild regularity conditions, we derive central limit theorems for the moment estimators of the mean and the variogram of the field.

As an extension of a central limit theorem established by Svante Janson, we prove a Berry–Esseen inequality for a sum of independent and identically distributed random variables conditioned by a sum of independent and identically distributed integer-valued random variables.

Let Xn(k) be the number of vertices at level k in a random recursive tree with n+1 vertices. We are interested in the asymptotic behavior of Xn(k) for intermediate levels k=kn satisfying kn→∞ and kn=o(logn) as n→∞. In particular, we prove weak convergence of finite-dimensional distributions for the process (Xn ([knu]))u>0, properly normalized and centered, as n→∞. The limit is a centered Gaussian process with covariance (u,v)↦(u+v)−1. One-dimensional distributional convergence of Xn(kn), properly normalized and centered, was obtained with the help of analytic tools by Fuchs et al. (2006). In contrast, our proofs, which are probabilistic in nature, exploit a connection of our model with certain Crump–Mode–Jagers branching processes.

Let Sn,n≥1, be the successive sums of the payoffs in the classical St. Petersburg game. The celebrated Feller weak law states that Sn∕(nlog2n)→ℙ1 as n→∞. In this paper we review some earlier results of ours and extend some of them as we consider an asymmetric St. Petersburg game, in which the distribution of the payoff X is given by ℙ(X=srk-1)=pqk-1,k=1,2,…, where p+q=1 and s,r>0. Two main results are extensions of the Feller weak law and the convergence in distribution theorem of Martin-Löf (1985). Moreover, it is well known that almost-sure convergence fails, though Csörgő and Simons (1996) showed that almost-sure convergence holds for trimmed sums and also for sums trimmed by an arbitrary fixed number of maxima. In view of the discreteness of the distribution we focus on `max-trimmed sums', that is, on the sums trimmed by the random number of observations that are equal to the largest one, and prove limit theorems for simply trimmed sums, for max-trimmed sums, as well as for the `total maximum'. Analogues with respect to the random number of summands equal to the minimum are also obtained and, finally, for joint trimming.

Khintchine's (necessary and sufficient) slowly varying function condition for the weak law of large numbers (WLLN) for the sum of n nonnegative, independent and identically distributed random variables is used as an overarching (sufficient) condition for the case that the number of summands is more generally [cn],cn→∞. Either the norming sequence {an},an→∞, or the number of summands sequence {cn}, can be chosen arbitrarily. This theorem generalizes results from a motivating branching process setting in which Khintchine's sufficient condition is automatically satisfied. A second theorem shows that Khintchine's condition is necessary for the generalized WLLN when it holds with cn→∞ and an→∞. Theorem 3, which is known, gives a necessary and sufficient condition for Khintchine's WLLN to hold with cn=n and an a specific function of n; it is extended to general cn subject to a growth restriction in Theorem 4. Section 6 returns to the branching process setting.

In this paper we consider a new type of urn scheme, where the selection probabilities are proportional to a weight function, which is linear but decreasing in the proportion of existing colours. We refer to it as the de-preferential urn scheme. We establish the almost-sure limit of the random configuration for any balanced replacement matrix R. In particular, we show that the limiting configuration is uniform on the set of colours if and only if R is a doubly stochastic matrix. We further establish the almost-sure limit of the vector of colour counts and prove central limit theorems for the random configuration as well as for the colour counts.

Let ξ = (ξ1, . . ., ξm) be a negatively associated mean-zero random vector with components that obey the bound |ξi| ≤ B, i = 1, . . ., m, and whose sum W = ∑i=1mξi has variance 1. The bound d1(ℒ(W), ℒ(Z)) ≤ 5B - 5.2∑i≠ jσij is obtained, where Z has the standard normal distribution and d1(∙, ∙) is the L1 metric. The result is extended to the multidimensional case with the L1 metric replaced by a smooth functions metric. Applications to second-order stationary random fields with exponential decreasing covariance are also presented.

We introduce a large and flexible class of discrete tempered stable distributions, and analyze the domains of attraction for both this class and the related class of positive tempered stable distributions. Our results suggest that these are natural models for sums of independent and identically distributed random variables with tempered heavy tails, i.e. tails that appear to be heavy up to a point, but ultimately decay faster.

A classical Pólya urn scheme is a Markov process where the evolution is encoded by a replacement matrix (Ri, j)1 ≤ i, j ≤ d. At every discrete time-step, we draw a ball uniformly at random, denote its colour c, and replace it in the urn together with Rc, j balls of colour j (for all 1 ≤ j ≤ d). We study multiple drawing Pólya urns, where the replacement rule depends on the random drawing of a set of m balls from the urn (with or without replacement). Many particular examples of this situation have been studied in the literature, but the only general results are due to Kuba and Mahmoud (2017). These authors proved second-order asymptotic results in the two-colour case, under the so-called balance and affinity assumptions, the latter being somewhat artificial. The main idea of this work is to apply stochastic approximation methods to this problem, which enables us to prove analogous results to Kuba and Mahmoud, but without the artificial affinity hypothesis, and, for the first time in the literature, in the d-colour case (d ≥ 3). We also provide some partial results in the two-colour nonbalanced case, the novelty here being that the only results for this case currently in the literature are for particular examples.

The Horton–Strahler ordering method, originating in hydrology, formulates the hierarchical structure of branching patterns using a quantity called the bifurcation ratio. The main result of this paper is the central limit theorem for the bifurcation ratio of a general branch order. This is a generalized form of the central limit theorem for the lowest bifurcation ratio, which was previously proved. Some useful relations regarding the Horton–Strahler analysis are also derived in the proofs of the main theorems.

We prove a second-order limit law for additive functionals of a d-dimensional fractional Brownian motion with Hurst index H = 1 / d, using the method of moments and extending the Kallianpur–Robbins law, and then give a functional version of this result. That is, we generalize it to the convergence of the finite-dimensional distributions for corresponding stochastic processes.

We study the joint degree counts in linear preferential attachment random graphs and find a simple representation for the limit distribution in infinite sequence space. We show weak convergence with respect to the p-norm topology for appropriate p and also provide optimal rates of convergence of the finite-dimensional distributions. The results hold for models with any general initial seed graph and any fixed number of initial outgoing edges per vertex; we generate nontree graphs using both a lumping and a sequential rule. Convergence of the order statistics and optimal rates of convergence to the maximum of the degrees is also established.

A class of games for finding a leader among a group of candidates is studied in detail. This class covers games based on coin tossing and rock-paper-scissors as special cases and its complexity exhibits similar stochastic behaviors: either of logarithmic mean and bounded variance or of exponential mean and exponential variance. Many applications are also discussed.

An extension of a convergence theorem for sequences of Markov chains is derived. For every positive integer N let (X N (r))r be a Markov chain with the same finite state space S and transition matrix ΠN =I+d N B N , where I is the unit matrix, Q a generator matrix, (B N )N a sequence of matrices, limN℩∞ c N = limN→∞d N =0 and limN→∞ c N ∕d N =0. Suppose that the limits P≔limm→∞(I+d N Q)m and G≔limN→∞ P B N P exist. If the sequence of initial distributions P X N (0) converges weakly to some probability measure μ, then the finite-dimensional distributions of (X N ([t∕c N ))t≥0 converge to those of the Markov process (X t )t≥0 with initial distribution μ, transition matrix PetG and limN→∞(I+d N Q+c N B N )[t∕c N]

We consider a variant of the randomly reinforced urn where more balls can be simultaneously drawn out and balls of different colors can be simultaneously added. More precisely, at each time-step, the conditional distribution of the number of extracted balls of a certain color, given the past, is assumed to be hypergeometric. We prove some central limit theorems in the sense of stable convergence and of almost sure conditional convergence, which are stronger than convergence in distribution. The proven results provide asymptotic confidence intervals for the limit proportion, whose distribution is generally unknown. Moreover, we also consider the case of more urns subjected to some random common factors.

We consider a Markov chain (M n )n≥0 on the set ℕ0 of nonnegative integers which is eventually decreasing, i.e. ℙ{M n+1<M n   |  M n ≥a}=1 for some a∈ℕ and all n≥0. We are interested in the asymptotic behavior of the law of the stopping time T=T(a)≔inf{k∈ℕ0:  M k <a} under ℙn ≔ℙ (·  |  M 0=n) as n→∞. Assuming that the decrements of (M n )n≥0 given M 0=n possess a kind of stationarity for large n, we derive sufficient conditions for the convergence in the minimal L p -distance of ℙn (T−a n)∕b n∈·) to some nondegenerate, proper law and give an explicit form of the constants a n and b n .