In this note we provide an upper bound for the difference between the value function of a distributionally robust Markov decision problem and the value function of a non-robust Markov decision problem, where the ambiguity set of probability kernels of the distributionally robust Markov decision process is described by a Wasserstein ball around some reference kernel whereas the non-robust Markov decision process behaves according to a fixed probability kernel contained in the ambiguity set. Our derived upper bound for the difference between the value functions is dimension-free and depends linearly on the radius of the Wasserstein ball.

We consider two continuous-time generalizations of conservative random walks introduced in Englander and Volkov (2022), an orthogonal and a spherically symmetrical one; the latter model is also known as random flights. For both models, we show the transience of the walks when $d\ge 2$ and that the rate of direction changing follows a power law $t^{-\alpha}$, $0<\alpha\le 1$, or the law $(\!\ln t)^{-\beta}$ where $\beta>2$.

It is known that the simple slice sampler has robust convergence properties; however, the class of problems where it can be implemented is limited. In contrast, we consider hybrid slice samplers which are easily implementable and where another Markov chain approximately samples the uniform distribution on each slice. Under appropriate assumptions on the Markov chain on the slice, we give a lower bound and an upper bound of the spectral gap of the hybrid slice sampler in terms of the spectral gap of the simple slice sampler. An immediate consequence of this is that the spectral gap and geometric ergodicity of the hybrid slice sampler can be concluded from the spectral gap and geometric ergodicity of the simple version, which is very well understood. These results indicate that robustness properties of the simple slice sampler are inherited by (appropriately designed) easily implementable hybrid versions. We apply the developed theory and analyze a number of specific algorithms, such as the stepping-out shrinkage slice sampling, hit-and-run slice sampling on a class of multivariate targets, and an easily implementable combination of both procedures on multidimensional bimodal densities.

It is proved that for families of stochastic operators on a countable tensor product, depending smoothly on parameters, any spectral projection persists smoothly, where smoothness is defined using norms based on ideas of Dobrushin. A rigorous perturbation theory for families of stochastic operators with spectral gap is thereby created. It is illustrated by deriving an effective slow two-state dynamics for a three-state probabilistic cellular automaton.

In this paper, we consider absorbing Markov chains $X_n$ admitting a quasi-stationary measure $\mu $ on M where the transition kernel ${\mathcal P}$ admits an eigenfunction $0\leq \eta \in L^1(M,\mu )$. We find conditions on the transition densities of ${\mathcal P}$ with respect to $\mu $ which ensure that $\eta (x) \mu (\mathrm {d} x)$ is a quasi-ergodic measure for $X_n$ and that the Yaglom limit converges to the quasi-stationary measure $\mu $-almost surely. We apply this result to the random logistic map $X_{n+1} = \omega _n X_n (1-X_n)$ absorbed at ${\mathbb R} \setminus [0,1],$ where $\omega _n$ is an independent and identically distributed sequence of random variables uniformly distributed in $[a,b],$ for $1\leq a <4$ and $b>4.$

Under mild assumptions, we show that the exact convergence rate in total variation is also exact in weaker Wasserstein distances for the Metropolis–Hastings independence sampler. We develop a new upper and lower bound on the worst-case Wasserstein distance when initialized from points. For an arbitrary point initialization, we show that the convergence rate is the same and matches the convergence rate in total variation. We derive exact convergence expressions for more general Wasserstein distances when initialization is at a specific point. Using optimization, we construct a novel centered independent proposal to develop exact convergence rates in Bayesian quantile regression and many generalized linear model settings. We show that the exact convergence rate can be upper bounded in Bayesian binary response regression (e.g. logistic and probit) when the sample size and dimension grow together.

Let $\theta $ be an irrational real number. The map $T_\theta : y \mapsto (y+\theta ) \,\mod \!\!\: 1$ from the unit interval $\mathbf {I} = [0,1[$ (endowed with the Lebesgue measure) to itself is ergodic. In 2002, Rudolph and Hoffman showed in [Uniform endomorphisms which are isomorphic to a Bernoulli shift. Ann. of Math. (2) 156(1) (2002), 79–101] that the measure-preserving map $[T_\theta ,\mathrm {Id}]$ is isomorphic to a one-sided dyadic Bernoulli shift. Their proof is not constructive. A few years before, Parry [Automorphisms of the Bernoulli endomorphism and a class of skew-products. Ergod. Th. & Dynam. Sys.16 (1996), 519–529] had provided an explicit isomorphism under the assumption that $\theta $ is extremely well approached by the rational numbers, namely,

$$ \begin{align*}\inf_{q \ge 1} q^44^{q^2}~\mathrm{dist}(\theta,q^{-1}\mathbb{Z}) = 0.\end{align*} $$

Whether the explicit map considered by Parry is an isomorphism or not in the general case was still an open question. In Leuridan [Bernoulliness of $[T,\mathrm {Id}]$ when T is an irrational rotation: towards an explicit isomorphism. Ergod. Th. & Dynam. Sys. 41(7) (2021), 2110–2135] we relaxed Parry’s condition into

$$ \begin{align*}\inf_{q \ge 1} q^4~\mathrm{dist}(\theta,q^{-1}\mathbb{Z}) = 0.\end{align*} $$

In the present paper, we remove the condition by showing that the explicit map considered by Parry is always an isomorphism. With a few adaptations, the same method works with $[T,T^{-1}]$.

We construct a class of non-reversible Metropolis kernels as a multivariate extension of the guided-walk kernel proposed by Gustafson (Statist. Comput. 8, 1998). The main idea of our method is to introduce a projection that maps a state space to a totally ordered group. By using Haar measure, we construct a novel Markov kernel termed the Haar mixture kernel, which is of interest in its own right. This is achieved by inducing a topological structure to the totally ordered group. Our proposed method, the $\Delta$-guided Metropolis–Haar kernel, is constructed by using the Haar mixture kernel as a proposal kernel. The proposed non-reversible kernel is at least 10 times better than the random-walk Metropolis kernel and Hamiltonian Monte Carlo kernel for the logistic regression and a discretely observed stochastic process in terms of effective sample size per second.

Let $({\mathbb X}, T)$ be a subshift of finite type equipped with the Gibbs measure $\nu $ and let f be a real-valued Hölder continuous function on ${\mathbb X}$ such that $\nu (f) = 0$. Consider the Birkhoff sums $S_n f = \sum _{k=0}^{n-1} f \circ T^{k}$, $n\geqslant 1$. For any $t \in {\mathbb R}$, denote by $\tau _t^f$ the first time when the sum $t+ S_n f$ leaves the positive half-line for some $n\geqslant 1$. By analogy with the case of random walks with independent and identically distributed increments, we study the asymptotic as $ n\to \infty $ of the probabilities $ \nu (x\in {\mathbb X}: \tau _t^f(x)>n) $ and $ {\nu (x\in {\mathbb X}: \tau _t^f(x)=n) }$. We also establish integral and local-type limit theorems for the sum $t+ S_n f(x)$ conditioned on the set $\{ x \in {\mathbb X}: \tau _t^f(x)>n \}.$

Let $\{X_n\}_{n\in{\mathbb{N}}}$ be an ${\mathbb{X}}$-valued iterated function system (IFS) of Lipschitz maps defined as $X_0 \in {\mathbb{X}}$ and for $n\geq 1$, $X_n\;:\!=\;F(X_{n-1},\vartheta_n)$, where $\{\vartheta_n\}_{n \ge 1}$ are independent and identically distributed random variables with common probability distribution $\mathfrak{p}$, $F(\cdot,\cdot)$ is Lipschitz continuous in the first variable, and $X_0$ is independent of $\{\vartheta_n\}_{n \ge 1}$. Under parametric perturbation of both F and $\mathfrak{p}$, we are interested in the robustness of the V-geometrical ergodicity property of $\{X_n\}_{n\in{\mathbb{N}}}$, of its invariant probability measure, and finally of the probability distribution of $X_n$. Specifically, we propose a pattern of assumptions for studying such robustness properties for an IFS. This pattern is implemented for the autoregressive processes with autoregressive conditional heteroscedastic errors, and for IFS under roundoff error or under thresholding/truncation. Moreover, we provide a general set of assumptions covering the classical Feller-type hypotheses for an IFS to be a V-geometrical ergodic process. An accurate bound for the rate of convergence is also provided.

We present an affine-invariant random walk for drawing uniform random samples from a convex body $\mathcal{K} \subset \mathbb{R}^n$ that uses maximum-volume inscribed ellipsoids, known as John’s ellipsoids, for the proposal distribution. Our algorithm makes steps using uniform sampling from the John’s ellipsoid of the symmetrization of $\mathcal{K}$ at the current point. We show that from a warm start, the random walk mixes in ${\widetilde{O}}\!\left(n^7\right)$ steps, where the log factors hidden in the ${\widetilde{O}}$ depend only on constants associated with the warm start and desired total variation distance to uniformity. We also prove polynomial mixing bounds starting from any fixed point x such that for any chord pq of $\mathcal{K}$ containing x, $\left|\log \frac{|p-x|}{|q-x|}\right|$ is bounded above by a polynomial in n.

Given a finite strongly connected directed graph $G=(V, E)$ , we study a Markov chain taking values on the space of probability measures on V. The chain, motivated by biological applications in the context of stochastic population dynamics, is characterized by transitions between states that respect the structure superimposed by E: mass (probability) can only be moved between neighbors in G. We provide conditions for the ergodicity of the chain. In a simple, symmetric case, we fully characterize the invariant probability.

We present a recurrence–transience classification for discrete-time Markov chains on manifolds with negative curvature. Our classification depends only on geometric quantities associated to the increments of the chain, defined via the Riemannian exponential map. We deduce that a recurrent chain that has zero average drift at every point cannot be uniformly elliptic, unlike in the Euclidean case. We also give natural examples of zero-drift recurrent chains on negatively curved manifolds, including on a stochastically incomplete manifold.

Consider a topologically transitive countable Markov shift $\Sigma $ and a summable locally constant potential $\phi $ with finite Gurevich pressure and $\mathrm {Var}_1(\phi ) < \infty $. We prove the existence of the limit $\lim _{t \to \infty } \mu _t$ in the weak$^\star $ topology, where $\mu _t$ is the unique equilibrium state associated to the potential $t\phi $. In addition, we present examples where the limit at zero temperature exists for potentials satisfying more general conditions.

Motivated by recent studies of big samples, this work aims to construct a parametric model which is characterized by the following features: (i) a ‘local’ reinforcement, i.e. a reinforcement mechanism mainly based on the last observations, (ii) a random persistent fluctuation of the predictive mean, and (iii) a long-term almost sure convergence of the empirical mean to a deterministic limit, together with a chi-squared goodness-of-fit result for the limit probabilities. This triple purpose is achieved by the introduction of a new variant of the Eggenberger–Pólya urn, which we call the rescaled Pólya urn. We provide a complete asymptotic characterization of this model, pointing out that, for a certain choice of the parameters, it has properties different from the ones typically exhibited by the other urn models in the literature. Therefore, beyond the possible statistical application, this work could be interesting for those who are concerned with stochastic processes with reinforcement.

Simulated tempering is a popular method of allowing Markov chain Monte Carlo algorithms to move between modes of a multimodal target density $\pi$ . Tawn, Moores and Roberts (2021) introduces the Annealed Leap-Point Sampler (ALPS) to allow for rapid movement between modes. In this paper we prove that, under appropriate assumptions, a suitably scaled version of the ALPS algorithm converges weakly to skew Brownian motion. Our results show that, under appropriate assumptions, the ALPS algorithm mixes in time $O(d [\log d]^2)$ or O(d), depending on which version is used.

Bifurcating Markov chains (BMCs) are Markov chains indexed by a full binary tree representing the evolution of a trait along a population where each individual has two children. We provide a central limit theorem for additive functionals of BMCs under $L^2$ -ergodic conditions with three different regimes. This completes the pointwise approach developed in a previous work. As an application, we study the elementary case of a symmetric bifurcating autoregressive process, which justifies the nontrivial hypothesis considered on the kernel transition of the BMCs. We illustrate in this example the phase transition observed in the fluctuations.

The random-cluster model is a unifying framework for studying random graphs, spin systems and electrical networks that plays a fundamental role in designing efficient Markov Chain Monte Carlo (MCMC) sampling algorithms for the classical ferromagnetic Ising and Potts models. In this paper, we study a natural non-local Markov chain known as the Chayes–Machta (CM) dynamics for the mean-field case of the random-cluster model, where the underlying graph is the complete graph on n vertices. The random-cluster model is parametrised by an edge probability p and a cluster weight q. Our focus is on the critical regime: $p = p_c(q)$ and $q \in (1,2)$ , where $p_c(q)$ is the threshold corresponding to the order–disorder phase transition of the model. We show that the mixing time of the CM dynamics is $O({\log}\ n \cdot \log \log n)$ in this parameter regime, which reveals that the dynamics does not undergo an exponential slowdown at criticality, a surprising fact that had been predicted (but not proved) by statistical physicists. This also provides a nearly optimal bound (up to the $\log\log n$ factor) for the mixing time of the mean-field CM dynamics in the only regime of parameters where no non-trivial bound was previously known. Our proof consists of a multi-phased coupling argument that combines several key ingredients, including a new local limit theorem, a precise bound on the maximum of symmetric random walks with varying step sizes and tailored estimates for critical random graphs. In addition, we derive an improved comparison inequality between the mixing time of the CM dynamics and that of the local Glauber dynamics on general graphs; this results in better mixing time bounds for the local dynamics in the mean-field setting.

Consider the following iterated process on a hypergraph H. Each vertex v starts with some initial weight $x_v$ . At each step, uniformly at random select an edge e in H, and for each vertex v in e replace the weight of v by the average value of the vertex weights over all vertices in e. This is a generalization of an interactive process on graphs which was first introduced by Aldous and Lanoue. In this paper we use the eigenvalues of a Laplacian for hypergraphs to bound the rate of convergence for this iterated averaging process.

We give a setting of the Diaconis–Freedman chain in a multi-dimensional simplex and consider its asymptotic behavior. By using techniques from random iterated function theory and quasi-compact operator theory, we first give some sufficient conditions which ensure the existence and uniqueness of an invariant probability measure and, in particular cases, explicit formulas for the invariant probability density. Moreover, we completely classify all behaviors of this chain in dimension two. Some other settings of the chain are also discussed.