By the technique of augmented truncations, we obtain the perturbation bounds on the distance of the finite-time state distributions of two continuous-time Markov chains (CTMCs) in a type of weaker norm than the V-norm. We derive the estimates for strongly and exponentially ergodic CTMCs. In particular, we apply these results to get the bounds for CTMCs satisfying Doeblin or stochastically monotone conditions. Some examples are presented to illustrate the limitation of the V-norm in perturbation analysis and to show the quality of the weak norm.

We establish exponential ergodicity for a class of Markov processes with interactions, including two-factor type processes and Gruschin type processes. The proof is elementary and direct via the Markov coupling technique.

This paper is devoted to the study of regime-switching jump diffusion processes with countable regimes. It aims to establish Foster–Lyapunov-type criteria for exponential ergodicity of such processes. After recalling results concerning the petiteness of compact sets, this paper presents sufficient conditions for the existence of a Foster–Lyapunov function; this, in turn, helps to establish sufficient conditions for the desired exponential ergodicity for regime-switching jump diffusion processes. Finally, an application to feedback control problems is presented.

We study ergodic properties of a class of Markov-modulated general birth–death processes under fast regime switching. The first set of results concerns the ergodic properties of the properly scaled joint Markov process with a parameter that is taken to be large. Under very weak hypotheses, we show that if the averaged process is exponentially ergodic for large values of the parameter, then the same applies to the original joint Markov process. The second set of results concerns steady-state diffusion approximations, under the assumption that the ‘averaged’ fluid limit exists. Here, we establish convergence rates for the moments of the approximating diffusion process to those of the Markov-modulated birth–death process. This is accomplished by comparing the generator of the approximating diffusion and that of the joint Markov process. We also provide several examples which demonstrate how the theory can be applied.

We study an affine two-factor model introduced by Barczy et al. (2014). One component of this two-dimensional model is the so-called α-root process, which generalizes the well-known Cox–Ingersoll–Ross process. In the α = 2 case, this two-factor model was used by Chen and Joslin (2012) to price defaultable bonds with stochastic recovery rates. In this paper we prove exponential ergodicity of this two-factor model when α ∈ (1, 2). As a possible application, our result can be used to study the parameter estimation problem of the model.

The goal of this paper is to identify exponential convergence rates and to find computable bounds for them for Markov processes representing unreliable Jackson networks. First, we use the bounds of Lawler and Sokal (1988) in order to show that, for unreliable Jackson networks, the spectral gap is strictly positive if and only if the spectral gaps for the corresponding coordinate birth and death processes are positive. Next, utilizing some results on birth and death processes, we find bounds on the spectral gap for network processes in terms of the hazard and equilibrium functions of the one-dimensional marginal distributions of the stationary distribution of the network. These distributions must be in this case strongly light-tailed, in the sense that their discrete hazard functions have to be separated from 0. We relate these hazard functions with the corresponding networks' service rate functions using the equilibrium rates of the stationary one-dimensional marginal distributions. We compare the obtained bounds on the spectral gap with some other known bounds.

We consider a general homogeneous continuous-time Markov process with restarts. The process is forced to restart from a given distribution at time moments generated by an independent Poisson process. The motivation to study such processes comes from modeling human and animal mobility patterns, restart processes in communication protocols, and from application of restarting random walks in information retrieval. We provide a connection between the transition probability functions of the original Markov process and the modified process with restarts. We give closed-form expressions for the invariant probability measure of the modified process. When the process evolves on the Euclidean space, there is also a closed-form expression for the moments of the modified process. We show that the modified process is always positive Harris recurrent and exponentially ergodic with the index equal to (or greater than) the rate of restarts. Finally, we illustrate the general results by the standard and geometric Brownian motions.

Based on the explicit coupling property, the ergodicity and the exponential ergodicity of Lévy-driven Ornstein–Uhlenbeck processes are established.

This work is concerned with a class of mean-field models given by a switching diffusion with a continuous-state-dependent switching process. Focusing on asymptotic properties, the regularity or nonexplosiveness, Feller continuity, and strong Feller continuity are established by means of introducing certain auxiliary processes and by making use of the truncations. Based on these results, exponential ergodicity is obtained under the Foster–Lyapunov drift conditions. By virtue of the coupling methods, the strong ergodicity or uniform ergodicity in the sense of convergence in the variation norm is established for the mean-field model with a Markovian switching process. Besides this, several examples are presented for demonstration and illustration.

This paper compares the convergence rate properties of three storage models (dams) driven by time-homogeneous jump process input: the infinitely high dam, the finite dam, and the infinitely deep dam. We show that the convergence rate of the infinitely high dam depends on the moment properties of the input process, the finite dam always approaches its limiting distribution exponentially fast, and the infinitely deep dam approaches its limiting distribution exponentially fast under very general conditions. Our methods make use of rate results for regenerative processes and several sample path orderings.

A threshold AR(1) process with boundary width 2δ > 0 was defined by Brockwell and Hyndman [5] in terms of the unique strong solution of a stochastic differential equation whose coefficients are piecewise linear and Lipschitz. The positive boundary-width is a convenient mathematical device to smooth out the coefficient changes at the boundary and hence to ensure the existence and uniqueness of the strong solution of the stochastic differential equation from which the process is derived. In this paper we give a direct definition of a threshold AR(1) process with δ = 0 in terms of the weak solution of a certain stochastic differential equation. Two characterizations of the distributions of the process are investigated. Both express the characteristic function of the transition probability distribution as an explicit functional of standard Brownian motion. It is shown that the joint distributions of this solution with δ = 0 are the weak limits as δ ↓ 0 of the distributions of the solution with δ > 0. The sense in which an approximating sequence of processes used by Brockwell and Hyndman [5] converges to this weak solution is also investigated. Some numerical examples illustrate the value of the latter approximation in comparison with the more direct representation of the process obtained from the Cameron–Martin–Girsanov formula and results of Engelbert and Schmidt [9]. We also derive the stationary distribution (under appropriate assumptions) and investigate stability of these processes.

This paper examines the infinitely high dam with seasonal (periodic) Lévy input under the unit release rule. We show that a periodic limiting distribution of dam content exists whenever the mean input over a seasonal cycle is less than 1. The Laplace transform of dam content at a finite time and the Laplace transform of the periodic limiting distribution are derived in terms of the probability of an empty dam. Necessary and sufficient conditions for the periodic limiting distribution to have finite moments are given. Convergence rates to the periodic limiting distribution are obtained from the moment results. Our methods of analysis lean heavily on the coupling method and a stochastic monotonicity result.

In Part I we developed stability concepts for discrete chains, together with Foster–Lyapunov criteria for them to hold. Part II was devoted to developing related stability concepts for continuous-time processes. In this paper we develop criteria for these forms of stability for continuous-parameter Markovian processes on general state spaces, based on Foster-Lyapunov inequalities for the extended generator.

Such test function criteria are found for non-explosivity, non-evanescence, Harris recurrence, and positive Harris recurrence. These results are proved by systematic application of Dynkin's formula.

We also strengthen known ergodic theorems, and especially exponential ergodic results, for continuous-time processes. In particular we are able to show that the test function approach provides a criterion for f-norm convergence, and bounding constants for such convergence in the exponential ergodic case.

We apply the criteria to several specific processes, including linear stochastic systems under non-linear feedback, work-modulated queues, general release storage processes and risk processes.

The ergodic properties of birth and death processes are studied. We obtain some explicit estimates for the rate of convergence by the methods of theory of differential equations.

Exact expressions are derived for the transition probabilities of the birth-death process with parameters and which serves as a queueing model where potential customers are discouraged by queue length.