We consider residue expansions for survival and density/mass functions of first-passage distributions in finite-state semi-Markov processes (SMPs) in continuous and integer time. Conditions are given which guarantee that the residue expansions for these functions have a dominant exponential/geometric term. The key condition assumes that the relevant states for first passage contain an irreducible class, thus ensuring the same sort of dominant exponential/geometric terms as one gets for phase-type distributions in Markov processes. Essentially, the presence of an irreducible class along with some other conditions ensures that the boundary singularity b for the moment generating function (MGF) of the first-passage-time distribution is a simple pole. In the continuous-time setting we prove that b is a dominant pole, in that the MGF has no other pole on the vertical line $\{\text{Re}(s)=b\}.$ In integer time we prove that b is dominant if all holding-time mass functions for the SMP are aperiodic and non-degenerate. The expansions and pole characterisations address first passage to a single new state or a subset of new states, and first return to the starting state. Numerical examples demonstrate that the residue expansions are considerably more accurate than saddlepoint approximations and can provide a substitute for exact computation above the 75th percentile.

Network dynamics with point-process-based interactions are of paramount modeling interest. Unfortunately, most relevant dynamics involve complex graphs of interactions for which an exact computational treatment is impossible. To circumvent this difficulty, the replica-mean-field approach focuses on randomly interacting replicas of the networks of interest. In the limit of an infinite number of replicas, these networks become analytically tractable under the so-called ‘Poisson hypothesis’. However, in most applications this hypothesis is only conjectured. In this paper we establish the Poisson hypothesis for a general class of discrete-time, point-process-based dynamics that we propose to call fragmentation-interaction-aggregation processes, and which are introduced here. These processes feature a network of nodes, each endowed with a state governing their random activation. Each activation triggers the fragmentation of the activated node state and the transmission of interaction signals to downstream nodes. In turn, the signals received by nodes are aggregated to their state. Our main contribution is a proof of the Poisson hypothesis for the replica-mean-field version of any network in this class. The proof is obtained by establishing the propagation of asymptotic independence for state variables in the limit of an infinite number of replicas. Discrete-time Galves–Löcherbach neural networks are used as a basic instance and illustration of our analysis.

We define a new family of multivariate stochastic processes over a finite time horizon that we call generalised Liouville processes (GLPs). GLPs are Markov processes constructed by splitting Lévy random bridges into non-overlapping subprocesses via time changes. We show that the terminal values and the increments of GLPs have generalised multivariate Liouville distributions, justifying their name. We provide various other properties of GLPs and some examples.

In a recent article, Döring et al. (2018) conditioned a stable process with two-sided jumps to avoid an interval. As usual, the strategy was to find an invariant function for the process killed on entering the interval and to show that the corresponding h-transformed process is indeed the process conditioned to avoid an interval in a meaningful way. In the present article we consider the case of a completely asymmetric stable process. It turns out that the invariant function found by Döring et al. does not exist or is not invariant, but nonetheless we will characterise the conditioned process as a Markov process.

We are interested in the rate of convergence of a subordinate Markov process to its invariant measure. Given a subordinator and the corresponding Bernstein function (Laplace exponent), we characterize the convergence rate of the subordinate Markov process; the key ingredients are the rate of convergence of the original process and the (inverse of the) Bernstein function. At a technical level, the crucial point is to bound three types of moment (subexponential, algebraic, and logarithmic) for subordinators as time t tends to ∞. We also discuss some concrete models and we show that subordination can dramatically change the speed of convergence to equilibrium.

We establish a local martingale M associate with f(X,Y) under some restrictions on f, where Y is a process of bounded variation (on compact intervals) and either X is a jump diffusion (a special case being a Lévy process) or X is some general (càdlàg metric-space valued) Markov process. In the latter case, f is restricted to the form f(x,y)=∑k=1Kξk(x)ηk(y). This local martingale unifies both Dynkin's formula for Markov processes and the Lebesgue–Stieltjes integration (change of variable) formula for (right-continuous) functions of bounded variation. For the jump diffusion case, when further relatively easily verifiable conditions are assumed, then this local martingale becomes an L2-martingale. Convergence of the product of this Martingale with some deterministic function ( of time ) to 0 both in L2 and almost sure is also considered and sufficient conditions for functions for which this happens are identified.

Comparison results are given for time-inhomogeneous Markov processes with respect to function classes with induced stochastic orderings. The main result states the comparison of two processes, provided that the comparability of their infinitesimal generators as well as an invariance property of one process is assumed. The corresponding proof is based on a representation result for the solutions of inhomogeneous evolution problems in Banach spaces, which extends previously known results from the literature. Based on this representation, an ordering result for Markov processes induced by bounded and unbounded function classes is established. We give various applications to time-inhomogeneous diffusions, to processes with independent increments, and to Lévy-driven diffusion processes.

Objectives: Long-term follow-up of the Caries Management System (CMS) protocol demonstrated that regular monitoring and noninvasive management of dental caries is effective in reducing the number of caries-related events over a 7-year period. This analysis complements the authors’ original economic evaluation of the CMS by re-evaluating the per-protocol cost-effectiveness of the CMS approach.

Methods: An individual patient-simulation Markov model was developed previously, based on 3-year randomized-controlled trial (RCT) data, to simulate the incidence and progression of dental caries, and resultant interventions, and to evaluate the lifetime cost-effectiveness of the CMS versus standard dental care from the Australian private dental practitioner perspective (in which the baseline age distribution was similar to that of the Australian population). The 4-year posttrial follow-up data are used to re-evaluate the long-term cost-effectiveness of the CMS in a more real-life setting.

Results: The reduction in caries risk was maintained among those practices within which the CMS protocols were adhered to. The per-protocol model appears to be reasonably accurate at predicting the risk of restorative events in the posttrial follow-up period. The per-protocol lifetime cost per restorative event avoided is AUD1,980 (USD1,409; 1 AUD = 0.71 USD).

Conclusions: The current analysis confirms that the CMS approach is both effective, when the protocols are adhered to appropriately, and cost-effective compared with standard care in the Australian private practice setting.

We establish an integral test on the lower escape rate of symmetric jump-diffusion processes generated by regular Dirichlet forms. Using this test, we can find the speed of particles escaping to infinity. We apply this test to symmetric jump processes of variable order. We also derive the upper and lower escape rates of time-changed processes by using those of underlying processes.

The paper deals with nonlinear Poisson neuron network models with bounded memory dynamics, which can include both Hebbian learning mechanisms and refractory periods. The state of the network is described by the times elapsed since its neurons fired within the post-synaptic transfer kernel memory span, and the current strengths of synaptic connections, the state spaces of our models being hierarchies of finite-dimensional components. We prove the ergodicity of the stochastic processes describing the behaviour of the networks, establish the existence of continuously differentiable stationary distribution densities (with respect to the Lebesgue measures of corresponding dimensionality) on the components of the state space, and find upper bounds for them. For the density components, we derive a system of differential equations that can be solved in a few simplest cases only. Approaches to approximate computation of the stationary density are discussed. One approach is to reduce the dimensionality of the problem by modifying the network so that each neuron cannot fire if the number of spikes it emitted within the post-synaptic transfer kernel memory span reaches a given threshold. We show that the stationary distribution of this ‘truncated’ network converges to that of the unrestricted network as the threshold increases, and that the convergence is at a superexponential rate. A complementary approach uses discrete Markov chain approximations to the network process.

The human connectome has been widely studied over the past decade. A principal finding is that it can be decomposed into communities of densely interconnected brain regions. Past studies have often used single-scale modularity measures in order to infer the connectome's community structure, possibly overlooking interesting structure at other organizational scales. In this report, we used the partition stability framework, which defines communities in terms of a Markov process (random walk), to infer the connectome's multi-scale community structure. Comparing the community structure to observed resting-state functional connectivity revealed communities across a broad range of scales that were closely related to functional connectivity. This result suggests a mapping between communities in structural networks, models of influence-spreading and diffusion, and brain function. It further suggests that the spread of influence among brain regions may not be limited to a single characteristic scale.

Markovian systems with multiple interacting subsystems under the influence of a control unit are considered. The state spaces of the subsystems are countably infinite, whereas that of the control unit is finite. A recent infinite level-dependent quasi-birth-and-death model for such systems is extended by facilitating the automatic representation and generation of the nonzero blocks in its underlying infinitesimal generator matrix with sums of Kronecker products. Experiments are performed on systems of stochastic chemical kinetics having two or more countably infinite state space subsystems. Results indicate that, even though more memory is consumed, there are many cases where a matrix-analytic solution coupled with Lyapunov theory yields a faster and more accurate steady-state measure compared to that obtained with simulation.

We define a class of stochastic processes, denoted as marked rational arrival processes (MRAPs), which is an extension of matrix exponential distributions and rational arrival processes. Continuous-time Markov processes with labeled transitions are a subclass of this more general model class. New equivalence relations between processes are defined, and it is shown that these equivalence relations are natural extensions of strong and weak lumpability and the corresponding bisimulation relations that have been defined for Markov processes. If a general rational process is equivalent to a Markov process, it can be used in numerical analysis techniques instead of the Markov process. This observation allows one to apply MRAPs like Markov processes and since the new equivalence relations are more general than lumpability and bisimulation, it is sometimes possible to find smaller representations of given processes. Finally, we show that the equivalence is preserved by the composition of MRAPs and can therefore be exploited in compositional modeling.

Let {Mn}n≥0 be a nonnegative time-homogeneous Markov process. The quasistationary distributions referred to in this note are of the form QA(x) = limn→∞P(Mn ≤ x | M0 ≤ A, M1 ≤ A, …, Mn ≤ A). Suppose that M0 has distribution QA, and define TAQA = min{n | Mn > A, n ≥ 1}, the first time when Mn exceeds A. We provide sufficient conditions for QA(x) to be nonincreasing in A (for fixed x) and for TAQA to be stochastically nondecreasing in A.

We add sequential operations to the categorical algebra of weighted andMarkov automata introduced in [L. de Francesco Albasini, N. Sabadini and R.F.C. Walters, 
arXiv:0909.4136]. The extra expressiveness of the algebra permits the description of hierarchical systems, and ones withevolving geometry. We make a comparison with the probabilistic automata of Lynch et al. [SIAM J. Comput.37 (2007) 977–1013].

The point process of vertices of an iteration infinitely divisible or, more specifically, of an iteration stable random tessellation in the Euclidean plane is considered. We explicitly determine its covariance measure and its pair-correlation function, as well as the cross-covariance measure and the cross-correlation function of the vertex point process and the random length measure in the general nonstationary regime. We also give special formulae in the stationary and isotropic setting. Exact formulae are given for vertex count variances in compact and convex sampling windows, and asymptotic relations are derived. Our results are then compared with those for a Poisson line tessellation having the same length density parameter. Moreover, a functional central limit theorem for the joint process of suitably rescaled total edge counts and edge lengths is established with the process (ξ, tξ), t > 0, arising in the limit, where ξ is a centered Gaussian variable with explicitly known variance.