We are interested in a large queue in a GI/G/k queue with heterogeneous servers. For this, we consider tail asymptotics and weak limit approximations for the stationary distribution of its queue length process in continuous time under a stability condition. Here, two weak limit approximations are considered. One is when the variances of the interarrival and/or service times are bounded, and the other is when they become large. Both require a heavy-traffic condition. Tail asymptotics and heavy-traffic approximations have been separately studied in the literature. We develop a unified approach based on a martingale produced by a good test function for a Markov process to answer both problems.

In this paper we study nonparametric estimation problems for a class of piecewise-deterministic Markov processes (PDMPs). Borovkov and Last (2008) proved a version of Rice's formula for PDMPs, which explains the relation between the stationary density and the level crossing intensity. From a statistical point of view, their result suggests a methodology for estimating the stationary density from observations of a sample path of PDMPs. First, we introduce the local time related to the level crossings and construct the local-time estimator for the stationary density, which is unbiased and uniformly consistent. Secondly, we investigate other estimation problems for the jump intensity and the conditional jump size distribution.

Motivated by stability questions on piecewise-deterministic Markov models of bacterial chemotaxis, we study the long-time behavior of a variant of the classic telegraph process having a nonconstant jump rate that induces a drift towards the origin. We compute its invariant law and show exponential ergodicity, obtaining a quantitative control of the total variation distance to equilibrium at each instant of time. These results rely on an exact description of the excursions of the process away from the origin and on the explicit construction of an original coalescent coupling for both the velocity and position. Sharpness of the obtained convergence rate is discussed.

In this paper we consider the generalized Hodgkin-Huxley model introduced in Austin (2008). This model describes the propagation of an action potential along the axon of a neuron at the scale of ion channels. Mathematically, this model is a fully coupled piecewise-deterministic Markov process (PDMP) in infinite dimensions. We introduce two time scales in this model in considering that some ion channels open and close at faster jump rates than others. We perform a slow-fast analysis of this model and prove that, asymptotically, this ‘two-time-scale’ model reduces to the so-called averaged model, which is still a PDMP in infinite dimensions, for which we provide effective evolution equations and jump rates.

A classical result about Markov jump processes states that a certain class of dynamical systems given by ordinary differential equations are obtained as the limit of a sequence of scaled Markov jump processes. This approach fails if the scaling cannot be carried out equally across all entities. In the present paper we present a convergence theorem for such an unequal scaling. In contrast to an equal scaling the limit process is not purely deterministic but still possesses randomness. We show that these processes constitute a rich subclass of piecewise-deterministic processes. Such processes apply in molecular biology where entities often occur in different scales of numbers.

We present a numerical method to compute the survival function and the moments of the exit time for a piecewise-deterministic Markov process (PDMP). Our approach is based on the quantization of an underlying discrete-time Markov chain related to the PDMP. The approximation we propose is easily computable and is even flexible with respect to the exit time we consider. We prove the convergence of the algorithm and obtain bounds for the rate of convergence in the case of the moments. We give an academic example and a model from the reliability field to illustrate the results of the paper.

We introduce a new point process, the dynamic contagion process, by generalising the Hawkes process and the Cox process with shot noise intensity. Our process includes both self-excited and externally excited jumps, which could be used to model the dynamic contagion impact from endogenous and exogenous factors of the underlying system. We have systematically analysed the theoretical distributional properties of this new process, based on the piecewise-deterministic Markov process theory developed in Davis (1984), and the extension of the martingale methodology used in Dassios and Jang (2003). The analytic expressions of the Laplace transform of the intensity process and the probability generating function of the point process have been derived. An explicit example of specified jumps with exponential distributions is also given. The object of this study is to produce a general mathematical framework for modelling the dependence structure of arriving events with dynamic contagion, which has the potential to be applicable to a variety of problems in economics, finance, and insurance. We provide an application of this process to credit risk, and a simulation algorithm for further industrial implementation and statistical analysis.

In this paper we establish limit theorems for a class of stochastic hybrid systems (continuous deterministic dynamics coupled with jump Markov processes) in the fluid limit (small jumps at high frequency), thus extending known results for jump Markov processes. We prove a functional law of large numbers with exponential convergence speed, derive a diffusion approximation, and establish a functional central limit theorem. We apply these results to neuron models with stochastic ion channels, as the number of channels goes to infinity, estimating the convergence to the deterministic model. In terms of neural coding, we apply our central limit theorems to numerically estimate the impact of channel noise both on frequency and spike timing coding.

This work is concerned with the existence of an optimal control strategy for the long-run average continuous control problem of piecewise-deterministic Markov processes (PDMPs). In Costa and Dufour (2008), sufficient conditions were derived to ensure the existence of an optimal control by using the vanishing discount approach. These conditions were mainly expressed in terms of the relative difference of the α-discount value functions. The main goal of this paper is to derive tractable conditions directly related to the primitive data of the PDMP to ensure the existence of an optimal control. The present work can be seen as a continuation of the results derived in Costa and Dufour (2008). Our main assumptions are written in terms of some integro-differential inequalities related to the so-called expected growth condition, and geometric convergence of the post-jump location kernel associated to the PDMP. An example based on the capacity expansion problem is presented, illustrating the possible applications of the results developed in the paper.

We consider a piecewise-deterministic Markov process (Xt) governed by a jump intensity function, a rate function that determines the behaviour between jumps, and a stochastic kernel describing the conditional distribution of jump sizes. The paper deals with the point process of upcrossings of some level b by (Xt). We prove a version of Rice's formula relating the stationary density of (Xt) to level crossing intensities and show that, for a wide class of processes (Xt), as b → ∞, the scaled point process where ν+(b) denotes the intensity of upcrossings of b, converges weakly to a geometrically compound Poisson process.

The TCP window size process can be modeled as a piecewise-deterministic Markov process that increases linearly and experiences downward jumps at Poisson times. We present a transient analysis of this window size process. Our main result is the Laplace transform of the transient moments. Formulae for the integer and fractional moments are derived, as well as an explicit characterization of the speed of convergence to steady state. Central to our approach are the infinitesimal generator and Dynkin's martingale.

We consider growth-collapse processes (GCPs) that grow linearly between random partial collapse times, at which they jump down according to some distribution depending on their current level. The jump occurrences are governed by a state-dependent rate function r(x). We deal with the stationary distribution of such a GCP, (Xt)t≥0, and the distributions of the hitting times Ta = inf{t ≥ 0 : Xt = a}, a > 0. After presenting the general theory of these GCPs, several important special cases are studied. We also take a brief look at the Markov-modulated case. In particular, we present a method of computing the distribution of min[Ta, σ] in this case (where σ is the time of the first jump), and apply it to determine the long-run average cost of running a certain Markov-modulated disaster-ridden system.

We describe a stochastic susceptible–infective–susceptible (SIS) model for transmission of infectious disease through a population, incorporating both direct host–host transmission and indirect transmission via free-living infectious stages (e.g. environmental bacteria). Existence of a quasi-stationary distribution conditional upon nonextinction of infection is established. A bivariate Ornstein–Uhlenbeck approximation is used to investigate the long-term behaviour of the process conditional upon nonextinction of infection. We show that indirect transmission leads to lower variability in the number of infected hosts present in quasi-stationarity and, consequently, to a greater tendency of infection to persist, compared with a model with direct transmission only and the same average individual infectivity. Some numerical work illustrating these results is presented.