One result that is of both theoretical and practical importance regarding point processes is the method of thinning. The basic idea of this method is that under some conditions, there exists an embedded Poisson process in any point process such that all its arrival points form a sub-sequence of the Poisson process. We extend this result by showing that on the embedded Poisson process of a uni- or multi-variable marked point process in which interarrival time distributions may depend on the marks, one can define a Markov chain with a discrete state that characterizes the stage of the interarrival times. This implies that one can construct embedded Markov chains with countable state spaces for the state processes of many practical systems that can be modeled by such point processes.

A new approach is used to obtain the transient probabilities of the M/M/1 queueing system. The first step of this approach deals with the generating function of the transient probabilities of the uniformized Markov chain associated with this queue. The second step consists of the inversion of this generating function. A new analytical expression of the transient probabilities of the M/M/1 queue is then obtained.