Moments in Markovian systems with lumped states

Abstract

In dealing with Markov chains, we are sometimes forced by circumstances to make observations on lumped states. We may wish, however, to deal with a random variable which is a function of the numbers in the various (unlumped) states at various times and whose moments, therefore, will involve the probabilities of transition between the unlumped states.

This paper demonstrates that, although these probabilities are immeasurable directly, we can, provided that we restrict our attention to a certain well-defined class of functions as our random variables, reduce all moments and product-moments of such random variables to functions of lumped state probabilities.