We add sequential operations to the categorical algebra of weighted andMarkov automata introduced in [L. de Francesco Albasini, N. Sabadini and R.F.C. Walters,
arXiv:0909.4136]. The extra expressiveness of the algebra permits the description of hierarchical systems, and ones withevolving geometry. We make a comparison with the probabilistic automata of Lynch et al. [SIAM J. Comput.37 (2007) 977–1013].