Hostname: page-component-745bb68f8f-hvd4g Total loading time: 0 Render date: 2025-01-13T14:09:57.011Z Has data issue: false hasContentIssue false
  • English
  • Français

Bisimulations for non-deterministic labelled Markov processes†

Published online by Cambridge University Press:  26 September 2011

PEDRO R. D'ARGENIO ,
PEDRO SÁNCHEZ TERRAF  and
NICOLÁS WOLOVICK
PEDRO R. D'ARGENIO
Affiliation:
FaMAF, Universidad Nacional de Córdoba and CONICET, Medina Allende s/n (Ciudad Universitaria), X5000HUA – Córdoba, Argentina Email: dargenio@famaf.unc.edu.ar
PEDRO SÁNCHEZ TERRAF
Affiliation:
FaMAF, Universidad Nacional de Córdoba, CONICET and CIEM, Medina Allende s/n (Ciudad Universitaria), X5000HUA – Córdoba, Argentina Email: sterraf@famaf.unc.edu.ar
NICOLÁS WOLOVICK
Affiliation:
FaMAF, Universidad Nacional de Córdoba, Medina Allende s/n (Ciudad Universitaria), X5000HUA – Córdoba, Argentina Email: nicolasw@famaf.unc.edu.ar
Get access Rights & Permissions [Opens in a new window]

Abstract

We extend the theory of labelled Markov processes to include internal non-determinism, which is a fundamental concept for the further development of a process theory with abstraction on non-deterministic continuous probabilistic systems. We define non-deterministic labelled Markov processes (NLMP) and provide three definitions of bisimulations: a bisimulation following a traditional characterisation; a state-based bisimulation tailored to our ‘measurable’ non-determinism; and an event-based bisimulation. We show the relations between them, including the fact that the largest state bisimulation is also an event bisimulation. We also introduce a variation of the Hennessy–Milner logic that characterises event bisimulation and is sound with respect to the other bisimulations for an arbitrary NLMP. This logic, however, is infinitary as it contains a denumerable . We then introduce a finitary sublogic that characterises all bisimulations for an image finite NLMP whose underlying measure space is also analytic. Hence, in this setting, all the notions of bisimulation we consider turn out to be equal. Finally, we show that all these bisimulation notions are different in the general case. The counterexamples that separate them turn out to be non-probabilistic NLMPs.

Type
Paper
Information
Mathematical Structures in Computer Science , Volume 22 , Issue 1 , February 2012 , pp. 43 - 68
Copyright
Copyright © Cambridge University Press 2011

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Billingsley, P. (1995) Probability and Measure, Wiley-Interscience.Google Scholar
Bohnenkamp, H., D'Argenio, P. R., Hermanns, H. and Katoen, J.-P. (2006) MoDeST: A compositional modeling formalism for real-time and stochastic systems. IEEE Trans. Softw. Eng. 32 812–830.CrossRefGoogle Scholar
Bravetti, M. (2002) Specification and Analysis of Stochastic Real-Time Systems, Ph.D. thesis, Università di Bologna, Padova, Venezia.CrossRefGoogle Scholar
Bravetti, M. and D'Argenio, P. R. (2004) Tutte le algebre insieme: Concepts, discussions and relations of stochastic process algebras with general distributions. In: Validation of Stochastic Systems. Springer-Verlag Lecture Notes in Computer Science 2925 44–88.CrossRefGoogle Scholar
van Breugel, F. (2005) The metric monad for probabilistic nondeterminism. Draft.Google Scholar
Cattani, S. (2005) Trace-based Process Algebras for Real-Time Probabilistic Systems, Ph.D. thesis, University of Birmingham.Google Scholar
Cattani, S., Segala, R., Kwiatkowska, M. Z. and Norman, G. (2005) Stochastic transition systems for continuous state spaces and non-determinism. In: Proceedings FoSSaCS 2005. Springer-Verlag Lecture Notes in Computer Science 3441 125–139.CrossRefGoogle Scholar
Celayes, P. (2006) Procesos de Markov etiquetados sobre espacios de Borel estándar. Master's thesis, FaMAF, Universidad Nacional de Córdoba.Google Scholar
Clarke, E. M., Grumberg, O. and Peled, D. (1999) Model Checking, MIT Press.Google Scholar
Danos, V., Desharnais, J., Laviolette, F. and Panangaden, P. (2006) Bisimulation and cocongruence for probabilistic systems. Information and Computation 204 503–523.CrossRefGoogle Scholar
D'Argenio, P. R. (1999) Algebras and Automata for Timed and Stochastic Systems, Ph.D. thesis, Department of Computer Science, University of Twente.Google Scholar
D'Argenio, P. R. and Katoen, J.-P. (2005) A theory of stochastic systems, Part I: Stochastic automata, and Part II: Process algebra. Information and Computation 203 1–38, 39–74.CrossRefGoogle Scholar
D'Argenio, P. R., Wolovick, N., Terraf, P. S. and Celayes, P. (2009) Nondeterministic labeled markov processes: Bisimulations and logical characterization. In: Quantitative Evaluation of Systems, International Conference on, IEEE Computer Society 11–20.Google Scholar
Desharnais, J. (1999) Labeled Markov Process, Ph.D. thesis, McGill University.Google Scholar
Desharnais, J. and Panangaden, P. (2003) Continuous stochastic logic characterizes bisimulation of continuous-time Markov processes. J. Log. Algebr. Program. 56 (1-2)99–115.CrossRefGoogle Scholar
Desharnais, J., Edalat, A. and Panangaden, P.Bisimulation for labelled Markov processes. Information and Computation 179 (2)163–193.CrossRefGoogle Scholar
Doberkat, E.-E. (2007) Stochastic relations. Foundations for Markov transition systems, Studies in Informatics Series, Chapman and Hall.CrossRefGoogle Scholar
Giry, M. (1981) A categorical approach to probability theory. In: Categorical Aspects of Topology and Analysis. Springer-Verlag Lecture Notes in Mathematics 915 68–85.CrossRefGoogle Scholar
van Glabeek, R. J. (2001) The linear time–branching time spectrum I. The semantics of concrete, sequential processes. In: Bergstra, J. A., Ponse, A. and Smolka, S. A. (eds.) Handbook of Process Algebra, North-Holland3–99.CrossRefGoogle Scholar
Kechris, A. S. (1995) Classical Descriptive Set Theory, Graduate Texts in Mathematics 156Springer-Verlag.CrossRefGoogle Scholar
Larsen, K. G. and Skou, A. (1991) Bisimulation through probabilistic testing. Information and Computation 94 (1)1–28.CrossRefGoogle Scholar
Milner, R. (1989) Communication and Concurrency, Prentice Hall.Google Scholar
Naimpally, S. (2003) What is a hit-and-miss topology? Topological Commentary 8 (1).Google Scholar
Parma, A. and Segala, R. (2007) Logical characterizations of bisimulations for discrete probabilistic systems. In: Proceedings FoSSaCS 07. Springer-Verlag Lecture Notes in Computer Science 4423 287–301.CrossRefGoogle Scholar
Puterman, M. L. (1994) Markov Decision Processes: Discrete Stochastic Dynamic Programming, Wiley-Interscience.CrossRefGoogle Scholar
Segala, R. (1995) Modeling and Verification of Randomized Distributed Real-Time Systems, Ph.D. thesis, Massachusetts Institute of Technology.Google Scholar
Strulo, B. (1993) Process Algebra for Discrete Event Simulation, Ph.D. thesis, Department of Computing, Imperial College, University of London.Google Scholar
Vardi, M. Y. (1985) Automatic verification of probabilistic concurrent finite-state programs. In: Proceedings 26th FOCS, IEEE Computer Society 327–338.Google Scholar
Viglizzo, I. D. (2005) Coalgebras on Measurable Spaces, Ph.D. thesis, Department of Mathematics, Indiana University.Google Scholar