Book contents
- Frontmatter
- Dedication
- Contents
- Introduction
- 1 Markov Decision Problems
- 2 A Tauberian Theorem and Uniform ∈-Optimality in Hidden Markov Decision Problems
- 3 Strategic-Form Games: A Review
- 4 Stochastic Games: The Model
- 5 Two-Player Zero-Sum Discounted Games
- 6 Semi-Algebraic Sets and the Limit of the Discounted Value
- 7 B-Graphs and the Continuity of the Limit limλ→0 ʋλ(s;q,r)
- 8 Kakutani’s Fixed-Point Theorem and Multiplayer Discounted Stochastic Games
- 9 Uniform Equilibrium
- 10 The Vanishing Discount Factor Approach and Uniform Equilibrium in Absorbing Games
- 11 Ramsey’s Theorem and Two-Player Deterministic Stopping Games
- 12 Infinite Orbits and Quitting Games
- 13 Linear Complementarity Problems and Quitting Games
- References
- Index
1 - Markov Decision Problems
Published online by Cambridge University Press: 05 May 2022
Book contents
- Frontmatter
- Dedication
- Contents
- Introduction
- 1 Markov Decision Problems
- 2 A Tauberian Theorem and Uniform ∈-Optimality in Hidden Markov Decision Problems
- 3 Strategic-Form Games: A Review
- 4 Stochastic Games: The Model
- 5 Two-Player Zero-Sum Discounted Games
- 6 Semi-Algebraic Sets and the Limit of the Discounted Value
- 7 B-Graphs and the Continuity of the Limit limλ→0 ʋλ(s;q,r)
- 8 Kakutani’s Fixed-Point Theorem and Multiplayer Discounted Stochastic Games
- 9 Uniform Equilibrium
- 10 The Vanishing Discount Factor Approach and Uniform Equilibrium in Absorbing Games
- 11 Ramsey’s Theorem and Two-Player Deterministic Stopping Games
- 12 Infinite Orbits and Quitting Games
- 13 Linear Complementarity Problems and Quitting Games
- References
- Index
HTML view is not available for this content. However, as you have access to this content, a full PDF is available via the 'Save PDF' action button.
Summary
In this chapter, we present the notions of Markov decision problem, the T-stage evaluation and the discounted evaluation. We introduce and study contracting mappings, and use such mappings to show that the decision maker has a stationary discounted optimal strategy. We also define the concept of uniform optimality, and show that the decision maker has a stationary uniformly optimal strategy.
Keywords
- Type
- Chapter
- Information
- A Course in Stochastic Game Theory , pp. 5 - 34Publisher: Cambridge University PressPrint publication year: 2022
You have
Access