Hostname: page-component-cd9895bd7-hc48f Total loading time: 0 Render date: 2024-12-28T13:50:54.691Z Has data issue: false hasContentIssue false
  • English
  • Français

Existence of optimal nonanticipating controls in piecewisedeterministic control problems

Published online by Cambridge University Press:  18 January 2012

Atle Seierstad
Atle Seierstad*
Affiliation:
University of Oslo, Department of Economics, Box 1095 Blindern, 0317 Oslo, Norway. atle.seierstad@econ.uio.no
Get access

Abstract

Optimal nonanticipating controls are shown to exist in nonautonomous piecewisedeterministic control problems with hard terminal restrictions. The assumptions needed arecompletely analogous to those needed to obtain optimal controls in deterministic controlproblems. The proof is based on well-known results on existence of deterministic optimalcontrols.

Keywords

Piecewise deterministic problemsoptimal controlsexistence
Type
Research Article
Information
ESAIM: Control, Optimisation and Calculus of Variations , Volume 19 , Issue 1 , January 2013 , pp. 43 - 62
Copyright
© EDP Sciences, SMAI, 2012

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

D. Bertsekas and S.E. Shreve, Stochastic optimal control : the discrete-time case. Academic Press, New York (1978).
L. Cesari, Optimization – Theory and Applications. Springer-Verlag, New York (1983).
M.H.A. Davis, Markov Models and Optimization. Chapman & Hall, London, England (1993).
M.H.A. Davis and M. Farid, Piecewise deterministic processes and viscosity solutions, in Stochastic analysis, control, optimization and applications, edited by W.M. Mc.Eneaney et al., A volume in honour of W.H. Fleming, on occation of his 70th birthday, Birkhäuser, Boston (1999) 249–286.
M.A.H. Dempster, Optimal control of piecewise-deterministic Markov Processes, in Applied Stochastic Analysis, edited by M.A.H. Davis and R.J. Elliot. Gordon and Breach, New York (1991) 303–325.
M.A.H. Dempster and J.J. Ye, A maximum principle for control of piecewise deterministic Markov Processes, in Approximation, optimization and computing : Theory and applications, edited by A.G. Law et al., NorthHolland, Amsterdam (1990) 235–240.
Dempster, M.A.H. and Ye, J.J., Necessary and sufficient optimality conditions for control of piecewise deterministic Markov processes. Stoch. Stoch. Rep. 40 (1992) 125–145. Google Scholar
Forwick, L., Schäl, M. and Schmitz, M., Piecewise deterministic Markov control processes with feedback controls and unbounded costs, Acta Appl. Math. 82 (2004) 239–267. Google Scholar
Hernandez-Lerma, O. et al., Markov processes with expected total cost criterion : optimality, stability, and transient models. Acta Appl. Math. 59 (1999) 229–269. Google Scholar
A. Seierstad, Stochastic control in discrete and continuous time. Springer, New York, NY (2009).
Seierstad, A., A stochastic maximum principle with hard end constraints. J. Optim. Theory Appl. 144 (2010) 335–365. Google Scholar
Vermes, D., Optimal control of piecewise-deterministic Markov processes. Stochastics 14 (1985) 165–208. Google Scholar
J.J. Ye, Generalized Bellman-Hamilton-Jacobi equations for piecewise deterministic Markov Processes, , in Systems modelling and optimization, Proceedings of the 16th IFIP-TC conference, Compiegne, France, July 5-9 1993, Lect. Notes Control Inf. Sci. 197, edited by J. Henry et al., London, Springer-Verlag (1994) 51–550.
J.J. Ye, Dynamic programming and the maximum principle of piecewise deterministic Markov processses, in Mathematics of stochastic manufacturing systems, AMS-SIAM summer seminar in applied mathematics, June 17-22 1996, Williamsburg, VA, USA, Lect. Appl. Math. 33, edited by G.G. Yin et al., Amer. Math. Soc., Providence, RI (1997) 365–383.