The structure of approximate solutions of autonomous discrete-time optimal control problems and individual turnpike results for optimal control problems without convexity (concavity) assumptions are examined in this book. In particular, the book focuses on the properties of approximate solutions which are independent of the length of the interval, for all sufficiently large intervals; these results apply to the so-called turnpike property of the optimal control problems. By encompassing the so-called turnpike property the approximate solutions of the problemsare determined primarily by the objective function and are fundamentally independent of the choice of interval and endpoint conditions, except in regions close to the endpoints. This bookalso explores the turnpike phenomenon for two large classes of autonomous optimal control problems. It is illustrated that the turnpike phenomenon is stable for an optimal control problem if the corresponding infinite horizon optimal control problem possesses an asymptotic turnpike property. If an optimal control problem belonging to the first class possesses the turnpike property, then the turnpike is a singleton (unit set). The stability of the turnpike property under small perturbations of an objective function and of a constraint map is established. For the second class of problems where the turnpike phenomenon is not necessarily a singleton the stability of the turnpike property under small perturbations of an objective function is established. Containing solutions of difficult problems in optimal controland presenting new approaches, techniques and methods this book is of interest formathematiciansworking in optimal control and the calculus of variations.It also can be useful in preparation courses for graduate students.
Cited By
- Gaitsgory V, Parkinson A and Shvartsman I Linear programming formulation of a discrete time infinite horizon optimal control problem with time discounting criterion 2016 IEEE 55th Conference on Decision and Control (CDC), (4481-4483)
- Borkar V and Gaitsgory V (2019). Linear Programming Formulation of Long-Run Average Optimal Control Problem, Journal of Optimization Theory and Applications, 181:1, (101-125), Online publication date: 1-Apr-2019.
Recommendations
Stability of a Turnpike Phenomenon for a Discrete-Time Optimal Control System
We study the structure of solutions of a discrete-time control system with a compact metric space of states X which arises in economic dynamics. This control system is described by a nonempty closed set ΩźX X which determines a class of admissible ...
An Exponential Turnpike Theorem for Dissipative Discrete Time Optimal Control Problems
We investigate the exponential turnpike property for finite horizon undiscounted discrete time optimal control problems without any terminal constraints. Considering a class of strictly dissipative systems, we derive a boundedness condition for an ...
On turnpike and dissipativity properties of continuous-time optimal control problems
This paper investigates the relations between three different properties, which are of importance in optimal control problems: dissipativity of the underlying dynamics with respect to a specific supply rate, optimal operation at steady state, and the ...