The availability of todays online information systems rapidly increases the relevance of dynamic decision making within a large number of operational contexts. Whenever a sequence of interdependent decisions occurs, making a single decision raises the need for anticipation of its future impact on the entire decision process. Anticipatory support is needed for a broad variety of dynamic and stochastic decision problems from different operational contexts such as finance, energy management, manufacturing and transportation. Example problems include asset allocation, feed-in of electricity produced by wind power as well as scheduling and routing. All these problems entail a sequence of decisions contributing to an overall goal and taking place in the course of a certain period of time. Each of the decisions is derived by solution of an optimization problem. As a consequence a stochastic and dynamic decision problem resolves into a series of optimization problems to be formulated and solved by anticipation of the remaining decision process.However, actually solving a dynamic decision problem by means of approximate dynamic programming still is a major scientific challenge. Most of the work done so far is devoted to problems allowing for formulation of the underlying optimization problems as linear programs. Problem domains like scheduling and routing, where linear programming typically does not produce a significant benefit for problem solving, have not been considered so far. Therefore, the industry demand for dynamic scheduling and routing is still predominantly satisfied by purely heuristic approaches to anticipatory decision making. Although this may work well for certain dynamic decision problems, these approaches lack transferability of findings to other, related problems.This book has serves two major purposes: It provides a comprehensive and unique view of anticipatory optimization for dynamic decision making. It fully integrates Markov decision processes, dynamic programming, data mining and optimization and introduces a new perspective on approximate dynamic programming. Moreover, the book identifies different degrees of anticipation, enabling an assessment of specific approaches to dynamic decision making. It shows for the first time how to successfully solve a dynamic vehicle routing problem by approximate dynamic programming. It elaborates on every building block required for this kind of approach to dynamic vehicle routing. Thereby the book has a pioneering character and is intended to provide a footing for the dynamic vehicle routing community.
Cited By
- Wölck M and Meisel S (2022). Branch-and-Price Approaches for Real-Time Vehicle Routing with Picking, Loading, and Soft Time Windows, INFORMS Journal on Computing, 34:4, (2192-2211), Online publication date: 1-Jul-2022.
- De Maio A, Laganà D, Musmanno R and Vocaturo F (2021). Arc routing under uncertainty, Computers and Operations Research, 135:C, Online publication date: 1-Nov-2021.
- Cui Q, Zhang J, Zhang X, Chen K, Tao X and Zhang P (2020). Online Anticipatory Proactive Network Association in Mobile Edge Computing for IoT, IEEE Transactions on Wireless Communications, 19:7, (4519-4534), Online publication date: 1-Jul-2020.
- Ulmer M, Goodson J, Mattfeld D and Hennig M (2018). Offline–Online Approximate Dynamic Programming for Dynamic Vehicle Routing with Stochastic Requests, Transportation Science, 53:1, (185-202), Online publication date: 1-Feb-2019.
- Bossek J, Grimme C, Meisel S, Rudolph G and Trautmann H Local search effects in bi-objective orienteering Proceedings of the Genetic and Evolutionary Computation Conference, (585-592)
- Corredor J, Sofrony J and Peer A (2017). Decision-Making Model for Adaptive Impedance Control of Teleoperation Systems, IEEE Transactions on Haptics, 10:1, (5-16), Online publication date: 1-Jan-2017.
- Meisel S, Grimme C, Bossek J, Wölck M, Rudolph G and Trautmann H Evaluation of a Multi-Objective EA on Benchmark Instances for Dynamic Routing of a Vehicle Proceedings of the 2015 Annual Conference on Genetic and Evolutionary Computation, (425-432)
Recommendations
Anticipatory network models of multicriteria decision-making processes
Uncertainty and robustness in planning and decision-makingIn this article, we will investigate the properties of a compromise solution selection method based on modelling the consequences of a decision as factors influencing the decision making in subsequent problems. Specifically, we assume that the ...
Decision making process: typology, intelligence, and optimization
Decision making is concerned with evaluating and/or ranking possible alternatives of action. In this paper, we develop a model for the process of decision making. Understanding the decision process can provide insights into how humans make decisions, ...
Sustainable decision making: the role of decision support systems
Sustainable decision making stands for decision making which contributes to the transition to a sustainable society. It raises a number of challenging problems for which existing decision support systems (DSS) may not be equipped. The role of DSS in ...