- Full Description
Performance optimization is vital in the design and operation of modern engineering systems, including communications, manufacturing, robotics, and logistics. Most engineering systems are too complicated to model, or the system parameters cannot be easily identified, so learning techniques have to be applied. This is a multi-disciplinary area which has been attracting wide attention across many disciplines. Areas such as perturbation analysis (PA) in discrete event dynamic systems (DEDSs), Markov decision processes (MDPs) in operations research, reinforcement learning (RL) or neuro-dynamic programming (NDP) in computer science, identification and adaptive control (I&AC) in control systems, share the common goal: to make the 'best decision' to optimize system performance. This book provides a unified framework based on a sensitivity point of view. It also introduces new approaches and proposes new research topics within this sensitivity-based framework.
- Table of Contents
Table of Contents
- Perturbation Analysis of Queueing Systems.
- Perturbation Analysis of Markov Chains.
- Performance Sensitivities of Markov Processes.
- Learning and Optimization with Perturbation Analysis.
- Markov Decision Processes.
- Ergodic Systems.
- Based Policy Iteration.
- Reinforcement Learning.
- Stochastic Approximation.
- Temporal Difference Methods.
- Identification and Adaptive Control.
- Constructing Sensitivity Formulas.
- Based Optimization of Markov Systems.
- Estimating Aggregated Potentials.
If you think that you've found an error in this book, please let us know about it. You will find any confirmed erratum below, so you can check if your concern has already been addressed.No errata are currently published