- Full Description
Performance optimization is vital in the design and operation of modern engineering systems, including communications, manufacturing, robotics, and logistics. Most engineering systems are too complicated to model, or the system parameters cannot be easily identified, so learning techniques have to be applied. This is a multi-disciplinary area which has been attracting wide attention across many disciplines. Areas such as perturbation analysis (PA) in discrete event dynamic systems (DEDSs), Markov decision processes (MDPs) in operations research, reinforcement learning (RL) or neuro-dynamic programming (NDP) in computer science, identification and adaptive control (I&AC) in control systems, share the common goal: to make the 'best decision' to optimize system performance. This book provides a unified framework based on a sensitivity point of view. It also introduces new approaches and proposes new research topics within this sensitivity-based framework.
- Table of Contents
Table of Contents
- Perturbation Analysis of Queueing Systems.
- Perturbation Analysis of Markov Chains.
- Performance Sensitivities of Markov Processes.
- Learning and Optimization with Perturbation Analysis.
- Markov Decision Processes.
- Ergodic Systems.
- Based Policy Iteration.
- Reinforcement Learning.
- Stochastic Approximation.
- Temporal Difference Methods.
- Identification and Adaptive Control.
- Constructing Sensitivity Formulas.
- Based Optimization of Markov Systems.
- Estimating Aggregated Potentials.
Please Login to submit errata.No errata are currently published