Apress Access

Reinforcement Learning for Adaptive Dialogue Systems

A Data-driven Methodology for Dialogue Management and Natural Language Generation

By Verena Rieser , Oliver Lemon

  • eBook Price: $129.00
Buy eBook Buy Print Book

Reinforcement Learning for Adaptive Dialogue Systems Cover Image

This book contributes to progress in spoken dialogue systems with a new, data-driven methodology. Covers Spoken and Multimodal dialogue systems; Wizard-of-Oz data collection; User Simulation methods; Reinforcement Learning and Evaluation methodologies.

Full Description

  • Add to Wishlist
  • ISBN13: 978-3-6422-4941-9
  • 268 Pages
  • User Level: Professionals
  • Publication Date: November 23, 2011
  • Available eBook Formats: PDF
Full Description
The past decade has seen a revolution in the field of spoken dialogue systems. As in other areas of Computer Science and Artificial Intelligence, data-driven methods are now being used to drive new methodologies for system development and evaluation. This book is a unique contribution to that ongoing change. A new  methodology for developing spoken dialogue systems is described in detail. The journey starts and ends with human behaviour in interaction, and explores methods for learning from the data, for building simulation environments for training and testing systems, and for evaluating the results. The detailed material covers: Spoken and Multimodal dialogue systems, Wizard-of-Oz data collection, User Simulation methods, Reinforcement Learning, and Evaluation methodologies. The book is a research guide for students and researchers with a background in Computer Science, AI, or Machine Learning. It navigates through a detailed case study in data-driven methods for development and evaluation of spoken dialogue systems. Common challenges associated with this approach are discussed and example solutions are provided. This work provides insights, lessons, and inspiration for future research and development – not only for spoken dialogue systems in particular, but for data-driven approaches to human-machine interaction in general.
Table of Contents

Table of Contents

  1. 1.Introduction.
  2. 2.Background.
  3. 3.Reinforcement Learning for Information Seeking dialogue strategies.
  4. 4.The bootstrapping approach to developing Reinforcement Learning
  5. based  strategies.
  6. 5.Data Collection in aWizard
  7. of
  8. Oz experiment.
  9. 6.Building a simulated learning environment from Wizard
  10. of
  11. Oz data.
  12. 7.Comparing Reinforcement and Supervised Learning of dialogue policies with real users.
  13. 8.Meta
  14. evaluation.
  15. 9.Adaptive Natural Language Generation.
  16. 10.Conclusion.
  17. References.
  18. Example Dialogues.
  19. A.1.Wizard
  20. of
  21. Oz Example Dialogues.
  22. A.2.Example Dialogues from Simulated Interaction.
  23. A.3.Example Dialogues from User Testing.
  24. Learned State
  25. Action Mappings.
  26. Index.

If you think that you've found an error in this book, please let us know by emailing to editorial@apress.com . You will find any confirmed erratum below, so you can check if your concern has already been addressed.
No errata are currently published


    1. PHP Objects, Patterns, and Practice


      View Book

    2. Beginning Android 3D Game Development


      View Book

    3. Troubleshooting Oracle Performance


      View Book

    4. Beginning Amazon Web Services with Node.js


      View Book