HAPPY HOLIDAYS: Get a special discount on Apress Access! Subscribe today >>

SpringerBriefs in Computer Science

Markov Decision Processes and the Belief-Desire-Intention Model

Bridging the Gap for Autonomous Agents

Authors: Simari, Gerardo I., Parsons, Simon D.

Buy this book

eBook $29.99
price for USA
  • ISBN 978-1-4614-1472-8
  • Digitally watermarked, DRM-free
  • Included format: PDF
  • ebooks can be used on all reading devices
  • Download immediately after purchase
Softcover $39.95
price for USA
  • ISBN 978-1-4614-1471-1
  • Free shipping for individuals worldwide
  • Usually dispatched within 3 to 5 business days.
About this book

In this work, we provide a treatment of the relationship between two models that have been widely used in the implementation of autonomous agents: the Belief DesireIntention (BDI) model and Markov Decision Processes (MDPs). We start with an informal description of the relationship, identifying the common features of the two approaches and the differences between them. Then we hone our understanding of these differences through an empirical analysis of the performance of both models on the TileWorld testbed. This allows us to show that even though the MDP model displays consistently better behavior than the BDI model for small worlds, this is not the case when the world becomes large and the MDP model cannot be solved exactly. Finally we present a theoretical analysis of the relationship between the two approaches, identifying mappings that allow us to extract a set of intentions from a policy (a solution to an MDP), and to extract a policy from a set of intentions.

Table of contents (6 chapters)

Buy this book

eBook $29.99
price for USA
  • ISBN 978-1-4614-1472-8
  • Digitally watermarked, DRM-free
  • Included format: PDF
  • ebooks can be used on all reading devices
  • Download immediately after purchase
Softcover $39.95
price for USA
  • ISBN 978-1-4614-1471-1
  • Free shipping for individuals worldwide
  • Usually dispatched within 3 to 5 business days.
Loading...

Bibliographic Information

Bibliographic Information
Book Title
Markov Decision Processes and the Belief-Desire-Intention Model
Book Subtitle
Bridging the Gap for Autonomous Agents
Authors
Series Title
SpringerBriefs in Computer Science
Copyright
2011
Publisher
Springer-Verlag New York
Copyright Holder
The Author(s)
eBook ISBN
978-1-4614-1472-8
DOI
10.1007/978-1-4614-1472-8
Softcover ISBN
978-1-4614-1471-1
Series ISSN
2191-5768
Edition Number
1
Number of Pages
VIII, 63
Topics