Deep Reinforcement Learning with Python

1. Front Matter

   Pages i-xix

   PDF

2. Introduction to Reinforcement Learning

   • Nimish Sanghi

   Pages 1-17

3. Markov Decision Processes

   • Nimish Sanghi

   Pages 19-48

4. Model-Based Algorithms

   • Nimish Sanghi

   Pages 49-76

5. Model-Free Approaches

   • Nimish Sanghi

   Pages 77-122

6. Function Approximation

   • Nimish Sanghi

   Pages 123-154

7. Deep Q-Learning

   • Nimish Sanghi

   Pages 155-206

8. Policy Gradient Algorithms

   • Nimish Sanghi

   Pages 207-249

9. Combining Policy Gradient and Q-Learning

   • Nimish Sanghi

   Pages 251-303

10. Integrated Planning and Learning

    • Nimish Sanghi

    Pages 305-342

11. Further Exploration and Next Steps

    • Nimish Sanghi

    Pages 343-373

12. Back Matter

    Pages 375-382

    PDF

Deep reinforcement learning is a fast-growing discipline that is making a significant impact in fields of autonomous vehicles, robotics, healthcare, finance, and many more. This book covers deep reinforcement learning using deep-q learning and policy gradient models with coding exercise.


You'll begin by reviewing the Markov decision processes, Bellman equations, and dynamic programming that form the core concepts and foundation of deep reinforcement learning. Next, you'll study model-free learning followed by function approximation using neural networks and deep learning. This is followed by various deep reinforcement learning algorithms such as deep q-networks, various flavors of actor-critic methods, and other policy-based methods. 


You'll also look at exploration vs exploitation dilemma, a key consideration in reinforcement learning algorithms, along with Monte Carlo tree search (MCTS), which played a key role inthe success of AlphaGo. The final chapters conclude with deep reinforcement learning implementation using popular deep learning frameworks such as TensorFlow and PyTorch. In the end, you'll understand deep reinforcement learning along with deep q networks and policy gradient models implementation with TensorFlow, PyTorch, and Open AI Gym.



What You'll Learn

• Examine deep reinforcement learning 
• Implement deep learning algorithms using OpenAI’s Gym environment
• Code your own game playing agents for Atari using actor-critic algorithms
• Apply best practices for model building and algorithm training 

Who This Book Is For




Machine learning developers and architects who want to stay ahead of the curve in the field of AI and deep learning.

• Artificial Intelligence
• Deep Reinforcement Learning
• PyTorch
• Neural Networks
• Robotics
• Autonomous Vehicle
• Machine Learning
• Markov Decision Processes
• OpenAI Gym
• Deep Q - Learning

• Bangalore, India

  Nimish Sanghi

Nimish is a passionate technical leader who brings to table extreme focus on use of technology for solving customer problems. He has over 25 years of work experience in the Software and Consulting. Nimish has held leadership roles with P&L responsibilities at PwC, IBM and Oracle. In 2006 he set out on his entrepreneurial journey in Software consulting at SOAIS with offices in Boston, Chicago and Bangalore. Today the firm provides Automation and Digital Transformation services to Fortune 100 companies helping them make the transition from on-premise applications to the cloud.

 

He is also an angel investor in the space of AI and Automation driven startups. He has co-founded Paybooks, a SaaS HR and Payroll platform for Indian market. He has also cofounded a Boston based startup which offers ZipperAgent and ZipperHQ, a suite of AI driven workflow and video marketing automation platforms. He currently hold the position as CTO and Chief Data Scientist for both these platforms. 

 

Nimish has an MBA from Indian Institute of Management in Ahmedabad, India and a BS in Electrical Engineering from Indian Institute of Technology in Kanpur, India. He also holds multiple certifications in AI and Deep Learning.

Policies and ethics