Hands-on Question Answering Systems with BERT

Applications in Neural Networks and Natural Language Processing

Authors: Sabharwal, Navin, Agrawal, Amit

Download source code Free Preview
  • Integrates question answering systems with document repositories from different sources
  • Contains an in-depth explanation of the technology behind BERT
  • Takes a step-by-step approach to building question answering systems from scratch 
see more benefits

Buy this book

eBook $24.99
price for USA
  • ISBN 978-1-4842-6664-9
  • Digitally watermarked, DRM-free
  • Included format:
  • ebooks can be used on all reading devices
  • Immediate eBook download after purchase
Softcover $34.99
price for USA
  • ISBN 978-1-4842-6663-2
  • Free shipping for individuals worldwide
  • Institutional customers should get in touch with their account manager
  • Covid-19 shipping restrictions & severe weather in the US may cause delays
  • Usually ready to be dispatched within 3 to 5 business days, if in stock
About this book

Get hands-on knowledge of how BERT (Bidirectional Encoder Representations from Transformers) can be used to develop question answering (QA) systems by using natural language processing (NLP) and deep learning.

The book begins with an overview of the technology landscape behind BERT. It takes you through the basics of NLP, including natural language understanding with tokenization, stemming, and lemmatization, and bag of words. Next, you’ll look at neural networks for NLP starting with its variants such as recurrent neural networks, encoders and decoders, bi-directional encoders and decoders, and transformer models. Along the way, you’ll cover word embedding and their types along with the basics of BERT.

After this solid foundation, you’ll be ready to take a deep dive into BERT algorithms such as masked language models and next sentence prediction. You’ll see different BERT variations followed by a hands-on example of a question answering system.

Hands-on Question Answering Systems with BERT is a good starting point for developers and data scientists who want to develop and design NLP systems using BERT. It provides step-by-step guidance for using BERT.

What You Will Learn

  • Examine the fundamentals of word embeddings
  • Apply neural networks and BERT for various NLP tasks
  • Develop a question-answering system from scratch
  • Train question-answering systems for your own data
  • Who This Book Is For

    AI and machine learning developers and natural language processing developers.


    About the authors

    Navin is the chief architect for HCL DryICE Autonomics. He is an innovator, thought leader, author, and consultant in the areas of AI, machine learning, cloud computing, big data analytics, and software product development. He is responsible for IP development and service delivery in the areas of AI and machine learning, automation, AIOPS, public cloud GCP, AWS, and Microsoft Azure. Navin has authored 15+ books in the areas of cloud computing , cognitive virtual agents, IBM Watson, GCP, containers, and microservices. 

    Amit Agrawal is a senior data scientist and researcher delivering solutions in the fields of AI and machine learning. He is responsible for designing end-to-end solutions and architecture for enterprise products. He has also authored and reviewed books in the area of cognitive virtual assistants.



    Table of contents (7 chapters)

    Table of contents (7 chapters)
    • Introduction to Natural Language Processing

      Pages 1-14

      Sabharwal, Navin (et al.)

    • Neural Networks for Natural Language Processing

      Pages 15-39

      Sabharwal, Navin (et al.)

    • Introduction to Word Embeddings

      Pages 41-63

      Sabharwal, Navin (et al.)

    • BERT Algorithms Explained

      Pages 65-95

      Sabharwal, Navin (et al.)

    • BERT Model Applications: Question Answering System

      Pages 97-137

      Sabharwal, Navin (et al.)

    Buy this book

    eBook $24.99
    price for USA
    • ISBN 978-1-4842-6664-9
    • Digitally watermarked, DRM-free
    • Included format:
    • ebooks can be used on all reading devices
    • Immediate eBook download after purchase
    Softcover $34.99
    price for USA
    • ISBN 978-1-4842-6663-2
    • Free shipping for individuals worldwide
    • Institutional customers should get in touch with their account manager
    • Covid-19 shipping restrictions & severe weather in the US may cause delays
    • Usually ready to be dispatched within 3 to 5 business days, if in stock

    Services for this book

    Loading...

    Bibliographic Information

    Bibliographic Information
    Book Title
    Hands-on Question Answering Systems with BERT
    Book Subtitle
    Applications in Neural Networks and Natural Language Processing
    Authors
    Copyright
    2021
    Publisher
    Apress
    Copyright Holder
    Navin Sabharwal, Amit Agrawal
    eBook ISBN
    978-1-4842-6664-9
    DOI
    10.1007/978-1-4842-6664-9
    Softcover ISBN
    978-1-4842-6663-2
    Edition Number
    1
    Number of Pages
    XV, 184
    Number of Illustrations
    80 b/w illustrations
    Topics