Theory and Applications of Natural Language Processing

Interactive Multi-modal Question-Answering

Editors: van den Bosch, Antal, Bouma, Gosse (Eds.)

  • Offers an inside look into a large multidisciplinary HCI project 
  • Provides new perspectives on question-answering systems 
  • Features unique developments in multi-model answer generation, fusion and paraphrasing 
  • Gives new insights in speech recognition technology
  • Details theoretical advancements in dialogue management
see more benefits

Buy this book

eBook $149.00
price for USA (gross)
  • ISBN 978-3-642-17525-1
  • Digitally watermarked, DRM-free
  • Included format: PDF
  • ebooks can be used on all reading devices
  • Immediate eBook download after purchase
Hardcover $189.00
price for USA
  • ISBN 978-3-642-17524-4
  • Free shipping for individuals worldwide
  • Usually dispatched within 3 to 5 business days.
Softcover $189.00
price for USA
  • ISBN 978-3-642-26822-9
  • Free shipping for individuals worldwide
  • Usually dispatched within 3 to 5 business days.
About this book

This book is the result of a group of researchers from different disciplines asking themselves one question: what does it take to develop a computer interface that listens, talks, and can answer questions in a domain? First, obviously, it takes specialized modules for speech recognition and synthesis, human interaction management (dialogue, input fusion, andmultimodal output fusion), basic question understanding, and answer finding. While all modules are researched as independent subfields, this book describes the development of state-of-the-art modules and their integration into a single, working application capable of answering medical (encyclopedic) questions such as "How long is a person with measles contagious?" or "How can I prevent RSI?".

The contributions in this book, which grew out of the IMIX project funded by the Netherlands Organisation for Scientific Research, document the development of this system, but also address more general issues in natural language processing, such as the development of multidimensional dialogue systems, the acquisition of taxonomic knowledge from text, answer fusion, sequence processing for domain-specific entity recognition, and syntactic parsing for question answering. Together, they offer an overview of the most important findings and lessons learned in the scope of the IMIX project, making the book of interest to both academic and commercial developers of human-machine interaction systems in Dutch or any other language.

Highlights include: integrating multi-modal input fusion in dialogue management (Van Schooten and Op den Akker), state-of-the-art approaches to the extraction of term variants (Van der Plas, Tiedemann, and Fahmi; Tjong Kim Sang, Hofmann, and De Rijke), and multi-modal answer fusion (two chapters by Van Hooijdonk, Bosma, Krahmer, Maes, Theune, and Marsi).

Watch the IMIX movie at www.nwo.nl/imix-film .

Like IBM's Watson, the IMIX system described in the book gives naturally phrased responses to naturally posed questions. Where Watson can only generate synthetic speech, the IMIX system also recognizes speech. On the other hand, Watson is able to win a television quiz, while the IMIX system is domain-specific, answering only to medical questions.

"The Netherlands has always been one of the leaders in the general field of Human Language Technology, and IMIX is no exception. It was a very ambitious program, with a remarkably successful performance leading to interesting results. The teams covered a remarkable amount of territory in the general sphere of multimodal  question answering and information delivery, question answering, information extraction and component technologies."

Eduard Hovy, USC, USA, Jon Oberlander, University of Edinburgh, Scotland, and Norbert Reithinger, DFKI, Germany 

Reviews

From the reviews:

“Researchers in broad disciplines … usually conduct their research by breaking the general problem down into many small problems. … It is rare for many researchers to coordinate their efforts and demonstrate what progress has been made to solve the general problem. This book documents one such effort. … The book is a collection of chapters written by various researchers in the IMIX project. … Anyone who wants to know about the state of the art in question answering will be interested in this book.” (D. L. Chester, ACM Computing Reviews, August, 2011)


Table of contents (12 chapters)

  • Introduction

    Bosch, Antal (et al.)

    Pages 3-9

  • The IMIX Demonstrator: An Information Search Assistant for the Medical Domain

    Hofs, Dennis (et al.)

    Pages 11-21

  • Vidiam: Corpus-based Development of a Dialogue Manager for Multimodal Question Answering

    Schooten, Boris (et al.)

    Pages 25-56

  • Multidimensional Dialogue Management

    Keizer, Simon (et al.)

    Pages 57-86

  • Experiments in Multimodal Information Presentation

    Hooijdonk, Charlotte (et al.)

    Pages 89-115

Buy this book

eBook $149.00
price for USA (gross)
  • ISBN 978-3-642-17525-1
  • Digitally watermarked, DRM-free
  • Included format: PDF
  • ebooks can be used on all reading devices
  • Immediate eBook download after purchase
Hardcover $189.00
price for USA
  • ISBN 978-3-642-17524-4
  • Free shipping for individuals worldwide
  • Usually dispatched within 3 to 5 business days.
Softcover $189.00
price for USA
  • ISBN 978-3-642-26822-9
  • Free shipping for individuals worldwide
  • Usually dispatched within 3 to 5 business days.
Loading...

Bibliographic Information

Bibliographic Information
Book Title
Interactive Multi-modal Question-Answering
Editors
  • Antal van den Bosch
  • Gosse Bouma
Series Title
Theory and Applications of Natural Language Processing
Copyright
2011
Publisher
Springer-Verlag Berlin Heidelberg
Copyright Holder
Springer-Verlag Berlin Heidelberg
eBook ISBN
978-3-642-17525-1
DOI
10.1007/978-3-642-17525-1
Hardcover ISBN
978-3-642-17524-4
Softcover ISBN
978-3-642-26822-9
Series ISSN
2192-032X
Edition Number
1
Number of Pages
XII, 280
Topics