Apress

Information Theory and Statistical Learning

By Frank Emmert-Streib , Matthias Dehmer

Information Theory and Statistical Learning Cover Image

This interdisciplinary text offers theoretical and practical results of information theoretic methods used in statistical learning. It presents a comprehensive overview of the many different methods that have been developed in numerous contexts.

Full Description

  • ISBN13: 978-0-3878-4815-0
  • 452 Pages
  • User Level: Science
  • Publication Date: November 24, 2008
  • Available eBook Formats: PDF
  • eBook Price: $129.00
Buy eBook Buy Print Book Add to Wishlist
Full Description
'Information Theory and Statistical Learning' presents theoretical and practical results about information theoretic methods used in the context of statistical learning. The book will present a comprehensive overview of the large range of different methods that have been developed in a multitude of contexts. Each chapter is written by an expert in the field. The book is intended for an interdisciplinary readership working in machine learning, applied statistics, artificial intelligence, biostatistics, computational biology, bioinformatics, web mining or related disciplines. Advance Praise for 'Information Theory and Statistical Learning': 'A new epoch has arrived for information sciences to integrate various disciplines such as information theory, machine learning, statistical inference, data mining, model selection etc. I am enthusiastic about recommending the present book to researchers and students, because it summarizes most of these new emerging subjects and methods, which are otherwise scattered in many places.' Shun-ichi Amari, RIKEN Brain Science Institute, Professor-Emeritus at the University of Tokyo
Table of Contents

Table of Contents

  1. Algorithmic Probability
  2. Theory and Applications.
  3. Model Selection and Testing by the MDL Principle.
  4. Normalized Information Distance.
  5. The Application of Data Compression
  6. based Distances to Biological Sequences.
  7. MIC: Mutual Information Based Hierarchical Clustering.
  8. A Hybrid Genetic Algorithm for Feature Selection Based on Mutual Information.
  9. Information Approach to Blind Source Separation and Deconvolution.
  10. Causality in Time Series: Its Detection and Quantification by Means of Information Theory.
  11. Information Theoretic Learning and Kernel Methods.
  12. Information
  13. Theoretic Causal Power.
  14. Information Flows in Complex Networks.
  15. Models of Information Processing in the Sensorimotor Loop.
  16. Information Divergence Geometry and the Application to Statistical Machine Learning.
  17. Model Selection and Information Criterion.
  18. Extreme Physical Information (EPI) as a PRinciple of Universal Stability.
  19. Entropy and Cloning Methods for Combinatorial Optimization, Sampling and Counting Using the Gibbs Sampler.
Errata

If you think that you've found an error in this book, please let us know about it. You will find any confirmed erratum below, so you can check if your concern has already been addressed.

* Required Fields

No errata are currently published