Pro Microsoft HDInsight

1. Front Matter

   Pages i-xxi

   PDF

2. Introducing HDInsight

   • Debarchan Sarkar

   Pages 1-12

3. Understanding Windows Azure HDInsight Service

   • Debarchan Sarkar

   Pages 13-22

4. Provisioning Your HDInsight Service Cluster

   • Debarchan Sarkar

   Pages 23-37

5. Automating HDInsight Cluster Provisioning

   • Debarchan Sarkar

   Pages 39-58

6. Submitting Jobs to Your HDInsight Cluster

   • Debarchan Sarkar

   Pages 59-87

7. Exploring the HDInsight Name Node

   • Debarchan Sarkar

   Pages 89-111

8. Using Windows Azure HDInsight Emulator

   • Debarchan Sarkar

   Pages 113-125

9. Accessing HDInsight over Hive and ODBC

   • Debarchan Sarkar

   Pages 127-145

10. Consuming HDInsight from Self-Service BI Tools

    • Debarchan Sarkar

    Pages 147-166

11. Integrating HDInsight with SQL Server Integration Services

    • Debarchan Sarkar

    Pages 167-185

12. Logging in HDInsight

    • Debarchan Sarkar

    Pages 187-204

13. Troubleshooting Cluster Deployments

    • Debarchan Sarkar

    Pages 205-217

14. Troubleshooting Job Failures

    • Debarchan Sarkar

    Pages 219-242

15. Back Matter

    Pages 243-247

    PDF

Pro Microsoft HDInsight is a complete guide to deploying and using Apache Hadoop on the Microsoft Windows Azure Platforms. The information in this book enables you to process enormous volumes of structured as well as non-structured data easily using HDInsight, which is Microsoft’s own distribution of Apache Hadoop. Furthermore, the blend of Infrastructure as a Service (IaaS) and Platform as a Service (PaaS) offerings available through Windows Azure lets you take advantage of Hadoop’s processing power without the worry of creating, configuring, maintaining, or managing your own cluster.

With the data explosion that is soon to happen, the open source Apache Hadoop Framework is gaining traction, and it benefits from a huge ecosystem that has risen around the core functionalities of the Hadoop distributed file system (HDFS™) and Hadoop Map Reduce. Pro Microsoft HDInsight equips you with the knowledge, confidence, and technique to configure and manage this ecosystem on Windows Azure. The book is an excellent choice for anyone aspiring to be a data scientist or data engineer, putting you a step ahead in the data mining field.

• Guides you through installation and configuration of an HDInsight cluster on Windows Azure
• Provides clear examples of configuring and executing Map Reduce jobs
• Helps you consume data and diagnose errors from the Windows Azure HDInsight Service

Debarchan Sarkar is a SQL Server engineer hailing from the City of Joy, Calcutta, India, currently relocated in Bangalore, India. His passion for processing and architecting data grew with the introduction of the Business Intelligence Suite introduced in SQL Server 2005. Since then he has fallen in love with the diversity of data mining techniques. He is a very active community member in the BI domain, and has published MSDN articles, Whitepapers, blogs, and videos in the ETL space. Debarchan has also delivered advanced training on ETL and Data Warehousing with great success to several Microsoft Premium partners and clients. He has been working on HDInsight since the initial days of its internal releases, helping to test and improve the product in multiple dimensions.

Policies and ethics