PolyBase Revealed

1. Front Matter

   Pages i-xix

   PDF

2. Installing and Configuring PolyBase

   • Kevin Feasel

   Pages 1-31

3. Connecting to Azure Blob Storage

   • Kevin Feasel

   Pages 33-62

4. Connecting to Hadoop

   • Kevin Feasel

   Pages 63-93

5. Using Predicate Pushdown to Enhance Query Performance

   • Kevin Feasel

   Pages 95-125

6. Common Hadoop and Blob Storage Integration Errors

   • Kevin Feasel

   Pages 127-149

7. Integrating with SQL Server

   • Kevin Feasel

   Pages 151-182

8. Built-In Integrations: Cosmos DB, Oracle, and More

   • Kevin Feasel

   Pages 183-204

9. Integrating via ODBC

   • Kevin Feasel

   Pages 205-231

10. PolyBase in Azure Synapse Analytics

    • Kevin Feasel

    Pages 233-249

11. Examining PolyBase via Dynamic Management Views

    • Kevin Feasel

    Pages 251-271

12. Query Tuning with Statistics and Execution Plans

    • Kevin Feasel

    Pages 273-288

13. PolyBase in Practice

    • Kevin Feasel

    Pages 289-304

14. Back Matter

    Pages 305-311

    PDF

Harness the power of PolyBase data virtualization software to make data from a variety of sources easily accessible through SQL queries while using the T-SQL skills you already know and have mastered.

PolyBase Revealed shows you how to use the PolyBase feature of SQL Server 2019 to integrate SQL Server with Azure Blob Storage, Apache Hadoop, other SQL Server instances, Oracle, Cosmos DB, Apache Spark, and more. You will learn how PolyBase can help you reduce storage and other costs by avoiding the need for ETL processes that duplicate data in order to make it accessible from one source. PolyBase makes SQL Server into that one source, and T-SQL is your golden ticket. The book also covers PolyBase scale-out clusters, allowing you to distribute PolyBase queries among several SQL Server instances, thus improving performance.

With great flexibility comes great complexity, and this book shows you where to look when queries fail, complete with coverageof internals, troubleshooting techniques, and where to find more information on obscure cross-platform errors. Data virtualization is a key target for Microsoft with SQL Server 2019. This book will help you keep your skills current, remain relevant, and build new business and career opportunities around Microsoft’s product direction.

What You Will Learn

• Install and configure PolyBase as a stand-alone service, or unlock its capabilities with a scale-out cluster
  
• Understand how PolyBase interacts with outside data sources while presenting their data as regular SQL Server tables
  
• Write queries combining data from SQL Server, Apache Hadoop, Oracle, Cosmos DB, Apache Spark, and more
  
• Troubleshoot PolyBase queries using SQL Server Dynamic Management Views
  
• Tune PolyBase queries using statistics and execution plans
  
• Solve common business problems, including "cold storage" of infrequentlyaccessed data and simplifying ETL jobs

Who This Book Is For


SQL Server developers working in multi-platform environments who want one easy way of communicating with, and collecting data from, all of these sources

• PolyBase
• SQL Server 2019
• Big Data
• Data Virtualization
• External Tables
• External File Formats
• External Pushdown
• Polyglot Data
• Massively Parallel Processing (MPP)
• Hadoop
• Apache Spark
• MongoDB
• Oracle
• T-SQL
• Teradata
• Azure Blob Storage
• Predicate Pushdown
• CosmosDB
• Azure SQL Data Warehouse
• Dynamic Management Views

• Durham, USA

  Kevin Feasel

Kevin Feasel is a Microsoft Data Platform MVP and CTO at Envizage where he specializes in T-SQL and R development, forcing Spark clusters to do his bidding, fighting with Kafka, and pulling rabbits out of hats on demand. He is the lead curator at Curated SQL (curatedsql.com). A resident of Durham, North Carolina, USA, Kevin can be found cycling the trails along the Triangle whenever the weather is nice enough.

 

Policies and ethics