BigQuery for Data Warehousing

1. Front Matter

   Pages i-xxxv

   PDF

2. Building a Warehouse

   1. Front Matter

      Pages 1-1

      PDF

   2. Settling into BigQuery

      • Mark Mucchetti

      Pages 3-21

   3. Starting Your Warehouse Project

      • Mark Mucchetti

      Pages 23-43

   4. All My Data

      • Mark Mucchetti

      Pages 45-60

   5. Managing BigQuery Costs

      • Mark Mucchetti

      Pages 61-71

3. Filling the Warehouse

   1. Front Matter

      Pages 73-73

      PDF

   2. Loading Data into the Warehouse

      • Mark Mucchetti

      Pages 75-103

   3. Streaming Data into the Warehouse

      • Mark Mucchetti

      Pages 105-121

   4. Dataflow

      • Mark Mucchetti

      Pages 123-152

4. Using the Warehouse

   1. Front Matter

      Pages 153-153

      PDF

   2. Care and Feeding of Your Warehouse

      • Mark Mucchetti

      Pages 155-172

   3. Querying the Warehouse

      • Mark Mucchetti

      Pages 173-207

   4. Scheduling Jobs

      • Mark Mucchetti

      Pages 209-230

   5. Serverless Functions with GCP

      • Mark Mucchetti

      Pages 231-251

   6. Cloud Logging

      • Mark Mucchetti

      Pages 253-269

5. Maintaining the Warehouse

   1. Front Matter

      Pages 271-271

      PDF

   2. Advanced BigQuery

      • Mark Mucchetti

      Pages 273-303

   3. Data Governance

      • Mark Mucchetti

      Pages 305-332

   4. Adapting to Long-Term Change

      • Mark Mucchetti

      Pages 333-351

Create a data warehouse, complete with reporting and dashboards using Google’s BigQuery technology. This book takes you from the basic concepts of data warehousing through the design, build, load, and maintenance phases. You will build capabilities to capture data from the operational environment, and then mine and analyze that data for insight into making your business more successful. You will gain practical knowledge about how to use BigQuery to solve data challenges in your organization.


BigQuery is a managed cloud platform from Google that provides enterprise data warehousing and reporting capabilities. Part I of this book shows you how to design and provision a data warehouse in the BigQuery platform. Part II teaches you how to load and stream your operational data into the warehouse to make it ready for analysis and reporting. Parts III and IV cover querying and maintaining, helping you keep your information relevant with other Google Cloud Platform services and advanced BigQuery. Part V takes reporting to the next level by showing you how to create dashboards to provide at-a-glance visual representations of your business situation. Part VI provides an introduction to data science with BigQuery, covering machine learning and Jupyter notebooks.



What You Will Learn

• Design a data warehouse for your project or organization
  
• Load data from a variety of external and internal sources
  
• Integrate other Google Cloud Platform services for more complex workflows
  
• Maintain and scale your data warehouse as your organization grows
  
• Analyze, report, and create dashboards on the information in the warehouse
  
• Become familiar with machine learning techniques using BigQuery ML

Who This Book Is For


Developers who want to provide business users with fast, reliable, and insightful analysis from operational data, and data analysts interested in a cloud-based solution that avoids the pain of provisioning their own servers.

• Big Query
• Google Cloud Platform
• GCP
• Big Data
• SQL
• BigQueryML
• Data Machine Learning
• Data Warehouse
• Data Mart
• Data Lake
• ETL

• Santa Monica, USA

  Mark Mucchetti

Mark Mucchetti is an industry technology leader in healthcare and ecommerce. He has been working with computers and writing software for over 30 years, starting with BASIC and Turbo C on an Intel 8088 and now using Node.js in the cloud. He has been building and managing technology groups for much of that time, combining his deep love of technical topics with his management skills to create world-class platforms. Mark has also worked in databases, release engineering, front- and back-end coding, and project management. He believes that the best decisions are made with the best data available, and that BigQuery is a great technology to increase the value and accessibility of data for business leaders on a day-to-day basis. He has seen the transformation that accurate, timely data has on an organization’s ability to succeed, and wants to bring that knowledge to the world in a people-first way.

Policies and ethics