Overview
- Helps .NET developers use Apache Spark without needing Python or Scala
- Shows you how to use the power of Apache Spark to efficiently process big data
- Provides examples in C# and F#
Access this book
Tax calculation will be finalised at checkout
Other ways to access
Table of contents (11 chapters)
-
Getting Started
-
The APIs
-
Examples
Keywords
About this book
This book covers how to get a local instance of Apache Spark running on your developer machine and shows you how to create your first .NET program that uses the Microsoft .NET bindings for Apache Spark. Techniques shown in the book allow you to use Apache Spark to distribute your data processing tasks over multiple compute nodes. You will learn to process data using both batch mode and streaming mode so you can make the right choice depending on whether you are processing an existing dataset or are working against new records in micro-batches as they arrive. The goal of the book is leave you comfortable in bringing the power of Apache Spark to your favorite .NET language.
What You Will Learn
- Install and configure Spark .NET on Windows, Linux, and macOS
- Write Apache Spark programs in C# and F# using the .NET bindings
- Access and invoke the Apache Spark APIs from .NET with the same high performance as Python, Scala, and R
- Encapsulate functionality in user-defined functions
- Transform and aggregate large datasets
- Execute SQL queries against files through Apache Hive
- Distribute processing of large datasets across multiple servers
- Create your own batch, streaming, and machine learning programs
Who This Book Is For
.NETdevelopers who want to perform big data processing without having to migrate to Python, Scala, or R; and Apache Spark developers who want to run natively on .NET and take advantage of the C# and F# ecosystems
Authors and Affiliations
About the author
Bibliographic Information
Book Title: Introducing .NET for Apache Spark
Book Subtitle: Distributed Processing for Massive Datasets
Authors: Ed Elliott
DOI: https://doi.org/10.1007/978-1-4842-6992-3
Publisher: Apress Berkeley, CA
eBook Packages: Professional and Applied Computing, Apress Access Books, Professional and Applied Computing (R0)
Copyright Information: Ed Elliott 2021
Softcover ISBN: 978-1-4842-6991-6Published: 14 April 2021
eBook ISBN: 978-1-4842-6992-3Published: 13 April 2021
Edition Number: 1
Number of Pages: XV, 262
Number of Illustrations: 41 b/w illustrations
Topics: Microsoft and .NET, Big Data