Summer Sale: 50% off print & eBooks in Open Source & Security! Browse now >>

Pro Spark Streaming

The Zen of Real-Time Analytics Using Apache Spark

Authors: Nabi, Zubair

Download source code
  • Highlights the differences between traditional stream processing and the Spark Streaming micro-batch model
  • Targets real-world applications from multiple industry verticals
  • Provides an introduction to other popular Big Data solutions, such as Apache Kafka
see more benefits

Buy this book

eBook 20,22 €
price for Germany (gross)
  • ISBN 978-1-4842-1479-4
  • Digitally watermarked, DRM-free
  • Included format: EPUB, PDF
  • ebooks can be used on all reading devices
  • Immediate eBook download after purchase
Softcover 28,84 €
price for Germany (gross)
  • ISBN 978-1-4842-1480-0
  • Free shipping for individuals worldwide
  • Usually dispatched within 3 to 5 business days.
About this book

Learn the right cutting-edge skills and knowledge to leverage Spark Streaming to implement a wide array of real-time, streaming applications. This book walks you through end-to-end real-time application development using real-world applications, data, and code. Taking an application-first approach, each chapter introduces use cases from a specific industry and uses publicly available datasets from that domain to unravel the intricacies of production-grade design and implementation. The domains covered in Pro Spark Streaming include social media, the sharing economy, finance, online advertising, telecommunication, and IoT.

In the last few years, Spark has become synonymous with big data processing. DStreams enhance the underlying Spark processing engine to support streaming analysis with a novel micro-batch processing model. Pro Spark Streaming by Zubair Nabi will enable you to become a specialist of latency sensitive applications by leveraging the key features of DStreams, micro-batch processing, and functional programming. To this end, the book includes ready-to-deploy examples and actual code. Pro Spark Streaming will act as the bible of Spark Streaming.

What You'll Learn

  • Discover Spark Streaming application development and best practices
  • Work with the low-level details of discretized streams
  • Optimize production-grade deployments of Spark Streaming via configuration recipes and instrumentation using Graphite, collectd, and Nagios
  • Ingest data from disparate sources including MQTT, Flume, Kafka, Twitter, and a custom HTTP receiver
  • Integrate and couple with HBase, Cassandra, and Redis
  • Take advantage of design patterns for side-effects and maintaining state across the Spark Streaming micro-batch model
  • Implement real-time and scalable ETL using data frames, SparkSQL, Hive, and SparkR
  • Use streaming machine learning, predictive analytics, and recommendations
  • Mesh batch processing with stream processing via the Lambda architecture
Who This Book Is For

Data scientists, big data experts, BI analysts, and data architects.

About the authors

Zubair Nabi is one of the very few computer scientists who have solved Big Data problems in all three domains: academia, research, and industry. He currently works at Qubit, a London-based start up backed by Goldman Sachs, Accel Partners, Salesforce Ventures, and Balderton Capital. Qubit helps retailers understand their customers and provide personalized customer experience, and which has a rapidly growing client base that includes Staples, Emirates, Thomas Cook, and Topshop. Prior to Qubit, he was a researcher at IBM Research, where he worked at the intersection of Big Data systems and analytics to solve real-world problems in the telecommunication, electricity, and urban dynamics space.
Zubair’s work has been featured in MIT Technology Review, SciDev, CNET, and Asian Scientist, and on Swedish National Radio, among others. He has authored more than 20 research papers, published by some of the top publication venues in computer science including USENIX Middleware, ECML PKDD, and IEEE BigData; and he also has a number of patents to his credit.
Zubair has an MPhil in computer science with distinction from Cambridge.

Table of contents (10 chapters)

  • The Hitchhiker’s Guide to Big Data

    Nabi, Zubair

    Pages 1-8

    Preview Buy Chapter 29,69 €
  • Introduction to Spark

    Nabi, Zubair

    Pages 9-27

    Preview Buy Chapter 29,69 €
  • DStreams: Real-Time RDDs

    Nabi, Zubair

    Pages 29-50

    Preview Buy Chapter 29,69 €
  • High-Velocity Streams: Parallelism and Other Stories

    Nabi, Zubair

    Pages 51-67

    Preview Buy Chapter 29,69 €
  • Real-Time Route 66: Linking External Data Sources

    Nabi, Zubair

    Pages 69-97

    Preview Buy Chapter 29,69 €

Buy this book

eBook 20,22 €
price for Germany (gross)
  • ISBN 978-1-4842-1479-4
  • Digitally watermarked, DRM-free
  • Included format: EPUB, PDF
  • ebooks can be used on all reading devices
  • Immediate eBook download after purchase
Softcover 28,84 €
price for Germany (gross)
  • ISBN 978-1-4842-1480-0
  • Free shipping for individuals worldwide
  • Usually dispatched within 3 to 5 business days.

Services for this book

Loading...

Bibliographic Information

Bibliographic Information
Book Title
Pro Spark Streaming
Book Subtitle
The Zen of Real-Time Analytics Using Apache Spark
Authors
Copyright
2016
Publisher
Apress
Copyright Holder
Zubair Nabi
eBook ISBN
978-1-4842-1479-4
DOI
10.1007/978-1-4842-1479-4
Softcover ISBN
978-1-4842-1480-0
Edition Number
1
Number of Pages
XIX, 230
Number of Illustrations and Tables
7 b/w illustrations, 61 illustrations in colour
Topics