PySpark SQL Recipes

With HiveQL, Dataframe and Graphframes

Authors: Mishra, Raju Kumar, Raman, Sundar Rajan

Free Preview
  • Explains PySpark SQL and Dataframe in detail
  • Include IO operation using  PySpark SQL from  most frequently used SQL and NoSQL databases
  • Detail discussion on  Data Preprocessing  using PySpark SQL
  • Problem Solution approach to graph bases algorithm using Graphframes
see more benefits

Buy this book

eBook $24.99
price for USA (gross)
  • ISBN 978-1-4842-4335-0
  • Digitally watermarked, DRM-free
  • Included format: PDF, EPUB
  • ebooks can be used on all reading devices
  • Immediate eBook download after purchase
Softcover $32.99
price for USA
  • ISBN 978-1-4842-4334-3
  • Free shipping for individuals worldwide
  • Usually dispatched within 3 to 5 business days.
About this book

Carry out data analysis with PySpark SQL, graphframes, and graph data processing using a problem-solution approach. This book provides solutions to problems related to dataframes, data manipulation summarization, and exploratory analysis. You will improve your skills in graph data analysis using graphframes and see how to optimize your PySpark SQL code.
PySpark SQL Recipes starts with recipes on creating dataframes from different types of data source, data aggregation and summarization, and exploratory data analysis using PySpark SQL. You’ll also discover how to solve problems in graph analysis using graphframes.
On completing this book, you’ll have ready-made code for all your PySpark SQL tasks, including creating dataframes using data from different file formats as well as from SQL or NoSQL databases.
What You Will Learn

  • Understand PySpark SQL and its advanced features
  • Use SQL and HiveQL with PySpark SQL
  • Work with structured streaming
  • Optimize PySpark SQL 
  • Master graphframes and graph processing

Who This Book Is ForData scientists, Python programmers, and SQL programmers.



About the authors

Raju Kumar Mishra has strong interests in data science and systems that have the capability of handling large amounts of data and operating complex mathematical models through computational programming. He was inspired to pursue an M. Tech in computational sciences from Indian Institute of Science in Bangalore, India. Raju primarily works in the areas of data science and its different applications. Working as a corporate trainer he has developed unique insights that help him in teaching and explaining complex ideas with ease. Raju is also a data science consultant solving complex industrial problems. He works on programming tools such as R, Python, scikit-learn, Statsmodels, Hadoop, Hive, Pig, Spark, and many others. His venture Walsoul Private Ltd provides training in data science, programming, and big data.
Sundar Rajan Raman is an artificial intelligence practitioner currently working at Bank of America. He holds a Bachelor of Technology degree from the National Institute of Technology, India. Being a seasoned Java and J2EE programmer he has worked on critical applications for companies such as AT&T, Singtel, and Deutsche Bank. He is also a seasoned big data architect. His current focus is on artificial intelligence space including machine learning and deep learning.

Table of contents (9 chapters)

Table of contents (9 chapters)

Buy this book

eBook $24.99
price for USA (gross)
  • ISBN 978-1-4842-4335-0
  • Digitally watermarked, DRM-free
  • Included format: PDF, EPUB
  • ebooks can be used on all reading devices
  • Immediate eBook download after purchase
Softcover $32.99
price for USA
  • ISBN 978-1-4842-4334-3
  • Free shipping for individuals worldwide
  • Usually dispatched within 3 to 5 business days.

Services for this book

Loading...

Bibliographic Information

Bibliographic Information
Book Title
PySpark SQL Recipes
Book Subtitle
With HiveQL, Dataframe and Graphframes
Authors
Copyright
2019
Publisher
Apress
Copyright Holder
Raju Kumar Mishra and Sundar Rajan Raman
Distribution Rights
Apress Standard Distribution
eBook ISBN
978-1-4842-4335-0
DOI
10.1007/978-1-4842-4335-0
Softcover ISBN
978-1-4842-4334-3
Edition Number
1
Number of Pages
XXIV, 323
Number of Illustrations
57 b/w illustrations
Topics