Conquering Big Data with High Performance Computing

1. Front Matter

   Pages i-viii

   PDF

2. An Introduction to Big Data, High Performance Computing, High-Throughput Computing, and Hadoop

   • Ritu Arora

   Pages 1-12

3. Using High Performance Computing for Conquering Big Data

   • Antonio Gómez-Iglesias, Ritu Arora

   Pages 13-30

4. Data Movement in Data-Intensive High Performance Computing

   • Pietro Cicotti, Sarp Oral, Gokcen Kestor, Roberto Gioiosa, Shawn Strande, Michela Taufer et al.

   Pages 31-59

5. Using Managed High Performance Computing Systems for High-Throughput Computing

   • Lucas A. Wilson

   Pages 61-79

6. Accelerating Big Data Processing on Modern HPC Clusters

   • Xiaoyi Lu, Md. Wasi-ur-Rahman, Nusrat Islam, Dipti Shankar, Dhabaleswar K. (DK) Panda

   Pages 81-107

7. dispel4py: Agility and Scalability for Data-Intensive Methods Using HPC

   • Rosa Filgueira, Malcolm P. Atkinson, Amrey Krause

   Pages 109-137

8. Performance Analysis Tool for HPC and Big Data Applications on Scientific Clusters

   • Wucherl Yoo, Michelle Koo, Yi Cao, Alex Sim, Peter Nugent, Kesheng Wu

   Pages 139-161

9. Big Data Behind Big Data

   • Elizabeth Bautista, Cary Whitney, Thomas Davis

   Pages 163-189

10. Empowering R with High Performance Computing Resources for Big Data Analytics

    • Weijia Xu, Ruizhu Huang, Hui Zhang, Yaakoub El-Khamra, David Walling

    Pages 191-217

11. Big Data Techniques as a Solution to Theory Problems

    • Richard W. Evans, Kenneth L. Judd, Kramer Quist

    Pages 219-231

12. High-Frequency Financial Statistics Through High-Performance Computing

    • Jian Zou, Hui Zhang

    Pages 233-252

13. Large-Scale Multi-Modal Data Exploration with Human in the Loop

    • Guangchen Ruan, Hui Zhang

    Pages 253-268

14. Using High Performance Computing for Detecting Duplicate, Similar and Related Images in a Large Data Collection

    • Ritu Arora, Jessica Trelogan, Trung Nguyen Ba

    Pages 269-286

15. Big Data Processing in the eDiscovery Domain

    • Sukrit Sondhi, Ritu Arora

    Pages 287-307

16. Databases and High Performance Computing

    • Ritu Arora, Sukrit Sondhi

    Pages 309-319

17. Conquering Big Data Through the Usage of the Wrangler Supercomputer

    • Jorge Salazar

    Pages 321-329

This book provides an overview of the resources and research projects that are bringing Big Data and High Performance Computing (HPC) on converging tracks. It demystifies Big Data and HPC for the reader by covering the primary resources, middleware, applications, and tools that enable the usage of HPC platforms for Big Data management and processing.
Through interesting use-cases from traditional and non-traditional HPC domains, the book highlights the most critical challenges related to Big Data processing and management, and shows ways to mitigate them using HPC resources. Unlike most books on Big Data, it covers a variety of alternatives to Hadoop, and explains the differences between HPC platforms and Hadoop.
Written by professionals and researchers in a range of departments and fields, this book is designed for anyone studying Big Data and its future directions. Those studying HPC will also find the content valuable.

• Big data
• High performance computing
• High throughput Computing
• Data-Intensive computing
• E-Discovery
• Parallel R
• Nuclear fusion
• Hadoop
• Data movement
• Big Data life cycle
• Data curation
• Image processing
• data structures

• Texas Advanced Computing Center, Austin, USA

  Ritu Arora

false

Policies and ethics