Performance Implications of Big Data in Scalable Deep Learning: On the Importance of Bandwidth and Caching

  title={Performance Implications of Big Data in Scalable Deep Learning: On the Importance of Bandwidth and Caching},
  author={Miro Hodak and David Ellison and Peter Seidel and A. Dholakia},
  journal={2018 IEEE International Conference on Big Data (Big Data)},
Deep learning techniques have revolutionized many areas including computer vision and speech recognition. While such networks require tremendous amounts of data, the requirement for and connection to Big Data storage systems is often undervalued and not well understood. In this paper, we explore the relationship between Big Data storage, networking, and Deep Learning workloads to understand key factors for designing Big Data/Deep Learning integrated solutions. We find that storage and… Expand
1 Citations


Towards Scalable Deep Learning via I/O Analysis and Optimization
  • S. Pumma, Min Si, Wu-chun Feng, P. Balaji
  • Computer Science
  • 2017 IEEE 19th International Conference on High Performance Computing and Communications; IEEE 15th International Conference on Smart City; IEEE 3rd International Conference on Data Science and Systems (HPCC/SmartCity/DSS)
  • 2017
  • 14
Applied Machine Learning at Facebook: A Datacenter Infrastructure Perspective
  • K. Hazelwood, Sarah Bird, +14 authors X. Wang
  • Computer Science
  • 2018 IEEE International Symposium on High Performance Computer Architecture (HPCA)
  • 2018
  • 233
  • PDF
Parallel I/O Optimizations for Scalable Deep Learning
  • 15
  • PDF
Towards Evaluation of Tensorflow Performance in a Distributed Compute Environment
  • 3
Poseidon: A System Architecture for Efficient GPU-based Deep Learning on Multiple Machines
  • 45
  • PDF
Distributed Deep Neural Networks Over the Cloud, the Edge and End Devices
  • 310
  • PDF
Distributed Training of Deep Neural Networks: Theoretical and Practical Limits of Parallel Scalability
  • 70
  • PDF
Parallel and Distributed Deep Learning
  • 17
  • PDF
Efficient Processing of Deep Neural Networks: A Tutorial and Survey
  • 1,219
  • PDF