Detecting bottlenecks in parallel DAG-based data flow programs

  title={Detecting bottlenecks in parallel DAG-based data flow programs},
  author={Dominic Battr{\'e} and Matthias Hovestadt and Bj{\"o}rn Lohrmann and Alexander Stanik and Daniel Warneke},
  journal={2010 3rd Workshop on Many-Task Computing on Grids and Supercomputers},
In recent years, several frameworks have been introduced to facilitate massively-parallel data processing on shared-nothing architectures like compute clouds. While these frameworks generally offer good support in terms of task deployment and fault tolerance, they only provide poor assistance in finding reasonable degrees of parallelization for the tasks to be executed. However, as billing models of clouds enable the utilization of many resources for a short period of time for the same cost as… CONTINUE READING


Publications referenced by this paper.
Showing 1-10 of 29 references

Amazon Elastic Compute Cloud (Amazon EC2)

  • LLC Amazon Web Services
  •, 2009.
  • 2009
Highly Influential
4 Excerpts

Self-service, prorated super computing fun!

  • D. Gottfrid
  • self-service-prorated-super-computing-fun/,
  • 2007
Highly Influential
5 Excerpts

Map/Reduce tutorial

  • The Apache Software Foundation
  • http://hadoop.…
  • 2010
1 Excerpt

The Rackspace Cloud

  • US Rackspace, Inc.
  • http://www., 2010.
  • 2010
1 Excerpt

, Inc . , “ The Rackspace Cloud

  • US Rackspace
  • Nephele : Efficient parallel data processing in…
  • 2009

Amazon Elastic Block Storage (Amazon EBS)

  • LLC Amazon Web Services
  •, 2009.
  • 2009
2 Excerpts

Similar Papers

Loading similar papers…