Optimization for Speculative Execution of Multiple Jobs in a MapReduce-like Cluster

@article{Xu2014OptimizationFS,
  title={Optimization for Speculative Execution of Multiple Jobs in a MapReduce-like Cluster},
  author={Huanle Xu and Wing Cheong Lau},
  journal={CoRR},
  year={2014},
  volume={abs/1406.0609}
}
Nowadays, a computing cluster in a typical data center can easily consist of hundreds of thousands of commodity servers, making component/ machine failures the norm rather than exception. A parallel processing job can be delayed substantially as long as one of its many tasks is being assigned to a failing machine. To tackle this so-called straggler problem… CONTINUE READING