Modeling and Optimization of Straggling Mappers

  title={Modeling and Optimization of Straggling Mappers},
  author={Farshid Farhat and Diman Zad Tootaghaj and Anand Sivasubramaniam and Melih Kandemir and Chita R. Das},
MapReduce framework is widely used to parallelize batch jobs since it exploits a high degree of multi-tasking to process them. However, it has been observed that when the number of mappers increases, the map phase can take much longer than expected. This paper analytically shows that stochastic behavior of mapper nodes has a negative effect on the completion time of a MapReduce job, and continuously increasing the number of mappers without accurate scheduling can degrade the overall performance… CONTINUE READING