TDWS: A Job Scheduling Algorithm Based on MapReduce

@article{Zhao2012TDWSAJ,
  title={TDWS: A Job Scheduling Algorithm Based on MapReduce},
  author={Yanrong Zhao and Weiping Wang and Dan Meng and YongChun Lv and Shubin Zhang and Jun Li},
  journal={2012 IEEE Seventh International Conference on Networking, Architecture, and Storage},
  year={2012},
  pages={313-319}
}
As organizations start to use data intensive cluster computing systems like Hadoop MapReduce to handle large-scale data, scheduling of jobs become very important in order to achieve efficiency. In the default implementations of Hadoop MapReduce, jobs are scheduled in FIFO order. It easily causes the starvation of small jobs in the event of resources being utilized by large jobs, while Fair Scheduler is inefficient when handling large jobs and it leads to sticky slots problem. In this paper, we… CONTINUE READING

Citations

Publications citing this paper.
Showing 1-5 of 5 extracted citations

A review of research on MapReduce scheduling algorithms in Hadoop

International Conference on Computing, Communication & Automation • 2015
View 1 Excerpt

Analysis of MapReduce scheduling and its improvements in cloud environment

2015 IEEE International Conference on Signal Processing, Informatics, Communication and Energy Systems (SPICES) • 2015
View 1 Excerpt

References

Publications referenced by this paper.
Showing 1-10 of 17 references

Design and Implementation of a Two Level Scheduler for HADOOP Data Grids

Dr G. Sudha sadhasivam, M Anjali
Int. J. of Advanced Networking and Applications, • 2010
View 1 Excerpt

Scheduling Hadoop Jobs to Meet Deadlines

2010 IEEE Second International Conference on Cloud Computing Technology and Science • 2010
View 1 Excerpt

Sudha sadhasivam , Anjali M . Design and Implementation of a Two Level Scheduler for HADOOP Data Grids

G. Dr
Int . J . of Advanced Networking and Applications • 2010

A Dynamic MapReduce Scheduler for Heterogeneous Workloads

2009 Eighth International Conference on Grid and Cooperative Computing • 2009
View 1 Excerpt

Hadoop: The Definitive Guide .O'Reilly.June

Tom White
2009
View 1 Excerpt

Similar Papers

Loading similar papers…