Natjam: design and evaluation of eviction policies for supporting priorities and deadlines in mapreduce clusters

@inproceedings{Cho2013NatjamDA,
  title={Natjam: design and evaluation of eviction policies for supporting priorities and deadlines in mapreduce clusters},
  author={Brian Cho and Muntasir Raihan Rahman and Tej Chajed and Indranil Gupta and Cristina L. Abad and Nathan Roberts and Philbert Lin},
  booktitle={SoCC},
  year={2013}
}
This paper presents Natjam, a system that supports arbitrary job priorities, hard real-time scheduling, and efficient preemption for Mapreduce clusters that are resource-constrained. Our contributions include: i) exploration and evaluation of smart eviction policies for jobs and for tasks, based on resource usage, task runtime, and job deadlines; and ii) a work-conserving task preemption mechanism for Mapreduce. We incorporated Natjam into the Hadoop YARN scheduler framework (in Hadoop 0.23… CONTINUE READING
Highly Cited
This paper has 65 citations. REVIEW CITATIONS

Citations

Publications citing this paper.
Showing 1-10 of 36 extracted citations

66 Citations

01020'14'16'18
Citations per Year
Semantic Scholar estimates that this publication has 66 citations based on the available data.

See our FAQ for additional information.

References

Publications referenced by this paper.
Showing 1-10 of 18 references

The Operating System as a Resource Manager

  • A. S. Tanenbaum
  • Modern Operating Systems, chapter 1.1.2. Pearson…
  • 2008
Highly Influential
11 Excerpts