Nondeterminism in MapReduce considered harmful? an empirical study on non-commutative aggregators in MapReduce programs

@inproceedings{Xiao2014NondeterminismIM,
  title={Nondeterminism in MapReduce considered harmful? an empirical study on non-commutative aggregators in MapReduce programs},
  author={Tian Xiao and Jiaxing Zhang and Hucheng Zhou and Zhenyu Guo and Sean McDirmid and Wei Lin and Wenguang Chen and Lidong Zhou},
  booktitle={ICSE Companion},
  year={2014}
}
The simplicity of MapReduce introduces unique subtleties that cause hard-to-detect bugs; in particular, the unfixed order of reduce function input is a source of nondeterminism that is harmful if the reduce function is not commutative and sensitive to input order. Our extensive study of production MapReduce programs reveals interesting findings on commutativity, nondeterminism, and correctness. Although non-commutative reduce functions lead to five bugs in our sample of well-tested production… CONTINUE READING
Highly Cited
This paper has 29 citations. REVIEW CITATIONS

Citations

Publications citing this paper.
Showing 1-10 of 19 extracted citations

Similar Papers

Loading similar papers…