OPTIMA: On-Line Partitioning Skew Mitigation for MapReduce with Resource Adjustment

Abstract

Partitioning skew has been shown to be a major issue that can significantly prolong the execution time of MapReduce jobs. Most of the existing off-line heuristics for partitioning skew mitigation are inefficient; they have to wait for the completion of all the map tasks. Some solutions can tackle this problem on-line, but will impose an additional overhead… (More)
DOI: 10.1007/s10922-015-9362-8

11 Figures and Tables

Topics

  • Presentations referencing similar topics