Load Balancing for Skewed Streams on Heterogeneous Cluster

@article{Nasir2017LoadBF,
  title={Load Balancing for Skewed Streams on Heterogeneous Cluster},
  author={Muhammad Anis Uddin Nasir and Hiroshi Horii and Marco Serafini and Nicolas Kourtellis and Raymond H. Putra and Sarunas Girdzijauskas and Takayuki Osogami},
  journal={CoRR},
  year={2017},
  volume={abs/1705.09073}
}
Primitive partitioning strategies for streaming applications operate e ciently under two very strict assumptions: the resources are homogeneous and the messages are drawn from a uniform key distribution. These assumptions are often not true for the real-world use cases. Dealing with heterogeneity and non-uniform workload requires inferring the resource capacities and input distribution at run time. However, gathering these statistics and nding an optimal placement often become a challenge when… CONTINUE READING
Recent Discussions
This paper has been referenced on Twitter 5 times over the past 90 days. VIEW TWEETS

References

Publications referenced by this paper.
Showing 1-10 of 51 references

Clay: ne-grained adaptive partitioning for general database schemas

  • Marco Sera ni, Rebecca Taft, Aaron J Elmore, Andrew Pavlo, Ashraf Aboulnaga, Michael Stonebraker
  • Proceedings of the VLDB Endowment 10,
  • 2016
1 Excerpt

Similar Papers

Loading similar papers…