Partitioning functions for stateful data parallelism in stream processing

  title={Partitioning functions for stateful data parallelism in stream processing},
  author={Bugra Gedik},
  journal={The VLDB Journal},
In this paper, we study partitioning functions for stream processing systems that employ stateful data parallelism to improve application throughput. In particular, we develop partitioning functions that are effective under workloads where the domain of the partitioning key is large and its value distribution is skewed. We define various desirable properties for partitioning functions, ranging from balance properties such as memory, processing, and communication balance, structural properties… CONTINUE READING
Highly Cited
This paper has 61 citations. REVIEW CITATIONS


Publications citing this paper.
Showing 1-10 of 45 extracted citations

61 Citations

Citations per Year
Semantic Scholar estimates that this publication has 61 citations based on the available data.

See our FAQ for additional information.


Publications referenced by this paper.
Showing 1-10 of 27 references

Elastic degreeofparallelism adaptation for data stream process

  • B. Gedik, S. Schneider, M. Hirzel, K. L. Wu
  • 2012

Synopses for Massive Data: Samples, Histograms, Wavelets, Sketches

  • G. Cormode, M. Garofalakis, P. Haas, C. Jermaine
  • Now Publishing, Foundations and Trends in…
  • 2011
1 Excerpt

Building a high-level data flow system on top of map-reduce: The PIG experience

  • A. F. Gates, O. Natkovich, +6 authors U. Srivastava
  • Proceedings of the Very Large Data Bases…
  • 2009
2 Excerpts

Similar Papers

Loading similar papers…