Twitter Heron: Stream Processing at Scale

  title={Twitter Heron: Stream Processing at Scale},
  author={Sanjeev Kulkarni and Nikunj Bhagat and Maosong Fu and Vikas Kedigehalli and Christopher Kellogg and Sailesh Mittal and Jignesh M. Patel and Karthikeyan Ramasamy and Siddarth Taneja},
  booktitle={SIGMOD Conference},
Storm has long served as the main platform for real-time analytics at Twitter. However, as the scale of data being processed in real-time at Twitter has increased, along with an increase in the diversity and the number of use cases, many limitations of Storm have become apparent. We need a system that scales better, has better debug-ability, has better performance, and is easier to manage -- all while working in a shared cluster infrastructure. We considered various alternatives to meet these… CONTINUE READING
Highly Influential
This paper has highly influenced 40 other papers. REVIEW HIGHLY INFLUENTIAL CITATIONS
Highly Cited
This paper has 307 citations. REVIEW CITATIONS

From This Paper

Topics from this paper.


Publications citing this paper.
Showing 1-10 of 209 extracted citations

Cutting the Tail: Designing High Performance Message Brokers to Reduce Tail Latencies in Stream Processing

2018 IEEE International Conference on Cluster Computing (CLUSTER) • 2018
View 4 Excerpts
Highly Influenced

Experimental Study on the Performance and Resource Utilization of Data Streaming Frameworks

2018 18th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGRID) • 2018
View 5 Excerpts
Highly Influenced

HarmonicIO: Scalable Data Stream Processing for Scientific Datasets

2018 IEEE 11th International Conference on Cloud Computing (CLOUD) • 2018
View 5 Excerpts
Highly Influenced

307 Citations

Citations per Year
Semantic Scholar estimates that this publication has 307 citations based on the available data.

See our FAQ for additional information.


Publications referenced by this paper.

Similar Papers

Loading similar papers…