Scotty: Efficient Window Aggregation for Out-of-Order Stream Processing

@article{Traub2018ScottyEW,
  title={Scotty: Efficient Window Aggregation for Out-of-Order Stream Processing},
  author={Jonas Traub and Philipp Marian Grulich and Junmin He and Sebastian Bre\ss and Asterios Katsifodimos and Tilmann Rabl and Volker Markl},
  journal={2018 IEEE 34th International Conference on Data Engineering (ICDE)},
  year={2018},
  pages={1300-1303}
}
Computing aggregates over windows is at the core of virtually every stream processing job. Typical stream processing applications involve overlapping windows and, therefore, cause redundant computations. Several techniques prevent this redundancy by sharing partial aggregates among windows. However, these techniques do not support out-of-order processing and session windows. Out-of-order processing is a key requirement to deal with delayed tuples in case of source failures such as temporary… CONTINUE READING

From This Paper

Figures and tables from this paper.

Citations

Publications citing this paper.

References

Publications referenced by this paper.
Showing 1-10 of 18 references

High-throughput, lowlatency, and exactly-once stream processing with Apache Flink

  • K. Tzoumas, S. Ewen, R. Metzger
  • 2015, https://data-artisans.com/blog/high…
  • 2015

Similar Papers

Loading similar papers…