Lightweight Asynchronous Snapshots for Distributed Dataflows

@article{Carbone2015LightweightAS,
  title={Lightweight Asynchronous Snapshots for Distributed Dataflows},
  author={Paris Carbone and Gyula F{\'o}ra and Stephan Ewen and Seif Haridi and Kostas Tzoumas},
  journal={ArXiv},
  year={2015},
  volume={abs/1506.08603}
}
Distributed stateful stream processing enables the deployment and execution of large scale continuous computations in the cloud, targeting both low latency and high throughput. One of the most fundamental challenges of this paradigm is providing processing guarantees under potential failures. Existing approaches rely on periodic global state snapshots that can be used for failure recovery. Those approaches suffer from two main drawbacks. First, they often stall the overall computation which… CONTINUE READING

Citations

Publications citing this paper.
SHOWING 1-10 OF 55 CITATIONS

Probabilistic Graphical Models on Multi-Core CPUs Using Java 8

  • IEEE Computational Intelligence Magazine
  • 2016
VIEW 8 EXCERPTS
CITES BACKGROUND & METHODS
HIGHLY INFLUENCED

Comparative Analysis of Big Data Stream Processing Systems

VIEW 4 EXCERPTS
CITES BACKGROUND & METHODS
HIGHLY INFLUENCED

A survey of state management in big data processing systems

  • The VLDB Journal
  • 2017
VIEW 3 EXCERPTS
CITES METHODS
HIGHLY INFLUENCED

Exploring the impact of processing guarantees on performance of stream data processing

  • 2017 IEEE 17th International Conference on Communication Technology (ICCT)
  • 2017
VIEW 7 EXCERPTS
CITES BACKGROUND & METHODS
HIGHLY INFLUENCED

Realtime Data Processing at Facebook

  • SIGMOD Conference
  • 2016
VIEW 5 EXCERPTS
CITES METHODS & BACKGROUND
HIGHLY INFLUENCED

Apache Flink™: Stream and Batch Processing in a Single Engine

  • IEEE Data Eng. Bull.
  • 2015
VIEW 3 EXCERPTS
CITES BACKGROUND & METHODS

FILTER CITATIONS BY YEAR

2015
2019

CITATION STATISTICS

  • 10 Highly Influenced Citations

  • Averaged 12 Citations per year from 2017 through 2019

References

Publications referenced by this paper.
SHOWING 1-10 OF 14 REFERENCES

Naiad: a timely dataflow system

VIEW 8 EXCERPTS
HIGHLY INFLUENTIAL