Discretized Streams : A Fault-Tolerant Model for Scalable Stream Processing

  title={Discretized Streams : A Fault-Tolerant Model for Scalable Stream Processing},
  author={Matei Zaharia and Tathagata Das and Haoyuan Li and Timothy Hunter and Scott Shenker and Ion Stoica},
Many “big data” applications need to act on data arriving in real time. However, current programming models for distributed stream processing are relatively low-level, often leaving the user to worry about consistency of state across the system and fault recovery. Furthermore, the models that provide fault recovery do so in an expensive manner, requiring either hot replication or long recovery times. We propose a new programming model, discretized streams (D-Streams), that offers a high-level… CONTINUE READING
Highly Cited
This paper has 23 citations. REVIEW CITATIONS
17 Citations
31 References
Similar Papers


Publications citing this paper.
Showing 1-10 of 17 extracted citations


Publications referenced by this paper.
Showing 1-10 of 31 references

Similar Papers

Loading similar papers…