Sparrow: distributed, low latency scheduling

  title={Sparrow: distributed, low latency scheduling},
  author={Kay Ousterhout and Patrick Wendell and Matei Zaharia and Ion Stoica},
Large-scale data analytics frameworks are shifting towards shorter task durations and larger degrees of parallelism to provide low latency. Scheduling highly parallel jobs that complete in hundreds of milliseconds poses a major challenge for task schedulers, which will need to schedule millions of tasks per second on appropriate machines while offering millisecond-level latency and high availability. We demonstrate that a decentralized, randomized sampling approach provides near-optimal… CONTINUE READING
Highly Influential
This paper has highly influenced 46 other papers. REVIEW HIGHLY INFLUENTIAL CITATIONS
Highly Cited
This paper has 319 citations. REVIEW CITATIONS
Related Discussions
This paper has been referenced on Twitter 4 times. VIEW TWEETS


Publications citing this paper.
Showing 1-10 of 223 extracted citations

Daphne: A Flexible and Hybrid Scheduling Framework in Multi-Tenant Clusters

IEEE Transactions on Network and Service Management • 2018
View 6 Excerpts
Highly Influenced

LAS: Logical-Block Affinity Scheduling in Big Data Analytics Systems

IEEE INFOCOM 2018 - IEEE Conference on Computer Communications • 2018
View 5 Excerpts
Highly Influenced

Phoenix: A Constraint-Aware Scheduler for Heterogeneous Datacenters

2017 IEEE 37th International Conference on Distributed Computing Systems (ICDCS) • 2017
View 8 Excerpts
Highly Influenced

Efficient and Low-Delay Task Scheduling for Big Data Clusters in a Theoretical Perspective

2016 IEEE Global Communications Conference (GLOBECOM) • 2016
View 6 Excerpts
Highly Influenced

319 Citations

Citations per Year
Semantic Scholar estimates that this publication has 319 citations based on the available data.

See our FAQ for additional information.


Publications referenced by this paper.
Showing 1-2 of 2 references

A Generalization of Multiple Choice Balls-into-Bins

G. Park
In Proc. PODC, pages 297–298, • 2011
View 4 Excerpts
Highly Influenced

The Power of Two Choices in Randomized Load Balancing

IEEE Trans. Parallel Distrib. Syst. • 2001
View 5 Excerpts
Highly Influenced

Similar Papers

Loading similar papers…