C3: Cutting Tail Latency in Cloud Data Stores via Adaptive Replica Selection

Abstract

Achieving predictable performance is critical for many distributed applications, yet difficult to achieve due to many factors that skew the tail of the latency distribution even in well-provisioned systems. In this paper, we present the fundamental challenges involved in designing a replica selection scheme that is robust in the face of performance fluctuations across servers. We illustrate these challenges through performance evaluations of the Cassandra distributed database on Amazon EC2. We then present the design and implementation of an adaptive replica selection mechanism, C3, that is robust to performance variability in the environment. We demonstrate C3’s effectiveness in reducing the latency tail and improving throughput through extensive evaluations on Amazon EC2 and through simulations. Our results show that C3 significantly improves the latencies along the mean, median, and tail (up to 3 times improvement at the 99.9th percentile) and provides higher system throughput.

View Slides

Extracted Key Phrases

0102030201520162017
Citations per Year

Citation Velocity: 16

Averaging 16 citations per year over the last 3 years.

Learn more about how we calculate this metric in our FAQ.

Cite this paper

@inproceedings{Suresh2015C3CT, title={C3: Cutting Tail Latency in Cloud Data Stores via Adaptive Replica Selection}, author={P. Lalith Suresh and Marco Canini and Stefan Schmid and Anja Feldmann}, booktitle={NSDI}, year={2015} }