Algorithmic Nuggets in Content Delivery

@article{Maggs2015AlgorithmicNI,
  title={Algorithmic Nuggets in Content Delivery},
  author={Bruce M. Maggs and Ramesh K. Sitaraman},
  journal={Comput. Commun. Rev.},
  year={2015},
  volume={45},
  pages={52-66}
}
This paper "peeks under the covers" at the subsystems that provide the basic functionality of a leading content delivery network. Based on our experiences in building one of the largest distributed systems in the world, we illustrate how sophisticated algorithmic research has been adapted to balance the load between and within server clusters, manage the caches on servers, select paths through an overlay routing network, and elect leaders in various contexts. In each instance, we first explain… 
Framework and Algorithms for Operator-Managed Content Caching
TLDR
This work proposes a complete framework targeting operator-driven content caching that can be equally applied to both ISP-operated Content Delivery Networks (CDNs) and future Information-Centric Networks (ICNs), and provides knobs for operators to fine-tune performance.
Data-Driven Management of CDN Performance
TLDR
A unified framework for CDNs to jointly solve the problems of placement, mapping, and disk allocation, while including the impact of cache misses is proposed, and a fine-grained instrumentation of the e2e path is proposed to detect and diagnose performance problems that cause poor experience for users.
Midgress-aware traffic provisioning for content delivery
TLDR
This paper proposes algorithms that provision traffic classes to servers such that midgress is minimized and proposes an efficient heuristic for traffic provisioning that achieves near-optimal midgress and is suitable for use in production settings.
Access Strategies for Network Caching
TLDR
Practical algorithms with guaranteed approximation ratios are introduced and shown to exhibit near-optimal performance in various settings, whereas the efficiency of existing approaches depends upon system parameters that may change over time, or be otherwise unknown.
Steering hyper-giants' traffic at scale
TLDR
This work reports on the multi-year experience in designing, building, rolling-out, and operating the first-ever large scale system, the Flow Director, which enables automated cooperation between one of the largest eyeball networks and a leading hyper-giant, and uses empirical data collected at the eyeball network to evaluate its impact.
Consistent Dynamic Server Assignment in Content Delivery Network
TLDR
Theoretical analysis proves that the proposed greedy algorithm has considerable optimality guarantees, and evaluation shows that DynDNS can avoid about 50% unnecessary shift in demand allocation and yield more stable cache hit ratio.
Overlay routing for fast video transfers in CDN
TLDR
The proposed algorithm provides a near-optimal solution, while drastically reducing the execution time, to speed up the transfer of video segments by finding minimum delay overlay paths under constraints on hop count, jitter, packet loss and relay node capacity.
Integrated Caching and Routing Strategy for Information-Centric Networks
TLDR
An integrated caching and forwarding solution which minimizes the caching redundancy and maximizes the probability of finding nearby cached content using Name Data Networking (NDN) node architecture and its forwarding plane/strategy (of routing) to attain the goal.
On the design of efficient caching systems
TLDR
This thesis addresses the problem of designing scalable and cost-effective distributed caching systems that will be able to efficiently support the expected massive growth of content traffic and makes three distinct contributions, including an extensive theoretical characterisation of sharding.
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 45 REFERENCES
Globally Distributed Content Delivery
TLDR
The Akamai system has since evolved to distribute dynamically generated pages and even applications to the network's edge, providing customers with on-demand bandwidth and computing capacity and lets content providers' infrastructure requirements be reduced, and lets them deploy or expand services more quickly and easily.
Load balancing in Content Delivery Networks in Novel Distributed Equilibrium
TLDR
A new CDN design is described that associates artificial load-aware coordinates with clients and data servers and uses them to direct content requests to cached data, which helps achieve good accuracy and service when request workloads and resource availability in the CDN are dynamic.
Designing overlay multicast networks for streaming
TLDR
A polynomial time approximation algorithm for designing a multicast overlay network that satisfies capacity and reliability constraints to within a constant factor of optimal, and cost to within alogarithmic factor is presented.
Algorithms for Constructing Overlay Networks For Live Streaming
TLDR
The class of overlay networks constructed by the algorithm are used by Akamai Technologies to deliver live media events to a global audience with high fidelity and include networks consisting of three stages of nodes.
Towards Realizing the Performance and Availability Benefits of a Global Overlay Network
TLDR
This study shows that while overlays provide some improvements in North America, their benefits are especially significant for paths with Asian endpoints, and proposes and evaluates a simple predictive scheme that achieves almost optimal latency using only 2-3 paths.
End-User Mapping: Next Generation Request Routing for Content Delivery
TLDR
This work describes the experience in building and rolling-out a novel system called end- user mapping that identifies the client directly by using a prefix of the client's IP address, and shows that a CDN with a larger number of deployment locations is likely to benefit more from end-user mapping than a CDNs with a smaller number of deployments.
Network flows - theory, algorithms and applications
TLDR
In-depth, self-contained treatments of shortest path, maximum flow, and minimum cost flow problems, including descriptions of polynomial-time algorithms for these core models are presented.
Overlay Networks: An Akamai Perspective
TLDR
The gap between what modern Internet-based services need and what the Internet actually provides is bridged, and guarantees on high performance, availability, scalability and security are not inherently provided on the Internet in accordance with its best effort design principle.
A transport layer for live streaming in a content delivery network
TLDR
The design choices made during the evolution of Akamai's CDN for streaming media are discussed to ensure the network's scalability, quality of delivered content, and reliability while keeping costs low.
...
1
2
3
4
5
...