Datacenter Traffic Control: Understanding Techniques and Tradeoffs

@article{Noormohammadpour2018DatacenterTC,
  title={Datacenter Traffic Control: Understanding Techniques and Tradeoffs},
  author={Mohammad Noormohammadpour and C. Raghavendra},
  journal={IEEE Communications Surveys \& Tutorials},
  year={2018},
  volume={20},
  pages={1492-1525}
}
Datacenters provide cost-effective and flexible access to scalable compute and storage resources necessary for today’s cloud computing needs. [...] Key Method To this end, custom transport protocols and traffic management techniques have been developed to improve datacenter network performance. In this tutorial paper, we review the general architecture of datacenter networks, various topologies proposed for them, their traffic properties, general traffic control challenges in datacenters and general traffic…Expand
View on IEEE
arxiv.org
68 Citations
Highly Influential Citations
2
Background Citations
36
Methods Citations
4

68 Citations

Citation Type

Citation Type

A survey on resource scheduling for data transfers in inter-datacenter WANs
TLDR
A review study on research efforts being conducted on the inter-datacenter networking resource scheduling problem, finding no survey focusing on the scheduling problem of inter-DC WANs is seen. Expand
information-Agnostic Traffic Scheduling in Data Center Networks with Asymmetric Topologies
TLDR
A flowlet based information-agnostic traffic scheduling mechanism that can reduce the average FCT by up to 15.35% with a realistic workload, as compared to the state-of-the-art traffic scheduling methods. Expand
Time-Space Decoupled SnF Scheduling of Bulk Transfers Across Inter-Datacenter Optical Networks
TLDR
This paper proposes a time-space decoupled (TSD) SnF scheduling method and demonstrates that the TSD method can outperform the conventional joint method, especially when the traffic load is moderate-to-high. Expand
Performance study of an SnF scheduling method for bulk data transfers over inter-datacenter WANs
TLDR
This paper aims to decouple the problem into its spatial and temporal components, and then solve these components separately, and has the potential to outperform the conventional joint method even with only three alternate routes considered in SnF scheduling. Expand
Joint Availability Enhancement and Traffic Optimization of Virtual Cluster Allocation in Cloud Datacenters
TLDR
A joint optimization function is proposed to measure the risk of VC and the core bandwidth usage with a global availability constraint and an evolutionary algorithm is raised to minimize the value of the constrained optimization function. Expand
Design of an SNF Scheduling Method for Bulk Data Transfers over Inter-Datacenter WANs
TLDR
Simulations show that the TSD method can outperform the conventional joint method when the traffic load is medium or higher, and propose a time-space decoupled (TSD) SNF scheduling method. Expand
Deadline-Aware Fast One-to-Many Bulk Transfers over Inter-Datacenter Networks
TLDR
This paper proposes a centralized admission control coupled with a scheduling algorithm, named deAdline-Guaranteed transfEr (AGE), to guarantee the deadline of admitted data transfers and utilize the network capacity efficiently. Expand
Load balance algorithm for an OPSquare datacenter network under real application traffic
TLDR
A synthetic traffic model is provided by capturing the traffic traces of the virtualized DC applications running in a DC and the lowest path buffer (LPB) algorithm is proposed and evaluated to optimize the OPSquare DCN performance. Expand
QuickCast: Fast and Efficient Inter-Datacenter Transfers Using Forwarding Tree Cohorts
TLDR
QuickCast is presented, a first solution to the problems of using a cohort of forwarding trees over which large inter-datacenter transfers take place and can speed up the average receiver's completion time by as much as $10\times while only using $1.04\times$ more bandwidth; further, the completion time for all receivers also improves and is faster at high loads. Expand
G-PFC: A Packet-Priority Aware PFC Scheme for the Datacenter
  • Zheng Cui, Steven Y. Rim
  • Computer Science
  • 2020 21st Asia-Pacific Network Operations and Management Symposium (APNOMS)
  • 2020
TLDR
G-PFC is presented, a packet-based priority aware flow control scheme to provide low queuing delay and less pause duration for the high priority traffic that compare to low priority traffic (packets). Expand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 273 REFERENCES
DCCast: Efficient Point to Multipoint Transfers Across Datacenters
TLDR
DCCast is presented, a centralized Point to Multi-Point (P2MP) algorithm that uses forwarding trees to efficiently deliver an object from a source datacenter to required destination datacenters with low computational overhead. Expand
A Scalable Approach to Avoid Incast Problem from Application Layer
TLDR
The proposed approach, staggered flows, is able to avoid incast problem and to make the performance better in most cases and the potential of scalability is shown that this approach can keep the performance well with the increment of node quantity. Expand
DCRoute: Speeding up Inter-Datacenter Traffic Allocation while Guaranteeing Deadlines
TLDR
DCRoute is proposed, a fast and efficient routing and traffic allocation technique that guarantees transfer completion before deadlines for admitted requests that assigns each transfer a single path to avoid packet reordering. Expand
Multiple bulk data transfers scheduling among datacenters
TLDR
The results prove that the algorithm can significantly reduce the network congestion as well as balance the entire network traffic with practical computational costs. Expand
Practical TDMA for datacenter ethernet
TLDR
A TDMA MAC layer for commodity Ethernet hardware is designed and implemented that allows end hosts to dispense with TCP's reliability and congestion control and is found to result in higher bandwidth for MapReduce shuffle workloads, lower latency for RPC workloads in the presence of background traffic, and more efficient operation in highly dynamic and hybrid optical/electrical networks. Expand
Better never than late: meeting deadlines in datacenter networks
The soft real-time nature of large scale web applications in today's datacenters, combined with their distributed workflow, leads to deadlines being associated with the datacenter application… Expand
Inter-datacenter bulk transfers with netstitcher
Large datacenter operators with sites at multiple locations dimension their key resources according to the peak demand of the geographic area that each site covers. The demand of specific areas… Expand
Energy proportional datacenter networks
TLDR
It is demonstrated that energy proportional datacenter communication is indeed possible and that there is a significant power advantage to having independent control of each unidirectional channel comprising a network link. Expand
Mahout: Low-overhead datacenter traffic management using end-host-based elephant detection
TLDR
Mahout is presented, a low-overhead yet effective traffic management system that follows OpenFlow-like central controller approach for network management but augments the design with the authors' novel end host mechanism. Expand
Dynamic Pricing and Traffic Engineering for Timely Inter-Datacenter Transfers
TLDR
Pretium is a framework that combines dynamic pricing with traffic engineering for inter-datacenter bandwidth and improves total system efficiency by more than 3.5X relative to current usage-based pricing schemes, while increasing the provider profits by 2X. Expand
...
1
2
3
4
5
...