HPSTOS: High-Performance and Scalable Traffic Optimization Strategy for Mixed Flows in Data Center Networks

被引:5
作者
Liu, Yong [1 ]
Gu, Huaxi [1 ]
Wang, Ning [2 ]
机构
[1] Xidian Univ, State Key Lab Integrated Serv Networks ISN, Xian 710071, Peoples R China
[2] Univ Surrey, Inst Commun Syst ICS, Guildford GU2 7XH, England
基金
国家重点研发计划; 中国国家自然科学基金; 中国博士后科学基金;
关键词
Data center networks; traffic optimization; high performance; scalability; CONGESTION; ELEPHANT;
D O I
10.1109/TCC.2021.3063469
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In data center networks, traffic needs to be distributed among different paths using traffic optimization strategies for mixed flows. Most of the existing strategies consider either distributed or centralized mechanisms to optimize the latency of mice flows or the throughput of elephant flows. However, low network performance and scalability issues are intrinsic limitations of both strategies. In addition, the current elephant flow detection methods are inefficient. In this article, we propose a high-performance and scalable traffic optimization strategy (HPSTOS) based on a hybrid approach that leverages the advantages of both centralized and distributed mechanisms. HPSTOS improves the efficiency of elephant flow detection through sampling and flow-table identification. HPSTOS guarantees preferential transmission of mice flows using priority scheduling and adjusts their transmission rate by coding-based congestion control on the end-host, reducing their latency. Additionally, HPSTOS schedules elephant flows by cost-aware dynamic flow scheduling on a centralized controller to improve their throughput. The controller handles only elephant flows, which constitutes the minority of the flows, allowing effective scalability. Evaluations show that HPSTOS outperforms existing schemes by realizing efficient elephant flow detection and improving network performance and scalability.
引用
收藏
页码:2649 / 2663
页数:15
相关论文
共 49 条
[1]  
Al-Fares M., 2010, Hedera: dynamic flow scheduling for data center networks, P19
[2]   FLight: A Fast and Lightweight Elephant-Flow Detection Mechanism [J].
AlGhadhban, Amer ;
Shihada, Basem .
2018 IEEE 38TH INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS (ICDCS), 2018, :1537-1538
[3]   CONGA: Distributed Congestion-Aware Load Balancing for Datacenters [J].
Alizadeh, Mohammad ;
Edsall, Tom ;
Dharmapurikar, Sarang ;
Vaidyanathan, Ramanan ;
Chu, Kevin ;
Fingerhut, Andy ;
Lam, Vinh The ;
Matus, Francis ;
Pan, Rong ;
Yadav, Navindra ;
Varghese, George .
SIGCOMM'14: PROCEEDINGS OF THE 2014 ACM CONFERENCE ON SPECIAL INTEREST GROUP ON DATA COMMUNICATION, 2014, :503-514
[4]   pFabric: Minimal Near-Optimal Datacenter Transport [J].
Alizadeh, Mohammad ;
Yang, Shuang ;
Sharif, Milad ;
Katti, Sachin ;
McKeown, Nick ;
Prabhakar, Balaji ;
Shenker, Scott .
ACM SIGCOMM COMPUTER COMMUNICATION REVIEW, 2013, 43 (04) :435-446
[5]   Data Center TCP (DCTCP) [J].
Alizadeh, Mohammad ;
Greenberg, Albert ;
Maltz, David A. ;
Padhye, Jitendra ;
Patel, Parveen ;
Prabhakar, Balaji ;
Sengupta, Sudipta ;
Sridharan, Murari .
ACM SIGCOMM COMPUTER COMMUNICATION REVIEW, 2010, 40 (04) :63-74
[6]  
CAIDA, 2014, ANONYMIZED INTERNET
[7]  
Carpio F, 2016, IEEE GLOB COMM CONF
[8]   AuTO: Scaling Deep Reinforcement Learning for Datacenter-Scale Automatic Traffic Optimization [J].
Chen, Li ;
Lingys, Justinas ;
Chen, Kai ;
Liu, Feng .
PROCEEDINGS OF THE 2018 CONFERENCE OF THE ACM SPECIAL INTEREST GROUP ON DATA COMMUNICATION (SIGCOMM '18), 2018, :191-205
[9]   Scheduling Mix-flows in Commodity Datacenters with Karuna [J].
Chen, Li ;
Chen, Kai ;
Bai, Wei ;
Alizadeh, Mohammad .
PROCEEDINGS OF THE 2016 ACM CONFERENCE ON SPECIAL INTEREST GROUP ON DATA COMMUNICATION (SIGCOMM '16), 2016, :174-187
[10]  
Corbato F.J., 1962, ACM AIEE IRE, P335