Multi-Agent Deep Reinforcement Learning-Based Fine-Grained Traffic Scheduling in Data Center Networks

被引:1
作者
Wang, Huiting [1 ]
Liu, Yazhi [1 ]
Li, Wei [1 ]
Yang, Zhigang [2 ]
机构
[1] North China Univ Sci & Technol, Coll Artificial Intelligence, Tangshan 063210, Peoples R China
[2] North China Univ Sci & Technol, Coll Elect Engn, Tangshan 063210, Peoples R China
关键词
data center network; traffic scheduling; multi-agent deep reinforcement learning; in-band network telemetry; programmable data plane;
D O I
10.3390/fi16040119
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In data center networks, when facing challenges such as traffic volatility, low resource utilization, and the difficulty of a single traffic scheduling strategy to meet demands, it is necessary to introduce intelligent traffic scheduling mechanisms to improve network resource utilization, optimize network performance, and adapt to the traffic scheduling requirements in a dynamic environment. This paper proposes a fine-grained traffic scheduling scheme based on multi-agent deep reinforcement learning (MAFS). This approach utilizes In-Band Network Telemetry to collect real-time network states on the programmable data plane, establishes the mapping relationship between real-time network state information and the forwarding efficiency on the control plane, and designs a multi-agent deep reinforcement learning algorithm to calculate the optimal routing strategy under the current network state. The experimental results demonstrate that compared to other traffic scheduling methods, MAFS can effectively enhance network throughput. It achieves a 1.2x better average throughput and achieves a 1.4-1.7x lower packet loss rate.
引用
收藏
页数:17
相关论文
共 29 条
[1]  
Al-Fares M., 2010, P 7 USENIX C NETWORK, V10, P89
[2]  
[Anonymous], About us
[3]   Performance Evaluation Using RYU SDN Controller in Software-Defined Networking Environment [J].
Bhardwaj, Shanu ;
Panda, S. N. .
WIRELESS PERSONAL COMMUNICATIONS, 2022, 122 (01) :701-723
[4]   Analysis of Inter-Satellite Link Paths for LEO Mega-Constellation Networks [J].
Chen, Quan ;
Giambene, Giovanni ;
Yang, Lei ;
Fan, Chengguang ;
Chen, Xiaoqian .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2021, 70 (03) :2743-2755
[5]  
Curtis AR, 2011, IEEE INFOCOM SER, P1629, DOI 10.1109/INFCOM.2011.5934956
[6]   Reinforcement Learning-Based Routing Protocol for Opportunistic Networks [J].
Dhurandher, Sanjay Kumar ;
Singh, Jagdeep ;
Obaidat, Mohammad S. ;
Woungang, Isaac ;
Srivastava, Samariddhi ;
Rodrigues, Joel J. P. C. .
ICC 2020 - 2020 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2020,
[7]   Target-driven visual navigation in indoor scenes using reinforcement learning and imitation learning [J].
Fang, Qiang ;
Xu, Xin ;
Wang, Xitong ;
Zeng, Yujun .
CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY, 2022, 7 (02) :167-176
[8]   RTHop: Real-Time Hop-by-Hop Mobile Network Routing by Decentralized Learning With Semantic Attention [J].
He, Bo ;
Wang, Jingyu ;
Qi, Qi ;
Sun, Haifeng ;
Liao, Jianxin .
IEEE TRANSACTIONS ON MOBILE COMPUTING, 2023, 22 (03) :1731-1747
[9]   QAM-FBMC: A New Multi-Carrier System for Post-OFDM Wireless Communications [J].
Kim, Chanhong ;
Kim, Kyeongyeon ;
Yun, Yeo Hun ;
Ho, Zuleita ;
Lee, Byunghwan ;
Seol, Ji-Yun .
2015 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2015,
[10]  
Kim D., 2019, arXiv