Leveraging Deep Reinforcement Learning for Traffic Engineering: A Survey

被引:62
|
作者
Xiao, Yang [1 ]
Liu, Jun [1 ]
Wu, Jiawei [1 ]
Ansari, Nirwan [2 ]
机构
[1] Beijing Univ Posts & Telecommun, Intelligent Percept & Comp Res Ctr, Sch Artificial Intelligence, Beijing 100876, Peoples R China
[2] New Jersey Inst Technol, Dept Elect & Comp Engn, Newark, NJ 07102 USA
来源
IEEE COMMUNICATIONS SURVEYS AND TUTORIALS | 2021年 / 23卷 / 04期
关键词
Wireless networks; Routing; Optimization; Reinforcement learning; Tutorials; Supervised learning; Wireless sensor networks; Deep reinforcement learning; traffic engineering; routing optimization; congestion control; resource management; TCP CONGESTION CONTROL; SPECTRUM ASSIGNMENT; RESOURCE-MANAGEMENT; WIRELESS NETWORKS; CELLULAR NETWORK; NEURAL-NETWORKS; EDGE; MULTIPATH; FRAMEWORK; ALGORITHM;
D O I
10.1109/COMST.2021.3102580
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
After decades of unprecedented development, modern networks have evolved far beyond expectations in terms of scale and complexity. In many cases, traditional traffic engineering (TE) approaches fail to address the quality of service (QoS) requirements of modern networks. In recent years, deep reinforcement learning (DRL) has proved to be a feasible and effective solution for autonomously controlling and managing complex systems. Massive growth in the use of DRL applications in various domains is beginning to benefit the communications industry. In this paper, we firstly provide a comprehensive overview of DRL-based TE. Then, we present a detailed literature review on applications of DRL for TE including three fundamental issues: routing optimization, congestion control, and resource management. Finally, we discuss our insights into the challenges and future research perspectives of DRL-based TE.
引用
收藏
页码:2064 / 2097
页数:34
相关论文
共 50 条
  • [1] Reinforcement and deep reinforcement learning for wireless Internet of Things: A survey
    Frikha, Mohamed Said
    Gammar, Sonia Mettali
    Lahmadi, Abdelkader
    Andrey, Laurent
    COMPUTER COMMUNICATIONS, 2021, 178 : 98 - 113
  • [2] Traffic Engineering in a Shared Inter-DC WAN via Deep Reinforcement Learning
    Guo, Yingya
    Ma, Yulong
    Luo, Huan
    Wu, Jianping
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2022, 9 (04): : 2870 - 2881
  • [3] Traffic Engineering Based on Reinforcement Learning for Service Function Chaining With Delay Guarantee
    Tuan-Minh Pham
    IEEE ACCESS, 2021, 9 : 121583 - 121592
  • [4] Applications of Deep Reinforcement Learning in Communications and Networking: A Survey
    Luong, Nguyen Cong
    Hoang, Dinh Thai
    Gong, Shimin
    Niyato, Dusit
    Wang, Ping
    Liang, Ying-Chang
    Kim, Dong In
    IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2019, 21 (04): : 3133 - 3174
  • [5] Enabling efficient routing for traffic engineering in SDN with Deep Reinforcement Learning
    Pei, Xinglong
    Sun, Penghao
    Hu, Yuxiang
    Li, Dan
    Chen, Bo
    Tian, Le
    COMPUTER NETWORKS, 2024, 241
  • [6] Leveraging Transfer Learning in Deep Reinforcement Learning for Solving Combinatorial Optimization Problems Under Uncertainty
    Ezzahra Achamrah, Fatima
    IEEE ACCESS, 2024, 12 : 181477 - 181497
  • [7] A survey of reinforcement and deep reinforcement learning for coordination in intelligent traffic light control
    Saadi, Aicha
    Abghour, Noureddine
    Chiba, Zouhair
    Moussaid, Khalid
    Ali, Saadi
    JOURNAL OF BIG DATA, 2025, 12 (01)
  • [8] CFR-RL: Traffic Engineering With Reinforcement Learning in SDN
    Zhang, Junjie
    Ye, Minghao
    Guo, Zehua
    Yen, Chen-Yu
    Chao, H. Jonathan
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2020, 38 (10) : 2249 - 2259
  • [9] The Frontiers of Deep Reinforcement Learning for Resource Management in Future Wireless HetNets: Techniques, Challenges, and Research Directions
    Alwarafy, Abdulmalik
    Abdallah, Mohamed
    Ciftler, Bekir Sait
    Al-Fuqaha, Ala
    Hamdi, Mounir
    IEEE OPEN JOURNAL OF THE COMMUNICATIONS SOCIETY, 2022, 3 : 322 - 365
  • [10] ScaleDRL: A Scalable Deep Reinforcement Learning Approach for Traffic Engineering in SDN with Pinning Control
    Sun, Penghao
    Guo, Zehua
    Lan, Julong
    Li, Junfei
    Hu, Yuxiang
    Baker, Thar
    COMPUTER NETWORKS, 2021, 190