Leveraging Deep Reinforcement Learning for Traffic Engineering: A Survey

被引:62
|
作者
Xiao, Yang [1 ]
Liu, Jun [1 ]
Wu, Jiawei [1 ]
Ansari, Nirwan [2 ]
机构
[1] Beijing Univ Posts & Telecommun, Intelligent Percept & Comp Res Ctr, Sch Artificial Intelligence, Beijing 100876, Peoples R China
[2] New Jersey Inst Technol, Dept Elect & Comp Engn, Newark, NJ 07102 USA
来源
IEEE COMMUNICATIONS SURVEYS AND TUTORIALS | 2021年 / 23卷 / 04期
关键词
Wireless networks; Routing; Optimization; Reinforcement learning; Tutorials; Supervised learning; Wireless sensor networks; Deep reinforcement learning; traffic engineering; routing optimization; congestion control; resource management; TCP CONGESTION CONTROL; SPECTRUM ASSIGNMENT; RESOURCE-MANAGEMENT; WIRELESS NETWORKS; CELLULAR NETWORK; NEURAL-NETWORKS; EDGE; MULTIPATH; FRAMEWORK; ALGORITHM;
D O I
10.1109/COMST.2021.3102580
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
After decades of unprecedented development, modern networks have evolved far beyond expectations in terms of scale and complexity. In many cases, traditional traffic engineering (TE) approaches fail to address the quality of service (QoS) requirements of modern networks. In recent years, deep reinforcement learning (DRL) has proved to be a feasible and effective solution for autonomously controlling and managing complex systems. Massive growth in the use of DRL applications in various domains is beginning to benefit the communications industry. In this paper, we firstly provide a comprehensive overview of DRL-based TE. Then, we present a detailed literature review on applications of DRL for TE including three fundamental issues: routing optimization, congestion control, and resource management. Finally, we discuss our insights into the challenges and future research perspectives of DRL-based TE.
引用
收藏
页码:2064 / 2097
页数:34
相关论文
共 50 条
  • [21] Deep reinforcement learning: a survey
    Wang, Hao-nan
    Liu, Ning
    Zhang, Yi-yun
    Feng, Da-wei
    Huang, Feng
    Li, Dong-sheng
    Zhang, Yi-ming
    FRONTIERS OF INFORMATION TECHNOLOGY & ELECTRONIC ENGINEERING, 2020, 21 (12) : 1726 - 1744
  • [22] Deep Reinforcement Learning for Autonomous Driving: A Survey
    Kiran, B. Ravi
    Sobh, Ibrahim
    Talpaert, Victor
    Mannion, Patrick
    Al Sallab, Ahmad A.
    Yogamani, Senthil
    Perez, Patrick
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (06) : 4909 - 4926
  • [23] Traffic Engineering Based on Deep Reinforcement Learning in Hybrid IP/SR Network
    Chen, Bo
    Sun, Penghao
    Zhang, Peng
    Lan, Julong
    Bu, Youjun
    Shen, Juan
    CHINA COMMUNICATIONS, 2021, 18 (10) : 204 - 213
  • [24] On Deep Reinforcement Learning for Traffic Engineering in SD-WAN
    Troia, Sebastian
    Sapienza, Federico
    Vare, Leonardo
    Maier, Guido
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2021, 39 (07) : 2198 - 2212
  • [25] Leveraging reinforcement learning for dynamic traffic control: A survey and challenges for field implementation
    Han, Yu
    Wang, Meng
    Leclercq, Ludovic
    COMMUNICATIONS IN TRANSPORTATION RESEARCH, 2023, 3
  • [26] Joint Computing and Caching in 5G-Envisioned Internet of Vehicles: A Deep Reinforcement Learning-Based Traffic Control System
    Ning, Zhaolong
    Zhang, Kaiyuan
    Wang, Xiaojie
    Obaidat, Mohammad S.
    Guo, Lei
    Hu, Xiping
    Hu, Bin
    Guo, Yi
    Sadoun, Balqies
    Kwok, Ricky Y. K.
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2021, 22 (08) : 5201 - 5212
  • [27] A survey on deep reinforcement learning approaches for traffic signal control
    Zhao, Haiyan
    Dong, Chengcheng
    Cao, Jian
    Chen, Qingkui
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 133
  • [28] Trajectory Design and Resource Allocation for Multi-UAV Networks: Deep Reinforcement Learning Approaches
    Chang, Zheng
    Deng, Hengwei
    You, Li
    Min, Geyong
    Garg, Sahil
    Kaddoum, Georges
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2023, 10 (05): : 2940 - 2951
  • [29] ReCARL: Resource Allocation in Cloud RANs With Deep Reinforcement Learning
    Xu, Zhiyuan
    Tang, Jian
    Yin, Chengxiang
    Wang, Yanzhi
    Xue, Guoliang
    Wang, Jing
    Gursoy, M. Cenk
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2022, 21 (07) : 2533 - 2545
  • [30] Relay Selection for Energy-Harvesting Collaborative Communication Systems: A Deep Reinforcement Learning Approach
    Wang, Jindong
    Liu, Zhibin
    Liu, Xiaowu
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2025, 21 (01) : 771 - 780