Leveraging Deep Reinforcement Learning for Traffic Engineering: A Survey

被引:62
|
作者
Xiao, Yang [1 ]
Liu, Jun [1 ]
Wu, Jiawei [1 ]
Ansari, Nirwan [2 ]
机构
[1] Beijing Univ Posts & Telecommun, Intelligent Percept & Comp Res Ctr, Sch Artificial Intelligence, Beijing 100876, Peoples R China
[2] New Jersey Inst Technol, Dept Elect & Comp Engn, Newark, NJ 07102 USA
来源
IEEE COMMUNICATIONS SURVEYS AND TUTORIALS | 2021年 / 23卷 / 04期
关键词
Wireless networks; Routing; Optimization; Reinforcement learning; Tutorials; Supervised learning; Wireless sensor networks; Deep reinforcement learning; traffic engineering; routing optimization; congestion control; resource management; TCP CONGESTION CONTROL; SPECTRUM ASSIGNMENT; RESOURCE-MANAGEMENT; WIRELESS NETWORKS; CELLULAR NETWORK; NEURAL-NETWORKS; EDGE; MULTIPATH; FRAMEWORK; ALGORITHM;
D O I
10.1109/COMST.2021.3102580
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
After decades of unprecedented development, modern networks have evolved far beyond expectations in terms of scale and complexity. In many cases, traditional traffic engineering (TE) approaches fail to address the quality of service (QoS) requirements of modern networks. In recent years, deep reinforcement learning (DRL) has proved to be a feasible and effective solution for autonomously controlling and managing complex systems. Massive growth in the use of DRL applications in various domains is beginning to benefit the communications industry. In this paper, we firstly provide a comprehensive overview of DRL-based TE. Then, we present a detailed literature review on applications of DRL for TE including three fundamental issues: routing optimization, congestion control, and resource management. Finally, we discuss our insights into the challenges and future research perspectives of DRL-based TE.
引用
收藏
页码:2064 / 2097
页数:34
相关论文
共 50 条
  • [41] TITE: A transformer-based deep reinforcement learning approach for traffic engineering in hybrid SDN with dynamic traffic
    Lin, Bin
    Guo, Yingya
    Luo, Huan
    Ding, Mingjie
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2024, 161 : 95 - 105
  • [42] Survey on Machine Learning for Intelligent End-to-End Communication Toward 6G: From Network Access, Routing to Traffic Control and Streaming Adaption
    Tang, Fengxiao
    Mao, Bomin
    Kawamoto, Yuichi
    Kato, Nei
    IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2021, 23 (03): : 1578 - 1598
  • [43] When UAVs Meet Cognitive Radio: Offloading Traffic Under Uncertain Spectrum Environment via Deep Reinforcement Learning
    Li, Xuanheng
    Cheng, Sike
    Ding, Haichuan
    Pan, Miao
    Zhao, Nan
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2023, 22 (02) : 824 - 838
  • [44] Traffic Engineering in Hybrid Software Defined Network via Reinforcement Learning
    Guo, Yingya
    Wang, Weipeng
    Zhang, Han
    Guo, Wenzhong
    Wang, Zhiliang
    Tian, Ying
    Yin, Xia
    Wu, Jianping
    JOURNAL OF NETWORK AND COMPUTER APPLICATIONS, 2021, 189
  • [45] A survey on deep learning and deep reinforcement learning in robotics with a tutorial on deep reinforcement learning
    Morales, Eduardo F.
    Murrieta-Cid, Rafael
    Becerra, Israel
    Esquivel-Basaldua, Marco A.
    INTELLIGENT SERVICE ROBOTICS, 2021, 14 (05) : 773 - 805
  • [46] A survey on deep learning and deep reinforcement learning in robotics with a tutorial on deep reinforcement learning
    Eduardo F. Morales
    Rafael Murrieta-Cid
    Israel Becerra
    Marco A. Esquivel-Basaldua
    Intelligent Service Robotics, 2021, 14 : 773 - 805
  • [47] Deep Reinforcement Learning for Resource Management on Network Slicing: A Survey
    Hurtado Sanchez, Johanna Andrea
    Casilimas, Katherine
    Caicedo Rendon, Oscar Mauricio
    SENSORS, 2022, 22 (08)
  • [48] Deep Reinforcement Learning for QoS provisioning at the MAC layer: A Survey
    Abbasi, Mahmoud
    Shahraki, Amin
    Piran, Md. Jalil
    Taherkordi, Amir
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2021, 102
  • [49] Deep learning and reinforcement learning approach on microgrid
    Chandrasekaran, Kumar
    Kandasamy, Prabaakaran
    Ramanathan, Srividhya
    INTERNATIONAL TRANSACTIONS ON ELECTRICAL ENERGY SYSTEMS, 2020, 30 (10):
  • [50] Fluid Antenna System Liberating Multiuser MIMO for ISAC via Deep Reinforcement Learning
    Wang, Chao
    Li, Guo
    Zhang, Haibin
    Wong, Kai-Kit
    Li, Zan
    Ng, Derrick Wing Kwan
    Chae, Chan-Byoung
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (09) : 10879 - 10894