Leveraging Deep Reinforcement Learning for Traffic Engineering: A Survey

被引:62
|
作者
Xiao, Yang [1 ]
Liu, Jun [1 ]
Wu, Jiawei [1 ]
Ansari, Nirwan [2 ]
机构
[1] Beijing Univ Posts & Telecommun, Intelligent Percept & Comp Res Ctr, Sch Artificial Intelligence, Beijing 100876, Peoples R China
[2] New Jersey Inst Technol, Dept Elect & Comp Engn, Newark, NJ 07102 USA
来源
IEEE COMMUNICATIONS SURVEYS AND TUTORIALS | 2021年 / 23卷 / 04期
关键词
Wireless networks; Routing; Optimization; Reinforcement learning; Tutorials; Supervised learning; Wireless sensor networks; Deep reinforcement learning; traffic engineering; routing optimization; congestion control; resource management; TCP CONGESTION CONTROL; SPECTRUM ASSIGNMENT; RESOURCE-MANAGEMENT; WIRELESS NETWORKS; CELLULAR NETWORK; NEURAL-NETWORKS; EDGE; MULTIPATH; FRAMEWORK; ALGORITHM;
D O I
10.1109/COMST.2021.3102580
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
After decades of unprecedented development, modern networks have evolved far beyond expectations in terms of scale and complexity. In many cases, traditional traffic engineering (TE) approaches fail to address the quality of service (QoS) requirements of modern networks. In recent years, deep reinforcement learning (DRL) has proved to be a feasible and effective solution for autonomously controlling and managing complex systems. Massive growth in the use of DRL applications in various domains is beginning to benefit the communications industry. In this paper, we firstly provide a comprehensive overview of DRL-based TE. Then, we present a detailed literature review on applications of DRL for TE including three fundamental issues: routing optimization, congestion control, and resource management. Finally, we discuss our insights into the challenges and future research perspectives of DRL-based TE.
引用
收藏
页码:2064 / 2097
页数:34
相关论文
共 50 条
  • [31] A survey of deep reinforcement learning application in 5G and beyond network slicing and virtualization
    Ssengonzi, Charles
    Kogeda, Okuthe P.
    Olwal, Thomas O.
    ARRAY, 2022, 14
  • [32] Leveraging UAVs for Coverage in Cell-Free Vehicular Networks: A Deep Reinforcement Learning Approach
    Samir, Moataz
    Ebrahimi, Dariush
    Assi, Chadi
    Sharafeddine, Sanaa
    Ghrayeb, Ali
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2021, 20 (09) : 2835 - 2847
  • [33] EPC-TE: Explicit Path Control in Traffic Engineering with Deep Reinforcement Learning
    Luan, Zeyu
    Lu, Lie
    Li, Qing
    Jiang, Yong
    2021 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2021,
  • [34] Transfer Learning in Deep Reinforcement Learning: A Survey
    Zhu, Zhuangdi
    Lin, Kaixiang
    Jain, Anil K.
    Zhou, Jiayu
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (11) : 13344 - 13362
  • [35] Deep Reinforcement Learning for Network Selection Over Heterogeneous Health Systems
    Chkirbene, Zina
    Abdellatif, Alaa Awad
    Mohamed, Amr
    Erbad, Aiman
    Guizani, Mohsen
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2022, 9 (01): : 258 - 270
  • [36] Deep Reinforcement Learning for Autonomous Internet of Things: Model, Applications and Challenges
    Lei, Lei
    Tan, Yue
    Zheng, Kan
    Liu, Shiwen
    Zhang, Kuan
    Shen, Xuemin
    IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2020, 22 (03): : 1722 - 1760
  • [37] A Survey on Deep Reinforcement Learning for Data Processing and Analytics
    Cai, Qingpeng
    Cui, Can
    Xiong, Yiyuan
    Wang, Wei
    Xie, Zhongle
    Zhang, Meihui
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (05) : 4446 - 4465
  • [38] A Survey of Multi-Task Deep Reinforcement Learning
    Vithayathil Varghese, Nelson
    Mahmoud, Qusay H.
    ELECTRONICS, 2020, 9 (09) : 1 - 21
  • [39] Resource Pricing and Allocation in MEC Enabled Blockchain Systems: An A3C Deep Reinforcement Learning Approach
    Du, Jianbo
    Cheng, Wenjie
    Lu, Guangyue
    Cao, Haotong
    Chu, Xiaoli
    Zhang, Zhicai
    Wang, Junxuan
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2022, 9 (01): : 33 - 44
  • [40] Empowering Traffic Steering in 6G Open RAN With Deep Reinforcement Learning
    Kavehmadavani, Fatemeh
    Nguyen, Van-Dinh
    Vu, Thang X.
    Chatzinotas, Symeon
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (10) : 12782 - 12798