DAR-DRL: A dynamic adaptive routing method based on deep reinforcement learning

被引:1
作者
Rao, Zheheng [1 ]
Xu, Yanyan [2 ]
Yao, Ye [1 ]
Meng, Weizhi [3 ]
机构
[1] Hangzhou Dianzi Univ, Sch Cyberspace, Hangzhou 310018, Peoples R China
[2] Wuhan Univ, State Key Lab Informat Engn Surveying Mapping & Re, Wuhan 430072, Peoples R China
[3] Tech Univ Denmark, Dept Appl Math & Comp Sci, DK-2800 Lyngby, Denmark
基金
中国国家自然科学基金;
关键词
Routing; Deep reinforcement learning; Graph neural networks; Dynamic adaptive; WIRELESS NETWORKS;
D O I
10.1016/j.comcom.2024.107983
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Mobile-centric wireless networks offer users a diverse range of services and experiences. However, existing intelligent routing methods often struggle to make suitable routing decisions during dynamic network changes, significantly limiting transmission performance. This paper proposes a dynamic adaptive routing method based on Deep Reinforcement Learning (DAR-DRL) to effectively address these challenges. First, to accurately model network state information in complex and dynamically changing routing tasks, we introduce a link-aware graph learning model (LA-GNN) that efficiently senses network information of varying structures through a hierarchical aggregated message-passing neural network. Second, to ensure routing reliability in dynamic environments, we design a hop-by-hop routing strategy featuring a large acceptance domain and a reliability guarantee reward function. This mechanism adaptively avoids routing holes and loops across various network scenarios while enhancing the robustness of routing under dynamic conditions. Experimental results demonstrate that the proposed DAR-DRL method achieves the network routing task with shorter end-to-end delays, lower packet loss rates, and higher throughput compared to existing mainstream methods across common dynamic network scenarios, including cases with dynamic traffic variations, random link failures (small topology changes), and significant topology alterations.
引用
收藏
页数:15
相关论文
共 43 条
  • [1] A new QoS routing algorithm based on self-organizing maps for wireless sensor networks
    Barbancho, Julio
    Leon, Carlos
    Javier Molina, F.
    Barbancho, Antonio
    [J]. TELECOMMUNICATION SYSTEMS, 2007, 36 (1-3) : 73 - 83
  • [2] Barreto F, 2012, Arxiv, DOI arXiv:1204.2465
  • [3] A deep reinforcement learning approach for solving the Traveling Salesman Problem with Drone
    Bogyrbayeva, Aigerim
    Yoon, Taehyun
    Ko, Hanbum
    Lim, Sungbin
    Yun, Hyokun
    Kwon, Changhyun
    [J]. TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2023, 148
  • [4] Responsive Algorithms for Handling Load Surges and Switching Links On in Green Networks
    Carpa, Radu
    de Assuncao, Marcos Dias
    Gluck, Olivier
    Lefevre, Laurent
    Mignot, Jean-Christophe
    [J]. 2016 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2016,
  • [5] DRSIR: A Deep Reinforcement Learning Approach for Routing in Software-Defined Networking
    Casas-Velasco, Daniela M.
    Rendon, Oscar Mauricio Caicedo
    da Fonseca, Nelson L. S.
    [J]. IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2022, 19 (04): : 4807 - 4820
  • [6] Chakeres ID, 2004, 24TH INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS WORKSHOPS, PROCEEDINGS, P698, DOI 10.1109/icdcsw.2004.1284108
  • [7] DRL-Based Load-Balancing Routing Scheme for 6G Space-Air-Ground Integrated Networks
    Dong, Feihu
    Song, Jiaxin
    Zhang, Yasheng
    Wang, Yuqi
    Huang, Tao
    [J]. REMOTE SENSING, 2023, 15 (11)
  • [8] Spatial Anti-Jamming Scheme for Internet of Satellites Based on the Deep Reinforcement Learning and Stackelberg Game
    Han, Chen
    Huo, Liangyu
    Tong, Xinhai
    Wang, Haichao
    Liu, Xian
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2020, 69 (05) : 5331 - 5342
  • [9] Hester T, 2018, AAAI CONF ARTIF INTE, P3223
  • [10] Jibu T., 1997, OSPF, P1