Reinforcement Learning-Driven Adaptive Traffic Routing Role Delegation for Enhanced SDN Network Performance

被引:0
|
作者
Kumar, Harsh [1 ]
Tshakwanda, Petro M. [1 ]
Arzo, Sisay T. [1 ]
Devetsikiotis, Michael [1 ]
Granelli, Fabrizio [2 ]
机构
[1] Univ New Mexico, Dept Elect & Comp Engn, Albuquerque, NM 87131 USA
[2] Univ Trento, Dept Informat Engn & Comp Sci, Trento, Italy
来源
2024 IEEE 5TH ANNUAL WORLD AI IOT CONGRESS, AIIOT 2024 | 2024年
基金
美国国家科学基金会;
关键词
Artificial Intelligence; Reinforcement Learning; Role Delegation; Software Defined Network;
D O I
10.1109/AIIoT61789.2024.10578954
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we introduce a novel method for autonomously assigning routing traffic roles in Software Defined Networks (SDN) using reinforcement learning. Our approach centers around a cloud-hosted central SDN controller interacting with two sub-SDN controllers situated in edge data centers. Each sub-controller manages three layer 2 switches and one wireless access point, connecting to five wired or wireless hosts generating randomized traffic. By collecting network data from hostto-host communications across diverse applications, we train a reinforcement learning agent to facilitate adaptive routing role delegation. The agent is tailored to identify optimal links between the main controller and subcontrollers, minimizing traffic congestion and ensuring ultra-low latency and high reliability during traffic routing. Our research aims to achieve dynamic and adaptive optimal routing, accommodating fluctuating traffic patterns and new device additions to the network. Leveraging PyTorch, we implement a neural network for the agent and employ a Q-learning algorithm for training, optimizing a reward function based on observed traffic congestion. Once trained, the agent autonomously delegates routing traffic roles to the least congested sub-controller. Performance evaluation involves analyzing traffic load and latency metrics, demonstrating the agent's proficiency in identifying optimal links and enhancing network performance, as observed through extensive experimentation and evaluation across diverse SDN scenarios. Furthermore, to foster collaboration and reproducibility within the research community, we make our implementation code and dataset publicly available on GitHub at https://github.com/your_username/project_name.
引用
收藏
页码:0038 / 0044
页数:7
相关论文
共 23 条
  • [1] Reinforcement Learning-driven Attack on Road Traffic Signal Controllers
    Arabi, Najmeh Seifollahpour
    Halabi, Talal
    Zulkernine, Mohammad
    PROCEEDINGS OF THE 2021 IEEE INTERNATIONAL CONFERENCE ON CYBER SECURITY AND RESILIENCE (IEEE CSR), 2021, : 218 - 225
  • [2] Intelligent routing method based on Dueling DQN reinforcement learning and network traffic state prediction in SDN
    Huang, Linqiang
    Ye, Miao
    Xue, Xingsi
    Wang, Yong
    Qiu, Hongbing
    Deng, Xiaofang
    WIRELESS NETWORKS, 2024, 30 (05) : 4507 - 4525
  • [3] RayNet: A Simulation Platform for Developing Reinforcement Learning-Driven Network Protocols
    Giacomoni, Luca
    Benny, Basil
    Parisis, George
    ACM TRANSACTIONS ON MODELING AND COMPUTER SIMULATION, 2024, 34 (03):
  • [4] Reinforcement Learning based Interconnection Routing for Adaptive Traffic Optimization
    Kao, Sheng-Chun
    Yang, Chao-Han Huck
    Chen, Pin-Yu
    Ma, Xiaoli
    Krishna, Tushar
    PROCEEDINGS OF THE 13TH IEEE/ACM INTERNATIONAL SYMPOSIUM ON NETWORKS-ON-CHIP (NOCS'19), 2019,
  • [5] Performance Testing Using a Smart Reinforcement Learning-Driven Test Agent
    Moghadam, Mahshid Helali
    Hamidi, Golrokh
    Borg, Markus
    Saadatmand, Mehrdad
    Bohlin, Markus
    Lisper, Bjorn
    Potena, Pasqualina
    2021 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC 2021), 2021, : 2385 - 2394
  • [6] REMEDI: REinforcement learning-driven adaptive MEtabolism modeling of primary sclerosing cholangitis DIsease progression
    Hu, Chang
    Saboo, Krishnakant V.
    Ali, Ahmad H.
    Juran, Brian D.
    Lazaridis, Konstantinos N.
    Iyer, Ravishankar K.
    MACHINE LEARNING FOR HEALTH, ML4H, VOL 225, 2023, 225 : 157 - 189
  • [7] RELAR: A Reinforcement Learning Framework for Adaptive Routing in Network-on-Chips
    Wang, Changhong
    Dong, Dezun
    Wang, Zicong
    Zhang, Xiaoyun
    Zhao, Zhenyu
    2021 IEEE INTERNATIONAL CONFERENCE ON CLUSTER COMPUTING (CLUSTER 2021), 2021, : 813 - 814
  • [8] A Deep Reinforcement Learning Approach for Adaptive Traffic Routing in Next-gen Networks
    Abrol, Akshita
    Mohan, Purnima Murali
    Truong-Huu, Tram
    ICC 2024 - IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, 2024, : 465 - 471
  • [9] Adaptive and Robust Network Routing Based on Deep Reinforcement Learning with Lyapunov Optimization
    Zhuang, Zirui
    Wang, Jingyu
    Qi, Qi
    Liao, Jianxin
    Han, Zhu
    2020 IEEE/ACM 28TH INTERNATIONAL SYMPOSIUM ON QUALITY OF SERVICE (IWQOS), 2020,
  • [10] Multipath Routing for Traffic Engineering with Hypergraph Attention Enhanced Multi-Agent Reinforcement Learning
    Cai, Xuhong
    Chen, Yi
    2022 31ST WIRELESS AND OPTICAL COMMUNICATIONS CONFERENCE (WOCC), 2022, : 103 - 108