Reinforcement Learning-Driven Adaptive Traffic Routing Role Delegation for Enhanced SDN Network Performance

被引:0
|
作者
Kumar, Harsh [1 ]
Tshakwanda, Petro M. [1 ]
Arzo, Sisay T. [1 ]
Devetsikiotis, Michael [1 ]
Granelli, Fabrizio [2 ]
机构
[1] Univ New Mexico, Dept Elect & Comp Engn, Albuquerque, NM 87131 USA
[2] Univ Trento, Dept Informat Engn & Comp Sci, Trento, Italy
来源
2024 IEEE 5TH ANNUAL WORLD AI IOT CONGRESS, AIIOT 2024 | 2024年
基金
美国国家科学基金会;
关键词
Artificial Intelligence; Reinforcement Learning; Role Delegation; Software Defined Network;
D O I
10.1109/AIIoT61789.2024.10578954
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we introduce a novel method for autonomously assigning routing traffic roles in Software Defined Networks (SDN) using reinforcement learning. Our approach centers around a cloud-hosted central SDN controller interacting with two sub-SDN controllers situated in edge data centers. Each sub-controller manages three layer 2 switches and one wireless access point, connecting to five wired or wireless hosts generating randomized traffic. By collecting network data from hostto-host communications across diverse applications, we train a reinforcement learning agent to facilitate adaptive routing role delegation. The agent is tailored to identify optimal links between the main controller and subcontrollers, minimizing traffic congestion and ensuring ultra-low latency and high reliability during traffic routing. Our research aims to achieve dynamic and adaptive optimal routing, accommodating fluctuating traffic patterns and new device additions to the network. Leveraging PyTorch, we implement a neural network for the agent and employ a Q-learning algorithm for training, optimizing a reward function based on observed traffic congestion. Once trained, the agent autonomously delegates routing traffic roles to the least congested sub-controller. Performance evaluation involves analyzing traffic load and latency metrics, demonstrating the agent's proficiency in identifying optimal links and enhancing network performance, as observed through extensive experimentation and evaluation across diverse SDN scenarios. Furthermore, to foster collaboration and reproducibility within the research community, we make our implementation code and dataset publicly available on GitHub at https://github.com/your_username/project_name.
引用
收藏
页码:0038 / 0044
页数:7
相关论文
共 23 条
  • [21] Joint Traffic Control and Multi-Channel Reassignment for Core Backbone Network in SDN-IoT: A Multi-Agent Deep Reinforcement Learning Approach
    Wu, Tong
    Zhou, Pan
    Wang, Binghui
    Li, Ang
    Tang, Xueming
    Xu, Zichuan
    Chen, Kai
    Ding, Xiaofeng
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2021, 8 (01): : 231 - 245
  • [22] Fault-tolerant adaptive tracking control of Euler-Lagrange systems-An echo state network approach driven by reinforcement learning
    Chen, Qing
    Jin, Yaochu
    Song, Yongduan
    NEUROCOMPUTING, 2022, 484 : 109 - 116
  • [23] Multiagent Reinforcement Learning for Integrated Network of Adaptive Traffic Signal Controllers (MARLIN-ATSC): Methodology and Large-Scale Application on Downtown Toronto
    El-Tantawy, Samah
    Abdulhai, Baher
    Abdelgawad, Hossam
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2013, 14 (03) : 1140 - 1150