2024 IEEE 5TH ANNUAL WORLD AI IOT CONGRESS, AIIOT 2024
|
2024年
基金:
美国国家科学基金会;
关键词:
Artificial Intelligence;
Reinforcement Learning;
Role Delegation;
Software Defined Network;
D O I:
10.1109/AIIoT61789.2024.10578954
中图分类号:
TP18 [人工智能理论];
学科分类号:
081104 ;
0812 ;
0835 ;
1405 ;
摘要:
In this paper, we introduce a novel method for autonomously assigning routing traffic roles in Software Defined Networks (SDN) using reinforcement learning. Our approach centers around a cloud-hosted central SDN controller interacting with two sub-SDN controllers situated in edge data centers. Each sub-controller manages three layer 2 switches and one wireless access point, connecting to five wired or wireless hosts generating randomized traffic. By collecting network data from hostto-host communications across diverse applications, we train a reinforcement learning agent to facilitate adaptive routing role delegation. The agent is tailored to identify optimal links between the main controller and subcontrollers, minimizing traffic congestion and ensuring ultra-low latency and high reliability during traffic routing. Our research aims to achieve dynamic and adaptive optimal routing, accommodating fluctuating traffic patterns and new device additions to the network. Leveraging PyTorch, we implement a neural network for the agent and employ a Q-learning algorithm for training, optimizing a reward function based on observed traffic congestion. Once trained, the agent autonomously delegates routing traffic roles to the least congested sub-controller. Performance evaluation involves analyzing traffic load and latency metrics, demonstrating the agent's proficiency in identifying optimal links and enhancing network performance, as observed through extensive experimentation and evaluation across diverse SDN scenarios. Furthermore, to foster collaboration and reproducibility within the research community, we make our implementation code and dataset publicly available on GitHub at https://github.com/your_username/project_name.