Federated Meta-Learning for Traffic Steering in O-RAN

被引:6
作者
Erdol, Hakan [1 ]
Wang, Xiaoyang [1 ]
Li, Peizheng [1 ]
Thomas, Jonathan D. [1 ]
Piechocki, Robert [1 ]
Oikonomou, George [1 ]
Inacio, Rui [2 ]
Ahmad, Abdelrahim [2 ]
Briggs, Keith [3 ]
Kapoor, Shipra [3 ]
机构
[1] Univ Bristol, Bristol, Avon, England
[2] Vilicom UK Ltd, Reading, Berks, England
[3] Appl Res BT, Martlesham, Suffolk, England
来源
2022 IEEE 96TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2022-FALL) | 2022年
基金
“创新英国”项目;
关键词
Federated Meta Learning; Reinforcement learning; Traffic steering; 5G; O-RAN; Resource management;
D O I
10.1109/VTC2022-Fall57202.2022.10012789
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The vision of 5G lies in providing high data rates, low latency (for the aim of near-real-time applications), significantly increased base station capacity, and near-perfect quality of service (QoS) for users, compared to LTE networks. In order to provide such services, 5G systems will support various combinations of access technologies such as LTE, NR, NR-U and Wi-Fi. Each radio access technology (RAT) provides different types of access, and these should be allocated and managed optimally among the users. Besides resource management, 5G systems will also support a dual connectivity service. The orchestration of the network therefore becomes a more difficult problem for system managers with respect to legacy access technologies. In this paper, we propose an algorithm for RAT allocation based on federated meta-learning (FML), which enables RAN intelligent controllers (RICs) to adapt more quickly to dynamically changing environments. We have designed a simulation environment which contains LTE and 5G NR service technologies. In the simulation, our objective is to fulfil UE demands within the deadline of transmission to provide higher QoS values. We compared our proposed algorithm with a single RL agent, the Reptile algorithm and a rule-based heuristic method. Simulation results show that the proposed FML method achieves higher caching rates at first deployment round 21% and 12% respectively. Moreover, proposed approach adapts to new tasks and environments most quickly amongst the compared methods.
引用
收藏
页数:7
相关论文
共 15 条
[1]   Reinforcement Learning Algorithm for Traffic Steering in Heterogeneous Network [J].
Adamczyk, Cezary ;
Kliks, Adrian .
2021 17TH INTERNATIONAL CONFERENCE ON WIRELESS AND MOBILE COMPUTING, NETWORKING AND COMMUNICATIONS (WIMOB 2021), 2021, :86-89
[2]  
[Anonymous], 2004, Routing, Flow, and Capacity Design in Communication and Computer Networks
[3]  
Bennis M., 2010, 2010 IEEE Globecom Workshops (GC'10), P706, DOI 10.1109/GLOCOMW.2010.5700414
[4]   A Survey on Beyond 5G Network With the Advent of 6G: Architecture and Emerging Technologies [J].
Dogra, Anutusha ;
Jha, Rakesh Kumar ;
Jain, Shubha .
IEEE ACCESS, 2021, 9 (09) :67512-67547
[5]   Toward Modular and Flexible Open RAN Implementations in 6G Networks: Traffic Steering Use Case and O-RAN xApps [J].
Dryjanski, Marcin ;
Kulacz, Lukasz ;
Kliks, Adrian .
SENSORS, 2021, 21 (24)
[6]  
Finn C, 2017, PR MACH LEARN RES, V70
[7]  
Itahara S., 2021, IEEE T MOBILE COMPUT, P1
[8]  
Konecny J, 2016, NIPS WORKSHOP PRIVAT
[9]   A Collaborative Learning Framework via Federated Meta-Learning [J].
Lin, Sen ;
Yang, Guang ;
Zhang, Junshan .
2020 IEEE 40TH INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS (ICDCS), 2020, :289-299
[10]   Lifelong Federated Reinforcement Learning: A Learning Architecture for Navigation in Cloud Robotic Systems [J].
Liu, Boyi ;
Wang, Lujia ;
Liu, Ming .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2019, 4 (04) :4555-4562