Energy-Efficient and Accelerated Resource Allocation in O-RAN Slicing Using Deep Reinforcement Learning and Transfer Learning

被引:2
作者
Sherif, Heba [1 ]
Ahmed, Eman [1 ]
Kotb, Amira M. [1 ]
机构
[1] Cairo Univ, Fac Comp & Artificial Intelligence, Cairo, Egypt
关键词
O-RAN; 6G; Radio resource management; Deep reinforcement learning; Transfer learning; NETWORK;
D O I
10.2478/cait-2024-0029
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Next Generation Wireless Networks (NGWNs) have two main components: Network Slicing and Open Radio Access Networks (O-RAN). NS is needed to handle various Quality of Services (QoS). O-RAN adopts an open environment for network vendors and Mobile Network Operators (MNOs). In recent years, Deep Reinforcement Learning (DRL) approaches have been proposed to solve some key issues in NGWNs. The primary obstacles preventing the DRL deployment are being slowly converged and unstable. Additionally, these algorithms have enormous carbon emissions that negatively impact climate change. This paper tackles the dynamic allocation problem of O-RAN radio resources for better QoS, faster convergence, stability, lower energy and power consumption, and reduced carbon emissions. Firstly, we develop an agent with a newly designed latency-based reward function and a top-k filtration mechanism for actions. Then, we propose a policy Transfer Learning approach to accelerate agent convergence. We compared our model to another two models.
引用
收藏
页码:132 / 150
页数:19
相关论文
共 32 条
[31]   Transfer Learning in Deep Reinforcement Learning: A Survey [J].
Zhu, Zhuangdi ;
Lin, Kaixiang ;
Jain, Anil K. ;
Zhou, Jiayu .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (11) :13344-13362
[32]   6G TECHNOLOGIES Key Drivers, Core Requirements, System Architectures, and Enabling Technologies [J].
Zong, Baiqing ;
Fan, Chen ;
Wang, Xiyu ;
Duan, Xiangyang ;
Wang, Baojie ;
Wang, Jianwei .
IEEE VEHICULAR TECHNOLOGY MAGAZINE, 2019, 14 (03) :18-27