Energy-Efficient and Accelerated Resource Allocation in O-RAN Slicing Using Deep Reinforcement Learning and Transfer Learning

被引:2
作者
Sherif, Heba [1 ]
Ahmed, Eman [1 ]
Kotb, Amira M. [1 ]
机构
[1] Cairo Univ, Fac Comp & Artificial Intelligence, Cairo, Egypt
关键词
O-RAN; 6G; Radio resource management; Deep reinforcement learning; Transfer learning; NETWORK;
D O I
10.2478/cait-2024-0029
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Next Generation Wireless Networks (NGWNs) have two main components: Network Slicing and Open Radio Access Networks (O-RAN). NS is needed to handle various Quality of Services (QoS). O-RAN adopts an open environment for network vendors and Mobile Network Operators (MNOs). In recent years, Deep Reinforcement Learning (DRL) approaches have been proposed to solve some key issues in NGWNs. The primary obstacles preventing the DRL deployment are being slowly converged and unstable. Additionally, these algorithms have enormous carbon emissions that negatively impact climate change. This paper tackles the dynamic allocation problem of O-RAN radio resources for better QoS, faster convergence, stability, lower energy and power consumption, and reduced carbon emissions. Firstly, we develop an agent with a newly designed latency-based reward function and a top-k filtration mechanism for actions. Then, we propose a policy Transfer Learning approach to accelerate agent convergence. We compared our model to another two models.
引用
收藏
页码:132 / 150
页数:19
相关论文
共 32 条
[1]   Toward Next Generation Open Radio Access Networks: What O-RAN Can and Cannot Do! [J].
Abdalla, Aly S. S. ;
Upadhyaya, Pratheek S. S. ;
Shah, Vijay K. K. ;
Marojevic, Vuk .
IEEE NETWORK, 2022, 36 (06) :206-213
[2]  
Abeta S., 2019, NTT DOCOMO Technical Journal, V21, P38
[3]   A Survey on Open Radio Access Networks: Challenges, Research Directions, and Open Source Approaches [J].
Azariah, Wilfrid ;
Bimo, Fransiscus Asisi ;
Lin, Chih-Wei ;
Cheng, Ray-Guang ;
Nikaein, Navid ;
Jana, Rittwik .
SENSORS, 2024, 24 (03)
[4]  
Bonati L., 2022, P 27 EUR WIR C GERM, P1
[5]   Deep Learning for B5G Open Radio Access Network: Evolution, Survey, Case Studies, and Challenges [J].
Brik, Bouziane ;
Boutiba, Karim ;
Ksentini, Adlen .
IEEE OPEN JOURNAL OF THE COMMUNICATIONS SOCIETY, 2022, 3 :228-250
[6]  
Brockman G, 2016, Arxiv, DOI arXiv:1606.01540
[7]   Single and Multi-Agent Deep Reinforcement Learning for AI-Enabled Wireless Networks: A Tutorial [J].
Feriani, Amal ;
Hossain, Ekram .
IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2021, 23 (02) :1226-1252
[8]   5G Evolution: A View on 5G Cellular Technology Beyond 3GPP Release 15 [J].
Ghosh, Amitabha ;
Maeder, Andreas ;
Baker, Matthew ;
Chandramouli, Devaki .
IEEE ACCESS, 2019, 7 :127639-127651
[9]  
Goyal-Kamal, 2021, Zenodo, DOI 10.5281/ZENODO.4699491
[10]   Recent Advances in Machine Learning for Network Automation in the O-RAN [J].
Hamdan, Mutasem Q. ;
Lee, Haeyoung ;
Triantafyllopoulou, Dionysia ;
Borralho, Ruben ;
Kose, Abdulkadir ;
Amiri, Esmaeil ;
Mulvey, David ;
Yu, Wenjuan ;
Zitouni, Rafik ;
Pozza, Riccardo ;
Hunt, Bernie ;
Bagheri, Hamidreza ;
Foh, Chuan Heng ;
Heliot, Fabien ;
Chen, Gaojie ;
Xiao, Pei ;
Wang, Ning ;
Tafazolli, Rahim .
SENSORS, 2023, 23 (21)