Actor Critic Based Reinforcement Learning for Joint Resource Allocation and Throughput Maximization in 5G RAN Slicing

被引:1
作者
Kulkarni, Dhanashree [1 ]
Venkatesan, Mithra [1 ]
Kulkarni, Anju V. [2 ]
机构
[1] Dr DY Patil Inst Technol, Elect & Telecommun, Pune, India
[2] Dayananda Sagar Coll Engn, Elect & Telecommun, Bangalore, India
关键词
Network slicing; Deep actor critic reinforcement learning-network slicing; Resource allocation; FRAMEWORK;
D O I
10.1007/s11277-024-11526-0
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
With the advent of fifth generation (5G) mobile communication network slicing technology, the range of application scenarios is expanding significantly. For 5G to function well, it necessitates little delay, a fast rate of data transfer, and the ability to handle a large number of connections. This demanding service requires the allocation of resources in a dynamic manner, while maintaining a very high level of reliability in terms of Quality of Service (QoS).The applications like autonomous driving, telesurgery, etc. have stringent QoS demands and the present design of slices is not suitable for these services. Therefore, latency has been regarded as a crucial factor in the design of the slices. Conventional optimization algorithms often lack robustness and adaptability to dynamic environments, getting stuck in local optima and failing to generalize to varying conditions. Our solution utilizes Reinforcement Learning (RL) to allocate resources to the slices. The utilization of restricted resources can be optimized through the reconfiguration of slices. The ability of RL to acquire knowledge from the surroundings enables our solution to adjust to varying network conditions, enhance the allocation of resources and improve quality of service over a period of time for different network slices. This study introduces the Deep Actor Critic Reinforcement Learning- Network Slicing (DACRL-NS) technique, which utilizes Deep Actor Critic Reinforcement learning for efficient resource allocation to network slices. The objective is to achieve optimal throughput in the network. If the slices fail to meet the minimum criteria, they will be omitted from the allocation. With increasing training episodes, our Actor-Critic algorithm enhances average cumulative rewards and resource allocation efficiency, demonstrating continuous learning and improved decision-making.The simulated suggested system demonstrates an average throughput improvement of 8.92% and 16.36% with respect to the rate requirement and latency requirement, respectively. The data also demonstrate a 17.14% increase in the overall network throughput.
引用
收藏
页码:623 / 640
页数:18
相关论文
共 28 条
[1]  
3GPPA, 2020, NG RAN ARCHITECTURE
[2]   Flexible Resource Block Allocation to Multiple Slices for Radio Access Network Slicing Using Deep Reinforcement Learning [J].
Abiko, Yu ;
Saito, Takato ;
Ikeda, Daizo ;
Ohta, Ken ;
Mizuno, Tadanori ;
Mineno, Hiroshi .
IEEE ACCESS, 2020, 8 :68183-68198
[3]  
al-Bataineh A, 2021, INT J BILING EDUC BI, V24, P386, DOI [10.1155/2018/4305395, 10.1080/13670050.2018.1471039]
[4]   Intelligent Resource Slicing for eMBB and URLLC Coexistence in 5G and Beyond: A Deep Reinforcement Learning Based Approach [J].
Alsenwi, Madyan ;
Tran, Nguyen H. ;
Bennis, Mehdi ;
Pandey, Shashi Raj ;
Bairagi, Anupam Kumar ;
Hong, Choong Seon .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (07) :4585-4600
[5]   Consortium Blockchain-Based Spectrum Trading for Network Slicing in 5G RAN: A Multi-Agent Deep Reinforcement Learning Approach [J].
Boateng, Gordon Owusu ;
Sun, Guolin ;
Mensah, Daniel Ayepah ;
Doe, Daniel Mawunyo ;
Ou, Ruijie ;
Liu, Guisong .
IEEE TRANSACTIONS ON MOBILE COMPUTING, 2023, 22 (10) :5801-5815
[6]   Challenges of real-world reinforcement learning: definitions, benchmarks and analysis [J].
Dulac-Arnold, Gabriel ;
Levine, Nir ;
Mankowitz, Daniel J. ;
Li, Jerry ;
Paduraru, Cosmin ;
Gowal, Sven ;
Hester, Todd .
MACHINE LEARNING, 2021, 110 (09) :2419-2468
[7]  
Filali A., 2022, ARXIV
[8]   Dynamic SDN-Based Radio Access Network Slicing With Deep Reinforcement Learning for URLLC and eMBB Services [J].
Filali, Abderrahime ;
Mlika, Zoubeir ;
Cherkaoui, Soumaya ;
Kobbane, Abdellatif .
IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2022, 9 (04) :2174-2187
[9]   Security Threats, Requirements and Recommendations on Creating 5G Network Slicing System: A Survey [J].
Gao, Shujuan ;
Lin, Ruyan ;
Fu, Yulong ;
Li, Hui ;
Cao, Jin .
ELECTRONICS, 2024, 13 (10)
[10]  
Ghosh A, 2019, IEEE ACCESS, V15