Slice admission control in 5G wireless communication with multi-dimensional state space and distributed action space: A sequential twin actor-critic approach

被引:0
|
作者
Ojijo, Mourice Otieno [1 ,2 ]
Ramotsoela, Daniel [1 ]
Oginga, Ruth A. [2 ]
机构
[1] Univ Cape Town, Dept Elect Engn, Cape Town, South Africa
[2] Kabarak Univ, Dept Comp Sci & Informat Technol, Nairobi, Kenya
关键词
Slice admission control; Reinforcement learning; Q-learning; Deep reinforcement learning; Actor-critic; RESOURCE-ALLOCATION; REINFORCEMENT; NETWORK;
D O I
10.1016/j.comnet.2024.110878
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Network slicing represents a paradigm shift in the way resources are allocated for different 5G network functions through network function virtualization. This innovation aims to facilitate logical resource allocation, accommodating the anticipated surge in network resource requirements. This will harness automatic processing, scheduling, and orchestration for efficient management. To overcome the challenge of managing network resources under heavy demand, slice providers need to leverage both artificial intelligence and slice admission control strategies. While 5G network resources can be allocated to maintain a slice, the logical allocation and real-time network evaluation must be continuously examined and adjusted if network resilience is to be maintained. The complex task of leveraging slice admission control to maintain 5G network resilience has not been fully investigated. To tackle this problem, we propose a machine learning approach for slice admission control and resource allocation optimization so as to maintain network resilience. Machine learning algorithms offer a powerful tool for making robust and autonomous decisions, which are crucial for effective slice admission control. By intelligently allocating resources based on real-time demand and network conditions, these algorithms can help ensure long-term network resilience and achieve key objectives. While various machine learning algorithms hold promise for 5G resource management and admission control, reinforcement learning (RL) has emerged as a particularly exciting solution. Its ability to mimic human learning processes makes it a versatile solution, well-suited to tackle the complex challenges of network control. To fill this gap, we propose anew technique known as sequential twin actor critic (STAC). Simulations show that the STAC improves network resilience through enhanced admission probability and overall utility.
引用
收藏
页数:15
相关论文
共 3 条
  • [1] Slice Admission and Deployment Strategies in Resource-Constrained 5G Network Slices using an Actor-Critic Approach
    Dayot, Ralph Voltaire J.
    Ra, In-Ho
    2022 JOINT 12TH INTERNATIONAL CONFERENCE ON SOFT COMPUTING AND INTELLIGENT SYSTEMS AND 23RD INTERNATIONAL SYMPOSIUM ON ADVANCED INTELLIGENT SYSTEMS (SCIS&ISIS), 2022,
  • [2] Digital twin-assisted flexible slice admission control for 5G core network: A deep reinforcement learning approach
    Wang, Jiadai
    Li, Jingyi
    Liu, Jiajia
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2024, 153 : 467 - 476
  • [3] Multi Actor-Critic DDPG for Robot Action Space Decomposition: A Framework to Control Large 3D Deformation of Soft Linear Objects
    Daniel, Melodie
    Magassouba, Aly
    Aranda, Miguel
    Lequievre, Laurent
    Corrales Ramon, Juan Antonio
    Iglesias Rodriguez, Roberto
    Mezouar, Youcef
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (02) : 1318 - 1325