RL-NSB: Reinforcement Learning-Based 5G Network Slice Broker

被引:93
作者
Sciancalepore, Vincenzo [1 ]
Costa-Perez, Xavier [1 ]
Banchs, Albert [2 ,3 ]
机构
[1] NEC Labs Europe GmbH, D-69115 Heidelberg, Germany
[2] IMDEA Networks Inst, Madrid 28918, Spain
[3] Univ Carlos III Madrid, Madrid 28903, Spain
关键词
5G; wireless networks; forecasting; reinforcement learning; virtualization; network slicing;
D O I
10.1109/TNET.2019.2924471
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Network slicing is considered one of the main pillars of the upcoming 5G networks. Indeed, the ability to slice a mobile network and tailor each slice to the needs of the corresponding tenant is envisioned as a key enabler for the design of future networks. However, this novel paradigm opens up to new challenges, such as isolation between network slices, the allocation of resources across them, and the admission of resource requests by network slice tenants. In this paper, we address this problem by designing the following building blocks for supporting network slicing: i) traffic and user mobility analysis, ii) a learning and forecasting scheme per slice, iii) optimal admission control decisions based on spatial and traffic information, and iv) a reinforcement process to drive the system towards optimal states. In our framework, namely RL-NSB, infrastructure providers perform admission control considering the service level agreements (SLA) of the different tenants as well as their traffic usage and user distribution, and enhance the overall process by the means of learning and the reinforcement techniques that consider heterogeneous mobility and traffic models among diverse slices. Our results show that by relying on appropriately tuned forecasting schemes, our approach provides very substantial potential gains in terms of system utilization while meeting the tenants' SLAs.
引用
收藏
页码:1543 / 1557
页数:15
相关论文
共 50 条
[21]   Intelligent Resource Allocation via Hybrid Reinforcement Learning in 5G Network Slicing [J].
Zakariya Saleh, Zahraa ;
Abbod, Maysam F. ;
Nilavalan, Rajagopal .
IEEE ACCESS, 2025, 13 :47440-47458
[22]   Reinforcement Learning-based Computation Resource Allocation Scheme for 5G Fog-Radio Access Network [J].
Khumalo, Nosipho ;
Oyerinde, Olutayo ;
Mfupe, Luzango .
2020 FIFTH INTERNATIONAL CONFERENCE ON FOG AND MOBILE EDGE COMPUTING (FMEC), 2020, :353-355
[23]   Deep Reinforcement Learning-Based Moving Target Defense Approach to Secure Network Slicing in 5G and Beyond [J].
Lallouche, Roumaissa ;
Ahoua, Ahmed ;
Boualouache, Abdelwahab ;
Messai, Mohamed-Lamine .
2024 20TH INTERNATIONAL CONFERENCE ON WIRELESS AND MOBILE COMPUTING, NETWORKING AND COMMUNICATIONS, WIMOB, 2024,
[24]   5G Network Slice Isolation [J].
Wong, Stan ;
Han, Bin ;
Schotten, Hans D. .
NETWORK, 2022, 2 (01) :153-167
[25]   Reinforcement Learning-based Multi-domain Network Slice Provisioning [J].
Wu, Zhouxiang ;
Ishigaki, Genya ;
Gour, Riti ;
Li, Congzhou ;
Mi, Feng ;
Talluri, Subhash ;
Jue, Jason P. .
ICC 2023-IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, 2023, :1899-1904
[26]   Towards 5G: A Reinforcement Learning-Based Scheduling Solution for Data Traffic Management [J].
Comsa, Ioan-Sorin ;
Zhang, Sijing ;
Aydin, Mehmet Emin ;
Kuonen, Pierre ;
Lu, Yao ;
Trestian, Ramona ;
Ghinea, Gheorghita .
IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2018, 15 (04) :1661-1675
[27]   A Deep Reinforcement Learning-Based Power Control Scheme for the 5G Wireless Systems [J].
Liang, Renjie ;
Lyu, Haiyang ;
Fan, Jiancun .
CHINA COMMUNICATIONS, 2023, 20 (10) :109-119
[28]   Slice admission control in 5G cloud radio access network using deep reinforcement learning: A survey [J].
Khani, Mohsen ;
Jamali, Shahram ;
Sohrabi, Mohammad Karim ;
Sadr, Mohammad Mohsen ;
Ghaffari, Ali .
INTERNATIONAL JOURNAL OF COMMUNICATION SYSTEMS, 2024, 37 (13)
[29]   An online cost minimization of the slice broker based on deep reinforcement learning [J].
Gohar, Ali ;
Nencioni, Gianfranco .
COMPUTER NETWORKS, 2024, 241
[30]   Blockchain-Enabled Resource Trading and Deep Reinforcement Learning-Based Autonomous RAN Slicing in 5G [J].
Boateng, Gordon Owusu ;
Ayepah-Mensah, Daniel ;
Doe, Daniel Mawunyo ;
Mohammed, Abegaz ;
Sun, Guolin ;
Liu, Guisong .
IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2022, 19 (01) :216-227