RL-NSB: Reinforcement Learning-Based 5G Network Slice Broker

被引:93
作者
Sciancalepore, Vincenzo [1 ]
Costa-Perez, Xavier [1 ]
Banchs, Albert [2 ,3 ]
机构
[1] NEC Labs Europe GmbH, D-69115 Heidelberg, Germany
[2] IMDEA Networks Inst, Madrid 28918, Spain
[3] Univ Carlos III Madrid, Madrid 28903, Spain
关键词
5G; wireless networks; forecasting; reinforcement learning; virtualization; network slicing;
D O I
10.1109/TNET.2019.2924471
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Network slicing is considered one of the main pillars of the upcoming 5G networks. Indeed, the ability to slice a mobile network and tailor each slice to the needs of the corresponding tenant is envisioned as a key enabler for the design of future networks. However, this novel paradigm opens up to new challenges, such as isolation between network slices, the allocation of resources across them, and the admission of resource requests by network slice tenants. In this paper, we address this problem by designing the following building blocks for supporting network slicing: i) traffic and user mobility analysis, ii) a learning and forecasting scheme per slice, iii) optimal admission control decisions based on spatial and traffic information, and iv) a reinforcement process to drive the system towards optimal states. In our framework, namely RL-NSB, infrastructure providers perform admission control considering the service level agreements (SLA) of the different tenants as well as their traffic usage and user distribution, and enhance the overall process by the means of learning and the reinforcement techniques that consider heterogeneous mobility and traffic models among diverse slices. Our results show that by relying on appropriately tuned forecasting schemes, our approach provides very substantial potential gains in terms of system utilization while meeting the tenants' SLAs.
引用
收藏
页码:1543 / 1557
页数:15
相关论文
共 50 条
[41]   Attacks Detection Approach Based on a Reinforcement Learning Process to Secure 5G Wireless Network [J].
Sedjelmaci, Hichem .
2020 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS WORKSHOPS (ICC WORKSHOPS), 2020,
[42]   Reinforcement Learning Based Resource Allocation for Network Slicing in 5G C-RAN [J].
Wang, Xiaofei ;
Zhang, Tiankui .
2019 COMPUTING, COMMUNICATIONS AND IOT APPLICATIONS (COMCOMAP), 2019, :106-111
[43]   Monitoring as a Service over a 5G Network Slice [J].
Giannopoulos, Dimitris ;
Papaioannou, Panagiotis ;
Tranoris, Christos ;
Denazis, Spyros .
2021 JOINT EUROPEAN CONFERENCE ON NETWORKS AND COMMUNICATIONS & 6G SUMMIT (EUCNC/6G SUMMIT), 2021, :329-334
[44]   A holistic approach for 5G Network Slice Monitoring [J].
Giannopoulos, Dimitris ;
Papaioannou, Panagiotis ;
Ntzogani, Lydia ;
Tranoris, Christos ;
Denazis, Spyros .
2021 IEEE INTERNATIONAL MEDITERRANEAN CONFERENCE ON COMMUNICATIONS AND NETWORKING (IEEE MEDITCOM 2021), 2021, :240-245
[45]   OACR2: Online Admission Control and Resource Reservation for 5G Slice Networks With Deep Reinforcement Learning [J].
Li, Fang ;
Hao, Yijun ;
Yang, Shusen ;
Zhao, Peng .
IEEE TRANSACTIONS ON MOBILE COMPUTING, 2025, 24 (08) :7360-7376
[46]   5G Network Slice Brokering: A Distributed Blockchain-based Market [J].
Afraz, Nima ;
Ruffini, Marco .
2020 EUROPEAN CONFERENCE ON NETWORKS AND COMMUNICATIONS (EUCNC 2020), 2020, :23-27
[47]   5G Handover using Reinforcement Learning [J].
Yajnanarayana, Vijaya ;
Ryden, Henrik ;
Hevizi, Laszlo .
2020 IEEE 3RD 5G WORLD FORUM (5GWF), 2020, :349-354
[48]   Dynamic Network Slice Scaling Assisted by Prediction in 5G Network [J].
Zhou, Jinhe ;
Zhao, Wenjun ;
Chen, Shuo .
IEEE ACCESS, 2020, 8 :133700-133712
[49]   Kaputa - Blockchain, Non-Fungible Token and Model Card Integrated 5G/6G Network Slice Broker and Marketplace [J].
Bandara, Eranga ;
Shetty, Sachin ;
Mukkamala, Ravi ;
Rahman, Abdul ;
Foytik, Peter ;
Liang, Xueping ;
Keong, Ng Wee .
2022 IEEE MILITARY COMMUNICATIONS CONFERENCE (MILCOM), 2022,
[50]   Physical Resource Management Based on Complex Network Theory in 5G Network Slice Trading [J].
Shen, Yidi ;
Wen, Xiangming ;
Wang, Luhan ;
Guan, Wanqing ;
Lu, Zhaoming .
2019 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2019,