RL-NSB: Reinforcement Learning-Based 5G Network Slice Broker

被引:93
作者
Sciancalepore, Vincenzo [1 ]
Costa-Perez, Xavier [1 ]
Banchs, Albert [2 ,3 ]
机构
[1] NEC Labs Europe GmbH, D-69115 Heidelberg, Germany
[2] IMDEA Networks Inst, Madrid 28918, Spain
[3] Univ Carlos III Madrid, Madrid 28903, Spain
关键词
5G; wireless networks; forecasting; reinforcement learning; virtualization; network slicing;
D O I
10.1109/TNET.2019.2924471
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Network slicing is considered one of the main pillars of the upcoming 5G networks. Indeed, the ability to slice a mobile network and tailor each slice to the needs of the corresponding tenant is envisioned as a key enabler for the design of future networks. However, this novel paradigm opens up to new challenges, such as isolation between network slices, the allocation of resources across them, and the admission of resource requests by network slice tenants. In this paper, we address this problem by designing the following building blocks for supporting network slicing: i) traffic and user mobility analysis, ii) a learning and forecasting scheme per slice, iii) optimal admission control decisions based on spatial and traffic information, and iv) a reinforcement process to drive the system towards optimal states. In our framework, namely RL-NSB, infrastructure providers perform admission control considering the service level agreements (SLA) of the different tenants as well as their traffic usage and user distribution, and enhance the overall process by the means of learning and the reinforcement techniques that consider heterogeneous mobility and traffic models among diverse slices. Our results show that by relying on appropriately tuned forecasting schemes, our approach provides very substantial potential gains in terms of system utilization while meeting the tenants' SLAs.
引用
收藏
页码:1543 / 1557
页数:15
相关论文
共 50 条
[31]   Virtual Network Function Migration Algorithm Based on Reinforcement Learning for 5G Network Slicing [J].
Tang L. ;
Zhou Y. ;
Tan Q. ;
Wei Y. ;
Chen Q. .
Dianzi Yu Xinxi Xuebao/Journal of Electronics and Information Technology, 2020, 42 (03) :669-677
[32]   Virtual Network Function Migration Algorithm Based on Reinforcement Learning for 5G Network Slicing [J].
Tang Lun ;
Zhou Yu ;
Tan Qi ;
Wei Yannan ;
Chen Qianbin .
JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2020, 42 (03) :669-677
[33]   Reinforcement Learning Based 5G Enabled Cognitive Radio Networks [J].
Puspita, Ratih Hikmah ;
Shah, Syed Danial Ali ;
Lee, Gyu-min ;
Roh, Byeong-hee ;
Oh, Jimyeong ;
Kang, Sungjin .
2019 10TH INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGY CONVERGENCE (ICTC): ICT CONVERGENCE LEADING THE AUTONOMOUS FUTURE, 2019, :555-558
[34]   Intimacy-based Resource Allocation for Network Slicing in 5G via Deep Reinforcement Learning [J].
He, Nan ;
Yang, Song ;
Li, Fan ;
Chen, Xu .
IEEE NETWORK, 2021, 35 (06) :111-118
[35]   A Reinforcement Learning Based Approach for 5G Network Slicing Across Multiple Domains [J].
Kibalya, Godfrey ;
Serrat, Joan ;
Gorricho, Juan-Luis ;
Pasquini, Rafael ;
Yao, Haipeng ;
Zhang, Peiying .
2019 15TH INTERNATIONAL CONFERENCE ON NETWORK AND SERVICE MANAGEMENT (CNSM), 2019,
[36]   Machine Learning-based Secure 5G Network Slicing: A Systematic Literature Review [J].
Alanazi, Meshari Huwaytim .
INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2023, 14 (12) :377-393
[37]   Reinforcement Learning for Dynamic Resource Optimization in 5G Radio Access Network Slicing [J].
Shi, Yi ;
Sagduyu, Yalin E. ;
Erpek, Tugba .
2020 IEEE 25TH INTERNATIONAL WORKSHOP ON COMPUTER AIDED MODELING AND DESIGN OF COMMUNICATION LINKS AND NETWORKS (CAMAD), 2020,
[38]   Dynamic Network Slice Scaling Assisted by Attention-Based Prediction in 5G Core Network [J].
Chien-Nguyen Nhu ;
Park, Minho .
IEEE ACCESS, 2022, 10 :72955-72972
[39]   Uplink Power Control Framework Based on Reinforcement Learning for 5G Networks [J].
Costa Neto, Francisco Hugo ;
Araujo, Daniel Costa ;
Mota, Mateus Pontes ;
Maciel, Tarcisio F. ;
de Almeida, Andr L. F. .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2021, 70 (06) :5734-5748
[40]   Reinforcement Learning-Based Optimization for Drone Mobility in 5G and Beyond Ultra-Dense Networks [J].
Tanveer, Jawad ;
Haider, Amir ;
Ali, Rashid ;
Kim, Ajung .
CMC-COMPUTERS MATERIALS & CONTINUA, 2021, 68 (03) :3807-3823