Deep Reinforcement Learning-Based Network Slicing for Beyond 5G

被引:47
作者
Suh, Kyungjoo [1 ]
Kim, Sunwoo [1 ]
Ahn, Yongjun [1 ]
Kim, Seungnyun [1 ]
Ju, Hyungyu [1 ]
Shim, Byonghyo [1 ]
机构
[1] Seoul Natl Univ, Dept Elect & Comp Engn, Seoul 08826, South Korea
基金
新加坡国家研究基金会;
关键词
Network slicing; Ultra reliable low latency communication; Quality of service; Resource management; Throughput; 5G mobile communication; Reinforcement learning; resource allocation; deep reinforcement learning; FRAMEWORK;
D O I
10.1109/ACCESS.2022.3141789
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the advent of 5G era, network slicing has received a great deal of attention as a means to support a variety of wireless services in a flexible manner. Network slicing is a technique to divide a single physical resource network into multiple slices supporting independent services. In beyond 5G (B5G) systems, the main goal of network slicing is to assign the physical resource blocks (RBs) such that the quality of service (QoS) requirements of eMBB, URLLC, and mMTC services are satisfied. Since the goal of each service category is dearly distinct and the computational burden caused by the increased number of time slots is huge, it is in general very difficult to assign RB properly. In this paper, we propose a deep reinforcement learning (DRL)-based network slicing technique to find out the resource allocation policy maximizing the long-term throughput while satisfying the QoS requirements in the B5G systems. Key ingredient of the proposed technique is to reduce the action space by eliminating undesirable actions that cannot satisfy the QoS requirements. Numerical results demonstrate that the proposed technique is effective in maximizing the long-term throughput and handling the coexistence of use cases in the B5G environments.
引用
收藏
页码:7384 / 7395
页数:12
相关论文
共 23 条
[1]  
Abadi M, 2016, PROCEEDINGS OF OSDI'16: 12TH USENIX SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION, P265
[2]  
[Anonymous], 2018, Rep. 38.901
[3]  
Bektas C., 2019, P IEEE GLOB WORKSH G, P1
[4]  
Cui YP, 2020, IEEE INT CONF COMMUN, P454, DOI [10.1109/iccc49849.2020.9238991, 10.1109/ICCC49849.2020.9238991]
[5]   Towards Cost Minimization for Wireless Caching Networks With Recommendation and Uncharted Users' Feature Information [J].
Fu, Yaru ;
Yang, Zhong ;
Quek, Tony Q. S. ;
Yang, Howard H. .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (10) :6758-6771
[6]   ULTRA-RELIABLE AND LOW-LATENCY COMMUNICATIONS IN 5G DOWNLINK: PHYSICAL LAYER ASPECTS [J].
Ji, Hyoungju ;
Park, Sunho ;
Yeo, Jeongho ;
Kim, Younsun ;
Lee, Juho ;
Shim, Byonghyo .
IEEE WIRELESS COMMUNICATIONS, 2018, 25 (03) :124-130
[7]  
Ju H., 2020, P IEEE WIR COMM NETW, P1
[8]  
Kim S, 2020, I C INF COMM TECH CO, P1766, DOI 10.1109/ICTC49870.2020.9289280
[9]  
Kingma D. P., 2015, ACS SYM SER
[10]  
Leconte M, 2018, IEEE INFOCOM SER, P2177, DOI 10.1109/INFOCOM.2018.8486303