Resource allocation for UAV-assisted 5G mMTC slicing networks using deep reinforcement learning

被引:7
作者
Gupta, Rohit Kumar [1 ]
Kumar, Saubhik [1 ]
Misra, Rajiv [1 ]
机构
[1] Indian Inst Technol Patna, Dept Comp Sci & Engn, Patna 801106, Bihar, India
关键词
5G; Network slicing; UAV; Markov decision process; Reinforcement learning; BASE STATION PLACEMENT; TRAJECTORY DESIGN; POWER ALLOCATION; COMMUNICATION; OPTIMIZATION; EXTENSION; BACKHAUL; IOT;
D O I
10.1007/s11235-022-00974-3
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
The Internet of Things (IoT) application scenarios is becoming extensive due to the quick evolution of smart devices with fifth-generation (5G) network slicing technologies. Hence, IoTs are becoming significantly important in 5G/6G networks. However, communication with IoT devices is more sensitive in disasters because the network depends on the main power supply and devices are fragile. In this paper, we consider Unmanned Aerial Vehicles (UAV) as a flying base station (BS) for the emergency communication system with 5G mMTC Network Slicing to improve the quality of user experience. The UAV-assisted mMTC creates a base station selection method to maximize the system energy efficiency. Then, the system model is reduced to the stochastic optimization-based problem using Markov Decision Process (MDP) theory. We propose a reinforcement learning-based dueling-deep-Q-networks (DDQN) technique to maximise energy efficiency and resource allocation. We compare the proposed model with DQN and Q-Learning models and found that the proposed DDQN-based model performs better for resource allocation in terms of low transmission power and maximum energy efficiency.
引用
收藏
页码:141 / 159
页数:19
相关论文
共 48 条
[1]   Optimal LAP Altitude for Maximum Coverage [J].
Al-Hourani, Akram ;
Kandeepan, Sithamparanathan ;
Lardner, Simon .
IEEE WIRELESS COMMUNICATIONS LETTERS, 2014, 3 (06) :569-572
[2]   UAV Placement and Power Allocation in Uplink and Downlink Operations of Cellular Network [J].
Ali, Muntadher A. ;
Jamalipour, Abbas .
IEEE TRANSACTIONS ON COMMUNICATIONS, 2020, 68 (07) :4383-4393
[3]   Open, Programmable, and Virtualized 5G Networks: State-of-the-Art and the Road Ahead [J].
Bonati, Leonardo ;
Polese, Michele ;
D'Oro, Salvatore ;
Basagni, Stefano ;
Melodia, Tommaso .
COMPUTER NETWORKS, 2020, 182
[4]   Dual-UAV-Enabled Secure Communications: Joint Trajectory Design and User Scheduling [J].
Cai, Yunlong ;
Cui, Fangyu ;
Shi, Qingjiang ;
Zhao, Minjian ;
Li, Geoffrey Ye .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2018, 36 (09) :1972-1985
[5]   Vision, Requirements, and Technology Trend of 6G: How to Tackle the Challenges of System Coverage, Capacity, User Data-Rate and Movement Speed [J].
Chen, Shanzhi ;
Liang, Ying-Chang ;
Sun, Shaohui ;
Kang, Shaoli ;
Chen, Wenchi ;
Peng, Mugen .
IEEE WIRELESS COMMUNICATIONS, 2020, 27 (02) :218-228
[6]   Deep Q-Network based resource allocation for UAV-assisted Ultra-Dense Networks [J].
Chen, Xin ;
Liu, Xu ;
Chen, Ying ;
Jiao, Libo ;
Min, Geyong .
COMPUTER NETWORKS, 2021, 196
[7]   TOFFEE: Task Offloading and Frequency Scaling for Energy Efficiency of Mobile Devices in Mobile Edge Computing [J].
Chen, Ying ;
Zhang, Ning ;
Zhang, Yongchao ;
Chen, Xin ;
Wu, Wen ;
Shen, Xuemin .
IEEE TRANSACTIONS ON CLOUD COMPUTING, 2021, 9 (04) :1634-1644
[8]   Design of a 5G Network Slice Extension With MEC UAVs Managed With Reinforcement Learning [J].
Faraci, Giuseppe ;
Grasso, Christian ;
Schembra, Giovanni .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2020, 38 (10) :2356-2371
[9]  
Faraci G, 2019, IEEE CONF COMPUT, P732, DOI [10.1109/infcomw.2019.8845316, 10.1109/INFCOMW.2019.8845316]
[10]   Computation Offloading for Multi-Access Mobile Edge Computing in Ultra-Dense Networks [J].
Guo, Hongzhi ;
Liu, Jiajia ;
Zhang, Jie .
IEEE COMMUNICATIONS MAGAZINE, 2018, 56 (08) :14-19