Priority-aware path planning and user scheduling for UAV-mounted MEC networks: A deep reinforcement learning approach

被引:11
作者
Zheng, Xiangdong [1 ]
Wu, Yuxin [2 ]
Zhang, Lianhong [1 ]
Tang, Maobin [3 ]
Zhu, Fusheng [4 ]
机构
[1] Guangzhou Univ, Sch Comp Sci & Cyber Engn, Guangzhou 510006, Peoples R China
[2] Guangzhou Univ, Guangzhou 510006, Peoples R China
[3] Guangzhou Univ, Sch Comp Sci & Educ Software, Guangzhou 510006, Peoples R China
[4] Guangdong Commun & Networks Inst, Guangzhou, Peoples R China
关键词
UAV; MEC; Task priority; System utility; DRL;
D O I
10.1016/j.phycom.2023.102234
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Owing to the flexibility and controllability, unmanned aerial vehicle (UAV) is frequently integrated into mobile edge computing (MEC) network to improve the system performance. This paper investigates a novel multiuser multi-hotspot MEC network supported by a UAV, where the UAV can help compute the tasks offloaded from end users (EUs) in multiple hotspots. In this network, we consider the task priority and task size are dynamic, due to the EUs' demands. We then propose a task priority-based system utility model to evaluate the network performance, which considers the priorities of tasks based on the urgent or non-urgent level. We further formulate a utility maximization problem that jointly optimizes the UAV's access path and the EUs' offloading strategy, while satisfying the constraints related to the UAV's battery capacity and UAV's duration of flight. Since the formulated problem is a NP-hard problem, we present a deep reinforcement learning (DRL) based scheme as a solution. The DRL scheme utilizes principles from reinforcement learning to address the optimization problem effectively, resulting in a dynamic solution. Simulation results demonstrate that the proposed DRL scheme outperforms alternative benchmark schemes in terms of system utility.
引用
收藏
页数:8
相关论文
共 41 条
[1]   Relay-Assisted Federated Edge Learning: Performance Analysis and System Optimization [J].
Chen, Lunyuan ;
Fan, Lisheng ;
Lei, Xianfu ;
Duong, Trung Q. ;
Nallanathan, Arumugam ;
Karagiannidis, George K. .
IEEE TRANSACTIONS ON COMMUNICATIONS, 2023, 71 (06) :3387-3401
[2]   Online Edge Learning Offloading and Resource Management for UAV-Assisted MEC Secure Communications [J].
Ding, Yu ;
Feng, Yunqi ;
Lu, Weidang ;
Zheng, Shilian ;
Zhao, Nan ;
Meng, Limin ;
Nallanathan, Arumugam ;
Yang, Xiaoniu .
IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2023, 17 (01) :54-65
[3]   Distributed Machine Learning for Multiuser Mobile Edge Computing Systems [J].
Guo, Yinghao ;
Zhao, Rui ;
Lai, Shiwei ;
Fan, Lisheng ;
Lei, Xianfu ;
Karagiannidis, George K. .
IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2022, 16 (03) :460-473
[4]  
Haarnoja T, 2019, Arxiv, DOI [arXiv:1812.05905, DOI 10.48550/ARXIV.1812.05905]
[5]  
He L., 2023, IEEE Trans. Cogn. Commun. Netw, P1
[6]   Learning-Based MIMO Detection With Dynamic Spatial Modulation [J].
He, Le ;
Fan, Lisheng ;
Lei, Xianfu ;
Tang, Xiaohu ;
Fan, Pingzhi ;
Nallanathan, Arumugam .
IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2023, 9 (06) :1489-1502
[7]   Deep Regularized Waveform Learning for Beam Prediction With Limited Samples in Non-Cooperative mmWave Systems [J].
Huang, Hao ;
Gui, Guan ;
Gacanin, Haris ;
Yuen, Chau ;
Sari, Hikmet ;
Adachi, Fumiyuki .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (07) :9614-9619
[8]   Mobile Edge Computing via a UAV-Mounted Cloudlet: Optimization of Bit Allocation and Path Planning [J].
Jeong, Seongah ;
Simeone, Osvaldo ;
Kang, Joonhyuk .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2018, 67 (03) :2049-2063
[9]   FlexEdge: Digital Twin-Enabled Task Offloading for UAV-Aided Vehicular Edge Computing [J].
Li, Bin ;
Xie, Wancheng ;
Ye, Yinghui ;
Liu, Lei ;
Fei, Zesong .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (08) :11086-11091
[10]   Energy and Age Pareto Optimal Trajectories in UAV-Assisted Wireless Data Collection [J].
Liao, Yuan ;
Friderikos, Vasilis .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (08) :9101-9106