DRL-Based Joint Task Scheduling and Trajectory Planning Method for UAV-Assisted MEC Scenarios

被引:1
作者
Gu, Cheng [1 ]
Li, Fan [2 ,3 ]
Liu, Dong-Sheng [4 ]
Wu, Yi-Xuan [4 ]
Wang, He-Xing [4 ]
机构
[1] Wuhan Univ, Sch Informat Management, Wuhan 430072, Peoples R China
[2] Inner Mongolia Univ, Sch Comp Sci, Hohhot 010000, Peoples R China
[3] Inner Mongolia Univ, Coll Software, Hohhot 010000, Peoples R China
[4] Northeastern Univ Qinhuangdao, Sch Comp & Commun Engn, Qinhuangdao 066004, Peoples R China
关键词
Autonomous aerial vehicles; Servers; Signal to noise ratio; Computational modeling; Real-time systems; Internet of Things; Resource management; Processor scheduling; Data models; Trajectory planning; Mobile edge computing; UAV; deep deterministic policy gradient; task offloading; trajectory planning;
D O I
10.1109/ACCESS.2024.3479312
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The proliferation of Internet of Things (IoT) devices has resulted in a massive increase in data generation, necessitating robust solutions for real-time data processing and analysis. The integration of Unmanned Aerial Vehicles (UAVs) with MEC systems presents a promising enhancement, providing dynamic, mobile edge computing capabilities that can adapt to changing conditions and demands. However, efficiently managing the task offloading and trajectory planning of UAVs in such scenarios poses significant challenges, particularly in maximizing coverage while minimizing time and energy consumption. In this context, this paper proposes a novel UAV-based MEC model utilizing the Multi-Agent Deep Deterministic Policy Gradient (MADDPG) reinforcement learning algorithm to optimize task scheduling and UAV trajectory in real-time. Our model enables UAVs to function as mobile edge servers, dynamically processing and routing tasks between terminal devices and edge servers based on real-time device demands. By incorporating a sophisticated reward function that prioritizes the minimization of system costs-including energy, time, and throughput maximization-our approach not only enhances the operational efficiency of UAV-assisted MEC systems but also improves the quality and responsiveness of edge computing services. After training the MADDPG model in the simulated environment, the experiments show that our approach significantly improved the performance of UAV-assisted MEC systems in real-time scenarios, converging after 50 learning episodes and achieving 90% task completion rate.
引用
收藏
页码:156224 / 156234
页数:11
相关论文
共 24 条
[1]   Energy Efficient UAV-Enabled Mobile Edge Computing for IoT Devices: A Review [J].
Abrar, Muhammad ;
Ajmal, Ushna ;
Almohaimeed, Ziyad M. ;
Gui, Xiang ;
Akram, Rizwan ;
Masroor, Roha .
IEEE ACCESS, 2021, 9 :127779-127798
[2]   Task offloading paradigm in mobile edge computing-current issues, adopted approaches, and future directions [J].
Akhlaqi, Mohammad Yahya ;
Hanapi, Zurina Binti Mohd .
JOURNAL OF NETWORK AND COMPUTER APPLICATIONS, 2023, 212
[3]   Task Offloading and Resource Allocation for Industrial Internet of Things: A Double-Dueling Deep Q-Network Approach [J].
Cheng, Weijun ;
Liu, Xiaoshi ;
Wang, Xiaoting ;
Nie, Gaofeng .
IEEE ACCESS, 2022, 10 :103111-103120
[4]  
Du Y, 2018, IEEE GLOB COMM CONF
[5]   A UAV-Assisted Multi-Task Allocation Method for Mobile Crowd Sensing [J].
Gao, Hui ;
Feng, Jianhao ;
Xiao, Yu ;
Zhang, Bo ;
Wang, Wendong .
IEEE TRANSACTIONS ON MOBILE COMPUTING, 2023, 22 (07) :3790-3804
[6]   Survey on computation offloading in UAV-Enabled mobile edge computing [J].
Huda, S. M. Asiful ;
Moh, Sangman .
JOURNAL OF NETWORK AND COMPUTER APPLICATIONS, 2022, 201
[7]  
Jiang HB, 2023, IEEE T MOBILE COMPUT, V22, P4000, DOI [10.1109/TMC.2022.3150432, 10.21037/joma-21-2]
[8]   RETRACTED: A Review and State of Art of Internet of Things (IoT) (Retracted Article) [J].
Laghari, Asif Ali ;
Wu, Kaishan ;
Laghari, Rashid Ali ;
Ali, Mureed ;
Khan, Abdullah Ayub .
ARCHIVES OF COMPUTATIONAL METHODS IN ENGINEERING, 2022, 29 (03) :1395-1413
[9]   EPtask: Deep Reinforcement Learning Based Energy-Efficient and Priority-Aware Task Scheduling for Dynamic Vehicular Edge Computing [J].
Li, Peisong ;
Xiao, Ziren ;
Wang, Xinheng ;
Huang, Kaizhu ;
Huang, Yi ;
Gao, Honghao .
IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2024, 9 (01) :1830-1846
[10]   Deep reinforcement learning-based task scheduling and resource allocation for NOMA-MEC in Industrial Internet of Things [J].
Lin, Lixia ;
Zhou, Wen'an ;
Yang, Zhicheng ;
Liu, Jianlong .
PEER-TO-PEER NETWORKING AND APPLICATIONS, 2023, 16 (01) :170-188