Task Offloading Strategy for Unmanned Aerial Vehicle Power Inspection Based on Deep Reinforcement Learning

被引:4
作者
Zhuang, Wei [1 ]
Xing, Fanan [1 ]
Lu, Yuhang [1 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Comp Sci, Nanjing 210044, Peoples R China
关键词
multiple UAVs; mobile edge computing; deep reinforcement learning; power inspection; offloading strategy; electric power IoT; MOBILE; 5G;
D O I
10.3390/s24072070
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
With the ongoing advancement of electric power Internet of Things (IoT), traditional power inspection methods face challenges such as low efficiency and high risk. Unmanned aerial vehicles (UAVs) have emerged as a more efficient solution for inspecting power facilities due to their high maneuverability, excellent line-of-sight communication capabilities, and strong adaptability. However, UAVs typically grapple with limited computational power and energy resources, which constrain their effectiveness in handling computationally intensive and latency-sensitive inspection tasks. In response to this issue, we propose a UAV task offloading strategy based on deep reinforcement learning (DRL), which is designed for power inspection scenarios consisting of mobile edge computing (MEC) servers and multiple UAVs. Firstly, we propose an innovative UAV-Edge server collaborative computing architecture to fully exploit the mobility of UAVs and the high-performance computing capabilities of MEC servers. Secondly, we established a computational model concerning energy consumption and task processing latency in the UAV power inspection system, enhancing our understanding of the trade-offs involved in UAV offloading strategies. Finally, we formalize the task offloading problem as a multi-objective optimization issue and simultaneously model it as a Markov Decision Process (MDP). Subsequently, we proposed a task offloading algorithm based on a Deep Deterministic Policy Gradient (OTDDPG) to obtain the optimal task offloading strategy for UAVs. The simulation results demonstrated that this approach outperforms baseline methods with significant improvements in task processing latency and energy consumption.
引用
收藏
页数:19
相关论文
共 34 条
[1]   Energy Efficient UAV-Enabled Mobile Edge Computing for IoT Devices: A Review [J].
Abrar, Muhammad ;
Ajmal, Ushna ;
Almohaimeed, Ziyad M. ;
Gui, Xiang ;
Akram, Rizwan ;
Masroor, Roha .
IEEE ACCESS, 2021, 9 :127779-127798
[2]   Optimizing Task Offloading Energy in Multi-User Multi-UAV-Enabled Mobile Edge-Cloud Computing Systems [J].
Alhelaly, Soha ;
Muthanna, Ammar ;
Elgendy, Ibrahim A. .
APPLIED SCIENCES-BASEL, 2022, 12 (13)
[3]   Smart computational offloading for mobile edge computing in next-generation Internet of Things networks [J].
Ali, Zaiwar ;
Abbas, Ziaul Haq ;
Abbas, Ghulam ;
Numani, Abdullah ;
Bilal, Muhammad .
COMPUTER NETWORKS, 2021, 198
[4]   Communicating While Computing [Distributed mobile cloud computing over 5G heterogeneous networks] [J].
Barbarossa, Sergio ;
Sardellitti, Stefania ;
Di Lorenzo, Paolo .
IEEE SIGNAL PROCESSING MAGAZINE, 2014, 31 (06) :45-55
[5]  
Cao XW, 2018, IEEE INT WORK SIGN P, P111
[6]  
[岑伯维 Cen Bowei], 2021, [电力系统自动化, Automation of Electric Power Systems], V45, P107
[7]   Energy Saving Strategy of UAV in MEC Based on Deep Reinforcement Learning [J].
Dai, Zhiqiang ;
Xu, Gaochao ;
Liu, Ziqi ;
Ge, Jiaqi ;
Wang, Wei .
FUTURE INTERNET, 2022, 14 (08)
[8]  
[邓芳明 Deng Fangming], 2021, [电网技术, Power System Technology], V45, P3649
[9]  
Dhiman S., 2023, P 2023 INT C ADVANCE, P1
[10]   A survey of mobile cloud computing: architecture, applications, and approaches [J].
Dinh, Hoang T. ;
Lee, Chonho ;
Niyato, Dusit ;
Wang, Ping .
WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2013, 13 (18) :1587-1611