Task offloading for multi-UAV asset edge computing with deep reinforcement learning

被引:0
作者
Zakaryia, Samah A. [1 ]
Mead, Mohamed A. [2 ]
Nabil, Tamer [3 ]
Hussein, Mohamed K. [2 ]
机构
[1] Suez Canal Univ, Fac Comp & Informat, Dept Comp Sci, Ismailia, Egypt
[2] Suez Canal Univ, Comp Sci, Ismailia, Egypt
[3] Suez Canal Univ, Basic Sci Dept, Ismailia, Egypt
来源
CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS | 2025年 / 28卷 / 07期
关键词
Deep reinforcement learning; Unmanned aerial vehicle (UAV); Task offloading; Mobile edge computing; Multi-UAV; DTLCM;
D O I
10.1007/s10586-025-05382-1
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Mobile Edge Computing (MEC) addresses the demands of computation-intensive network services by providing processing capabilities at the network's edge, reducing service latency. Unmanned Aerial Vehicles (UAVs) enhance MEC due to their flexibility, broad coverage, and reliable wireless communication. This paper investigates task offloading in a UAV-assisted MEC system with multiple collaborating UAVs, optimizing task allocation in binary offloading mode to enhance system efficiency. System performance is evaluated in terms of energy consumption and task delay, while the proposed framework jointly optimizes UAV trajectory design, binary offloading, computation resource allocation, and communication resource management to achieve better resource utilization. To overcome the limitations of traditional heuristic-based approaches, we propose an innovative Deep Reinforcement Learning (DRL)-based task offloading framework and conduct a comparative analysis of Deep Deterministic Policy Gradient with Distance to Task Location and Capability Matching (DDPG with DTLCM), Deep Q-Network (DQN), and Q-Learning. Our approach leverages DTLCM to enhance decision-making, allowing UAVs to assign tasks more intelligently by factoring in both their proximity to the task and their computational capabilities. Experimental results show that DDPG with DTLCM consistently outperforms both DQN and Q-Learning, delivering more stable task allocation and better adaptability in dynamic scenarios. While DQN is more stable than Q-Learning in high-dimensional state spaces, it still suffers from discretization constraints. In contrast, DDPG with DTLCM benefits from a continuous action space, enabling more flexible and fine-tuned decision-making. These insights underscore the strength of policy-gradient DRL methods, particularly when augmented with context-aware mechanisms like DTLCM, in advancing UAV-assisted MEC task scheduling and resource optimization.
引用
收藏
页数:17
相关论文
共 40 条
[1]   Optimizing UAV computation offloading via MEC with deep deterministic policy gradient [J].
Abbasi, Ahmed Bashir ;
Hadi, Muhammad Usman .
TRANSACTIONS ON EMERGING TELECOMMUNICATIONS TECHNOLOGIES, 2024, 35 (01)
[2]   Reinforcement learning based task offloading of IoT applications in fog computing: algorithms and optimization techniques [J].
Allaoui, Takwa ;
Gasmi, Kaouther ;
Ezzedine, Tahar .
CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2024, 27 (08) :10299-10324
[3]   Delay-Aware Cooperative Task Offloading for Multi-UAV Enabled Edge-Cloud Computing [J].
Bai, Zhuoyi ;
Lin, Yifan ;
Cao, Yang ;
Wang, Wei .
IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (02) :1034-1049
[4]   Active device detection and performance analysis of massive non-orthogonal transmissions in cellular Internet of Things [J].
Cai, Donghong ;
Fan, Pingzhi ;
Zou, Qiuyun ;
Xu, Yanqing ;
Ding, Zhiguo ;
Liu, Zhiquan .
SCIENCE CHINA-INFORMATION SCIENCES, 2022, 65 (08)
[5]   Intelligent ubiquitous computing for future UAV-enabled MEC network systems [J].
Chen, Lunyuan ;
Zhao, Rui ;
He, Ke ;
Zhao, Zichao ;
Fan, Liseng .
CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2022, 25 (04) :2417-2427
[6]   UAV-Assisted Task Offloading in Vehicular Edge Computing Networks [J].
Dai, Xingxia ;
Xiao, Zhu ;
Jiang, Hongbo ;
Lui, John C. S. .
IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (04) :2520-2534
[7]   Joint Task Offloading, Resource Allocation, and Load-Balancing Optimization in Multi-UAV-Aided MEC Systems [J].
Elgendy, Ibrahim A. ;
Meshoul, Souham ;
Hammad, Mohamed .
APPLIED SCIENCES-BASEL, 2023, 13 (04)
[8]   Partial observation learning-based task offloading and spectrum allocation in UAV collaborative edge computing [J].
Fan, Chaoqiong ;
Wu, Xinyu ;
Li, Bin ;
Zhao, Chenglin .
DIGITAL COMMUNICATIONS AND NETWORKS, 2024, 10 (06) :1635-1643
[9]   UAV-Enabled Mobile Edge Computing for Resource Allocation Using Cooperative Evolutionary Computation [J].
Goudarzi, Shidrokh ;
Soleymani, Seyed Ahmad ;
Wang, Wenwu ;
Xiao, Pei .
IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2023, 59 (05) :5134-5147
[10]   Multi-UAV Cooperative Task Offloading and Resource Allocation in 5G Advanced and Beyond [J].
Guo, Hongzhi ;
Wang, Yutao ;
Liu, Jiajia ;
Liu, Chang .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (01) :347-359