Learning-Based Collaborative Computation Offloading in UAV-Assisted Multi-Access Edge Computing

被引:2
|
作者
Xu, Zikun [1 ]
Liu, Junhui [1 ,2 ]
Guo, Ying [1 ]
Dong, Yunyun [1 ,3 ]
He, Zhenli [1 ,2 ,3 ]
机构
[1] Yunnan Univ, Sch Software, Kunming 650504, Peoples R China
[2] Yunnan Univ, Yunnan Key Lab Software Engn, Kunming 650504, Peoples R China
[3] Yunnan Univ, Engn Res Ctr Cyberspace, Kunming 650504, Peoples R China
关键词
UAV-assisted MEC; multi-agent reinforcement learning; task offloading; multi-agent deep deterministic policy gradient; RESOURCE-ALLOCATION; ENERGY; OPTIMIZATION; NETWORKS; MEC;
D O I
10.3390/electronics12204371
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Unmanned aerial vehicles (UAVs) have gained considerable attention in the research community due to their exceptional agility, maneuverability, and potential applications in fields like surveillance, multi-access edge computing (MEC), and various other domains. However, efficiently providing computation offloading services for concurrent Internet of Things devices (IOTDs) remains a significant challenge for UAVs due to their limited computing and communication capabilities. Consequently, optimizing and managing the constrained computing, communication, and energy resources of UAVs are essential for establishing an efficient aerial network infrastructure. To address this challenge, we investigate the collaborative computation offloading optimization problem in a UAV-assisted MEC environment comprising multiple UAVs and multiple IODTs. Our primary objective is to obtain efficient offloading strategies within a multi-heterogeneous UAV environment characterized by limited computing and communication capabilities. In this context, we model the problem as a multi-agent markov decision process (MAMDP) to account for environmental dynamics. We employ a multi-agent deep deterministic policy gradient (MADDPG) approach for task offloading. Subsequently, we conduct simulations to evaluate the efficiency of our proposed offloading scheme. The results highlight significant improvements achieved by the proposed offloading strategy, including a notable increase in the system completion rate and a significant reduction in the average energy consumption of the system.
引用
收藏
页数:21
相关论文
共 50 条
  • [41] Online Computation Offloading in NOMA-Based Multi-Access Edge Computing: A Deep Reinforcement Learning Approach
    Nduwayezu, Maurice
    Quoc-Viet Pham
    Hwang, Won-Joo
    IEEE ACCESS, 2020, 8 : 99098 - 99109
  • [42] UAV-Assisted Multi-Access Edge Computing System: An Energy-Efficient Resource Management Framework
    Alsenwi, Madyan
    Tun, Yan Kyaw
    Pandey, Shashi Raj
    Ei, Nway Nway
    Hong, Choong Seon
    2020 34TH INTERNATIONAL CONFERENCE ON INFORMATION NETWORKING (ICOIN 2020), 2020, : 214 - 219
  • [43] Energy-efficient collaborative task offloading in multi-access edge computing based on deep reinforcement learning
    Wang, Shudong
    Zhao, Shengzhe
    Gui, Haiyuan
    He, Xiao
    Lu, Zhi
    Chen, Baoyun
    Fan, Zixuan
    Pang, Shanchen
    AD HOC NETWORKS, 2025, 169
  • [44] Distributed User Association and Computation Offloading in UAV-Assisted Mobile Edge Computing Systems
    Wang, Tong
    You, Chuanchuan
    IEEE ACCESS, 2024, 12 : 63548 - 63567
  • [45] Learning-Based Computation Offloading Approaches in UAVs-Assisted Edge Computing
    Zhu, Shichao
    Gui, Lin
    Zhao, Dongmei
    Cheng, Nan
    Zhang, Qi
    Lang, Xiupu
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2021, 70 (01) : 928 - 944
  • [46] Learning-Based Microservice Placement and Migration for Multi-Access Edge Computing
    Ray, Kaustabha
    Banerjee, Ansuman
    Narendra, Nanjangud C.
    IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2024, 21 (02): : 1969 - 1982
  • [47] Minimizing Response Delay in UAV-Assisted Mobile Edge Computing by Joint UAV Deployment and Computation Offloading
    Zhang, Jianshan
    Luo, Haibo
    Chen, Xing
    Shen, Hong
    Guo, Longkun
    IEEE TRANSACTIONS ON CLOUD COMPUTING, 2024, 12 (04) : 1372 - 1386
  • [48] Task Computation Offloading for Multi-Access Edge Computing via Attention Communication Deep Reinforcement Learning
    Li, Kexin
    Wang, Xingwei
    He, Qiang
    Yang, Mingzhou
    Huang, Min
    Dustdar, Schahram
    IEEE TRANSACTIONS ON SERVICES COMPUTING, 2023, 16 (04) : 2985 - 2999
  • [49] Multi-Agent Deep Reinforcement Learning for Task Offloading in UAV-Assisted Mobile Edge Computing
    Zhao, Nan
    Ye, Zhiyang
    Pei, Yiyang
    Liang, Ying-Chang
    Niyato, Dusit
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2022, 21 (09) : 6949 - 6960
  • [50] Qc - DQN: A Novel Constrained Reinforcement Learning Method for Computation Offloading in Multi-access Edge Computing
    Zhuang, Shen
    Gao, Chengxi
    He, Ying
    Yu, F. Richard
    Wang, Yuhang
    Pan, Weike
    Ming, Zhong
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,