Learning-Based Collaborative Computation Offloading in UAV-Assisted Multi-Access Edge Computing

被引:2
|
作者
Xu, Zikun [1 ]
Liu, Junhui [1 ,2 ]
Guo, Ying [1 ]
Dong, Yunyun [1 ,3 ]
He, Zhenli [1 ,2 ,3 ]
机构
[1] Yunnan Univ, Sch Software, Kunming 650504, Peoples R China
[2] Yunnan Univ, Yunnan Key Lab Software Engn, Kunming 650504, Peoples R China
[3] Yunnan Univ, Engn Res Ctr Cyberspace, Kunming 650504, Peoples R China
关键词
UAV-assisted MEC; multi-agent reinforcement learning; task offloading; multi-agent deep deterministic policy gradient; RESOURCE-ALLOCATION; ENERGY; OPTIMIZATION; NETWORKS; MEC;
D O I
10.3390/electronics12204371
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Unmanned aerial vehicles (UAVs) have gained considerable attention in the research community due to their exceptional agility, maneuverability, and potential applications in fields like surveillance, multi-access edge computing (MEC), and various other domains. However, efficiently providing computation offloading services for concurrent Internet of Things devices (IOTDs) remains a significant challenge for UAVs due to their limited computing and communication capabilities. Consequently, optimizing and managing the constrained computing, communication, and energy resources of UAVs are essential for establishing an efficient aerial network infrastructure. To address this challenge, we investigate the collaborative computation offloading optimization problem in a UAV-assisted MEC environment comprising multiple UAVs and multiple IODTs. Our primary objective is to obtain efficient offloading strategies within a multi-heterogeneous UAV environment characterized by limited computing and communication capabilities. In this context, we model the problem as a multi-agent markov decision process (MAMDP) to account for environmental dynamics. We employ a multi-agent deep deterministic policy gradient (MADDPG) approach for task offloading. Subsequently, we conduct simulations to evaluate the efficiency of our proposed offloading scheme. The results highlight significant improvements achieved by the proposed offloading strategy, including a notable increase in the system completion rate and a significant reduction in the average energy consumption of the system.
引用
收藏
页数:21
相关论文
共 50 条
  • [21] Computation Offloading and Trajectory Control for UAV-Assisted Edge Computing Using Deep Reinforcement Learning
    Qi, Huamei
    Zhou, Zheng
    APPLIED SCIENCES-BASEL, 2022, 12 (24):
  • [22] Computation Offloading and Resource Allocation Algorithm for Collaborative LEO Satellite Multi-Access Edge Computing
    Song Z.-Y.
    Hao Y.-Y.
    Sun X.
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2022, 50 (03): : 567 - 573
  • [23] Deep Reinforcement Learning for Multi-Hop Offloading in UAV-Assisted Edge Computing
    Nguyen Tien Hoa
    Do Van Dai
    Le Hoang Lan
    Nguyen Cong Luong
    Duc Van Le
    Niyato, Dusit
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (12) : 16917 - 16922
  • [24] Computation Offloading in Multi-Access Edge Computing Networks: A Multi-Task Learning Approach
    Yang, Bo
    Cao, Xuelin
    Bassey, Joshua
    Li, Xiangfang
    Kroecker, Timothy
    Qian, Lijun
    ICC 2019 - 2019 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2019,
  • [25] Data Offloading in UAV-Assisted Multi-Access Edge Computing Systems: A Resource-Based Pricing and User Risk-Awareness Approach
    Mitsis, Giorgos
    Tsiropoulou, Eirini Eleni
    Papavassiliou, Symeon
    SENSORS, 2020, 20 (08)
  • [26] Stochastic Computation Offloading and Trajectory Scheduling for UAV-Assisted Mobile Edge Computing
    Zhang, Jiao
    Zhou, Li
    Tang, Qi
    Ngai, Edith C. -H.
    Hu, Xiping
    Zhao, Haitao
    Wei, Jibo
    IEEE INTERNET OF THINGS JOURNAL, 2019, 6 (02) : 3688 - 3699
  • [27] Computation Offloading in Multi-Access Edge Computing Using a Deep Sequential Model Based on Reinforcement Learning
    Wang, Jin
    Hu, Jia
    Min, Geyong
    Zhan, Wenhan
    Ni, Qiang
    Georgalas, Nektarios
    IEEE COMMUNICATIONS MAGAZINE, 2019, 57 (05) : 64 - 69
  • [28] Cooperative service caching and computation offloading in multi-access edge computing
    Zhong, Shijie
    Guo, Songtao
    Yu, Hongyan
    Wang, Quyuan
    COMPUTER NETWORKS, 2021, 189
  • [29] Computation Offloading in Resource-Constrained Multi-Access Edge Computing
    Li, Kexin
    Wang, Xingwei
    He, Qiang
    Wang, Jielei
    Li, Jie
    Zhan, Siyu
    Lu, Guoming
    Dustdar, Schahram
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (11) : 10665 - 10677
  • [30] Multi-Relay Assisted Computation Offloading for Multi-Access Edge Computing Systems With Energy Harvesting
    Li, Molin
    Zhou, Xiaobo
    Qiu, Tie
    Zhao, Qinglin
    Li, Keqiu
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2021, 70 (10) : 10941 - 10956