Learning-Based Collaborative Computation Offloading in UAV-Assisted Multi-Access Edge Computing

被引:2
|
作者
Xu, Zikun [1 ]
Liu, Junhui [1 ,2 ]
Guo, Ying [1 ]
Dong, Yunyun [1 ,3 ]
He, Zhenli [1 ,2 ,3 ]
机构
[1] Yunnan Univ, Sch Software, Kunming 650504, Peoples R China
[2] Yunnan Univ, Yunnan Key Lab Software Engn, Kunming 650504, Peoples R China
[3] Yunnan Univ, Engn Res Ctr Cyberspace, Kunming 650504, Peoples R China
关键词
UAV-assisted MEC; multi-agent reinforcement learning; task offloading; multi-agent deep deterministic policy gradient; RESOURCE-ALLOCATION; ENERGY; OPTIMIZATION; NETWORKS; MEC;
D O I
10.3390/electronics12204371
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Unmanned aerial vehicles (UAVs) have gained considerable attention in the research community due to their exceptional agility, maneuverability, and potential applications in fields like surveillance, multi-access edge computing (MEC), and various other domains. However, efficiently providing computation offloading services for concurrent Internet of Things devices (IOTDs) remains a significant challenge for UAVs due to their limited computing and communication capabilities. Consequently, optimizing and managing the constrained computing, communication, and energy resources of UAVs are essential for establishing an efficient aerial network infrastructure. To address this challenge, we investigate the collaborative computation offloading optimization problem in a UAV-assisted MEC environment comprising multiple UAVs and multiple IODTs. Our primary objective is to obtain efficient offloading strategies within a multi-heterogeneous UAV environment characterized by limited computing and communication capabilities. In this context, we model the problem as a multi-agent markov decision process (MAMDP) to account for environmental dynamics. We employ a multi-agent deep deterministic policy gradient (MADDPG) approach for task offloading. Subsequently, we conduct simulations to evaluate the efficiency of our proposed offloading scheme. The results highlight significant improvements achieved by the proposed offloading strategy, including a notable increase in the system completion rate and a significant reduction in the average energy consumption of the system.
引用
收藏
页数:21
相关论文
共 50 条
  • [1] Multi-objective deep reinforcement learning for computation offloading in UAV-assisted multi-access edge computing ✩
    Liu, Xu
    Chai, Zheng-Yi
    Li, Ya-Lun
    Cheng, Yan-Yang
    Zeng, Yue
    INFORMATION SCIENCES, 2023, 642
  • [2] Collaborative Computation Offloading for Multi-access Edge Computing
    Yu, Shuai
    Langar, Rami
    2019 IFIP/IEEE SYMPOSIUM ON INTEGRATED NETWORK AND SERVICE MANAGEMENT (IM), 2019, : 689 - 694
  • [3] Machine learning-based computation offloading in multi-access edge computing: A survey
    Choudhury, Alok
    Ghose, Manojit
    Islam, Akhirul
    Yogita
    JOURNAL OF SYSTEMS ARCHITECTURE, 2024, 148
  • [4] Deep reinforcement learning based computation offloading for xURLLC services with UAV-assisted IoT-based multi-access edge computing system
    Fatima, Nida
    Saxena, Paresh
    Giambene, Giovanni
    WIRELESS NETWORKS, 2024, 30 (09) : 7275 - 7291
  • [5] Learning-based Privacy-Preserving Computation Offloading in Multi-Access Edge Computing
    You, Feiran
    Yuan, Xin
    Ni, Wei
    Jamalipour, Abbas
    IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 922 - 927
  • [6] UAV-Assisted Multi-Access Edge Computing: Technologies and Challenges
    Zhang P.
    Wang C.
    Jiang C.
    Benslimane A.
    IEEE Internet of Things Magazine, 2021, 4 (04): : 12 - 17
  • [7] Deep Reinforcement Learning Based Computation Offloading in UAV-Assisted Edge Computing
    Zhang, Peiying
    Su, Yu
    Li, Boxiao
    Liu, Lei
    Wang, Cong
    Zhang, Wei
    Tan, Lizhuang
    DRONES, 2023, 7 (03)
  • [8] Data Offloading in UAV-Assisted Multi-Access Edge Computing Systems Under Resource Uncertainty
    Apostolopoulos, Pavlos Athanasios
    Fragkos, Georgios
    Tsiropoulou, Eirini Eleni
    Papavassiliou, Symeon
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2023, 22 (01) : 175 - 190
  • [9] The Advantage of Computation Offloading in Multi-Access Edge Computing
    Singh, Raghubir
    Armour, Simon
    Khan, Aftab
    Sooriyabandara, Mahesh
    Oikonomou, George
    2019 FOURTH INTERNATIONAL CONFERENCE ON FOG AND MOBILE EDGE COMPUTING (FMEC), 2019, : 289 - 294
  • [10] UAV-Assisted Multi-Access Edge Computing With Altitude-Dependent Computing Power
    Deng, Yiqin
    Zhang, Haixia
    Chen, Xianhao
    Fang, Yuguang
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (08) : 9404 - 9418