Learning-Based Collaborative Computation Offloading in UAV-Assisted Multi-Access Edge Computing

被引:2
|
作者
Xu, Zikun [1 ]
Liu, Junhui [1 ,2 ]
Guo, Ying [1 ]
Dong, Yunyun [1 ,3 ]
He, Zhenli [1 ,2 ,3 ]
机构
[1] Yunnan Univ, Sch Software, Kunming 650504, Peoples R China
[2] Yunnan Univ, Yunnan Key Lab Software Engn, Kunming 650504, Peoples R China
[3] Yunnan Univ, Engn Res Ctr Cyberspace, Kunming 650504, Peoples R China
关键词
UAV-assisted MEC; multi-agent reinforcement learning; task offloading; multi-agent deep deterministic policy gradient; RESOURCE-ALLOCATION; ENERGY; OPTIMIZATION; NETWORKS; MEC;
D O I
10.3390/electronics12204371
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Unmanned aerial vehicles (UAVs) have gained considerable attention in the research community due to their exceptional agility, maneuverability, and potential applications in fields like surveillance, multi-access edge computing (MEC), and various other domains. However, efficiently providing computation offloading services for concurrent Internet of Things devices (IOTDs) remains a significant challenge for UAVs due to their limited computing and communication capabilities. Consequently, optimizing and managing the constrained computing, communication, and energy resources of UAVs are essential for establishing an efficient aerial network infrastructure. To address this challenge, we investigate the collaborative computation offloading optimization problem in a UAV-assisted MEC environment comprising multiple UAVs and multiple IODTs. Our primary objective is to obtain efficient offloading strategies within a multi-heterogeneous UAV environment characterized by limited computing and communication capabilities. In this context, we model the problem as a multi-agent markov decision process (MAMDP) to account for environmental dynamics. We employ a multi-agent deep deterministic policy gradient (MADDPG) approach for task offloading. Subsequently, we conduct simulations to evaluate the efficiency of our proposed offloading scheme. The results highlight significant improvements achieved by the proposed offloading strategy, including a notable increase in the system completion rate and a significant reduction in the average energy consumption of the system.
引用
收藏
页数:21
相关论文
共 50 条
  • [31] Highly Immersive Telepresence with Computation Offloading to Multi-Access Edge Computing
    Kim, Younggi
    Joo, Younghyun
    Cho, Hyoyoung
    Park, Intaik
    11TH INTERNATIONAL CONFERENCE ON ICT CONVERGENCE: DATA, NETWORK, AND AI IN THE AGE OF UNTACT (ICTC 2020), 2020, : 860 - 862
  • [32] Dynamic Task Software Caching-Assisted Computation Offloading for Multi-Access Edge Computing
    Chen, Zhixiong
    Yi, Wenqiang
    Alam, Atm S.
    Nallanathan, Arumugam
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2022, 70 (10) : 6950 - 6965
  • [33] Collaborative Content Caching and Task Offloading in Multi-Access Edge Computing
    Li, Yumei
    Zhu, Xiumin
    Li, Nianxin
    Wang, Lingling
    Chen, Yawen
    Yang, Feng
    Zhai, Linbo
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (04) : 5367 - 5372
  • [34] Computation offloading and resource allocation for UAV-assisted IoT based on blockchain and mobile edge computing
    赵铖泽
    LI Meng
    SUN Enchang
    HUO Ru
    LI Yu
    ZHANG Yanhua
    High Technology Letters, 2022, 28 (01) : 80 - 90
  • [35] Computation offloading and resource allocation for UAV-assisted IoT based on blockchain and mobile edge computing
    Zhao C.
    Li M.
    Sun E.
    Huo R.
    Li Y.
    Zhang Y.
    High Technology Letters, 2022, 28 (01) : 80 - 90
  • [36] A QoE-based Optimization Approach to Computation Offloading in Vehicle-assisted Multi-access Edge Computing
    Pham, Xuan-Qui
    Thien Huynh-The
    Kim, Dong-Seong
    12TH INTERNATIONAL CONFERENCE ON ICT CONVERGENCE (ICTC 2021): BEYOND THE PANDEMIC ERA WITH ICT CONVERGENCE INNOVATION, 2021, : 131 - 133
  • [37] Prototype-Based Collaborative Learning in UAV-Assisted Edge Computing Networks
    Yu, Enze
    Dai, Haipeng
    Zhang, Haihan
    Zheng, Zhenzhe
    Zhao, Jun
    Chen, Guihai
    SOFTWARE-PRACTICE & EXPERIENCE, 2024,
  • [38] Decentralized Offloading Strategies Based on Reinforcement Learning for Multi-Access Edge Computing
    Hu, Chunyang
    Li, Jingchen
    Shi, Haobin
    Ning, Bin
    Gu, Qiong
    INFORMATION, 2021, 12 (09)
  • [39] Deep Reinforcement Learning-Based Computation Offloading for 5G Vehicle-Aware Multi-Access Edge Computing Network
    Ziying Wu
    Danfeng Yan
    ChinaCommunications, 2021, 18 (11) : 26 - 41
  • [40] Deep reinforcement learning-based computation offloading for 5G vehicle-aware multi-access edge computing network
    Wu, Ziying
    Yan, Danfeng
    CHINA COMMUNICATIONS, 2021, 18 (11) : 26 - 41