Learning-Based Collaborative Computation Offloading in UAV-Assisted Multi-Access Edge Computing

被引:2
作者
Xu, Zikun [1 ]
Liu, Junhui [1 ,2 ]
Guo, Ying [1 ]
Dong, Yunyun [1 ,3 ]
He, Zhenli [1 ,2 ,3 ]
机构
[1] Yunnan Univ, Sch Software, Kunming 650504, Peoples R China
[2] Yunnan Univ, Yunnan Key Lab Software Engn, Kunming 650504, Peoples R China
[3] Yunnan Univ, Engn Res Ctr Cyberspace, Kunming 650504, Peoples R China
关键词
UAV-assisted MEC; multi-agent reinforcement learning; task offloading; multi-agent deep deterministic policy gradient; RESOURCE-ALLOCATION; ENERGY; OPTIMIZATION; NETWORKS; MEC;
D O I
10.3390/electronics12204371
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Unmanned aerial vehicles (UAVs) have gained considerable attention in the research community due to their exceptional agility, maneuverability, and potential applications in fields like surveillance, multi-access edge computing (MEC), and various other domains. However, efficiently providing computation offloading services for concurrent Internet of Things devices (IOTDs) remains a significant challenge for UAVs due to their limited computing and communication capabilities. Consequently, optimizing and managing the constrained computing, communication, and energy resources of UAVs are essential for establishing an efficient aerial network infrastructure. To address this challenge, we investigate the collaborative computation offloading optimization problem in a UAV-assisted MEC environment comprising multiple UAVs and multiple IODTs. Our primary objective is to obtain efficient offloading strategies within a multi-heterogeneous UAV environment characterized by limited computing and communication capabilities. In this context, we model the problem as a multi-agent markov decision process (MAMDP) to account for environmental dynamics. We employ a multi-agent deep deterministic policy gradient (MADDPG) approach for task offloading. Subsequently, we conduct simulations to evaluate the efficiency of our proposed offloading scheme. The results highlight significant improvements achieved by the proposed offloading strategy, including a notable increase in the system completion rate and a significant reduction in the average energy consumption of the system.
引用
收藏
页数:21
相关论文
共 46 条
  • [1] SVM-Based Task Admission Control and Computation Offloading Using Lyapunov Optimization in Heterogeneous MEC Network
    Abbas, Nadine
    Fawaz, Wissam
    Sharafeddine, Sanaa
    Mourad, Azzam
    Abou-Rjeily, Chadi
    [J]. IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2022, 19 (03): : 3121 - 3135
  • [2] Deep Reinforcement Learning A brief survey
    Arulkumaran, Kai
    Deisenroth, Marc Peter
    Brundage, Miles
    Bharath, Anil Anthony
    [J]. IEEE SIGNAL PROCESSING MAGAZINE, 2017, 34 (06) : 26 - 38
  • [3] Green Parallel Online Offloading for DSCI-Type Tasks in IoT-Edge Systems
    Chen, Junqi
    Wu, Huaming
    Li, Ruidong
    Jiao, Pengfei
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2022, 18 (11) : 7955 - 7966
  • [4] QoE-Aware Decentralized Task Offloading and Resource Allocation for End-Edge-Cloud Systems: A Game-Theoretical Approach
    Chen, Ying
    Zhao, Jie
    Wu, Yuan
    Huang, Jiwei
    Shen, Xuemin
    [J]. IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (01) : 769 - 784
  • [5] Deep Reinforcement Learning for Stochastic Computation Offloading in Digital Twin Networks
    Dai, Yueyue
    Zhang, Ke
    Maharjan, Sabita
    Zhang, Yan
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (07) : 4968 - 4977
  • [6] Survey on Aerial Radio Access Networks: Toward a Comprehensive 6G Access Infrastructure
    Dao, Nhu-Ngoc
    Pham, Quoc-Viet
    Tu, Ngo Hoang
    Thanh, Tran Thien
    Bao, Vo Nguyen Quoc
    Lakew, Demeke Shumeye
    Cho, Sungrae
    [J]. IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2021, 23 (02): : 1193 - 1225
  • [7] Joint Offloading and Trajectory Optimization for Complex Status Updates in UAV-Assisted Internet of Things
    Diao, Xianbang
    Guan, Xinrong
    Cai, Yueming
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (23) : 23881 - 23896
  • [8] Cooperative Task Offloading and Content Delivery for Heterogeneous Demands: A Matching Game-Theoretic Approach
    Fang, Tao
    Wu, Dan
    Chen, Jiaxin
    Liu, Dianxiong
    [J]. IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2022, 8 (02) : 1092 - 1103
  • [9] UAVs as Mobile Infrastructure: Addressing Battery Lifetime
    Galkin, Boris
    Kibilda, Jacek
    DaSilva, Luiz A.
    [J]. IEEE COMMUNICATIONS MAGAZINE, 2019, 57 (06) : 132 - 137
  • [10] PPO2: Location Privacy-Oriented Task Offloading to Edge Computing Using Reinforcement Learning for Intelligent Autonomous Transport Systems
    Gao, Honghao
    Huang, Wanqiu
    Liu, Tong
    Yin, Yuyu
    Li, Youhuizi
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (07) : 7599 - 7612