Deep Reinforcement Learning Based Resource Allocation in Multi-UAV-Aided MEC Networks

被引:60
作者
Chen, Jingxuan [1 ,2 ]
Cao, Xianbin [1 ,2 ,3 ]
Yang, Peng [1 ,2 ,3 ]
Xiao, Meng [1 ,2 ]
Ren, Siqiao [1 ,2 ]
Zhao, Zhongliang [1 ,2 ,3 ]
Wu, Dapeng Oliver [4 ]
机构
[1] Beihang Univ, Sch Elect & Informat Engn, Beijing 100191, Peoples R China
[2] Beihang Univ, Key Lab Adv Technol Near Space Informat Syst, Minist Ind & Informat Technol China, Beijing 100191, Peoples R China
[3] Peng Cheng Lab, Dept Math & Theories, Shenzhen 518055, Guangdong, Peoples R China
[4] City Univ Hong Kong, Dept Comp Sci, Kowloon, Hong Kong, Peoples R China
基金
中国国家自然科学基金;
关键词
Energy consumption; Resource management; Autonomous aerial vehicles; Task analysis; Optimization; Trajectory; Energy efficiency; MEC; UAV; resource allocation; movement control; DRL; EDGE; OPTIMIZATION;
D O I
10.1109/TCOMM.2022.3226193
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Resource allocation for mobile edge computing (MEC) in unmanned aerial vehicle (UAV) networks has been a popular research issue. Different from existing works, this paper considers a multi-UAV-aided uplink communication scenario and investigates a resource allocation problem of minimizing the total system latency and the energy consumption, subject to constraints on transmit power of mobile users (MUs), system latency caused by transmission and computation. The problem is confirmed to be a challenging time-series mixed-integer non-convex programming problem, and we propose a joint UAV Movement control, MU Association and MU Power control (UMAP) algorithm to solve it effectively, where three sub-problems are optimized iteratively. Specifically, UAV movement and MU association are optimized utilizing deep reinforcement learning (DRL) to decrease the energy consumption and system latency. Next, a closed-form solution of the MU transmit power is derived. Finally, simulation results show that the UMAP algorithm can significantly decrease the system latency and energy consumption and increase the coverage rate compared with benchmark algorithms.
引用
收藏
页码:296 / 309
页数:14
相关论文
共 50 条
  • [31] Deep-Reinforcement-Learning-Based AoI-Aware Resource Allocation for RIS-Aided IoV Networks
    Qi, Kangwei
    Wu, Qiong
    Fan, Pingyi
    Cheng, Nan
    Chen, Wen
    Wang, Jiangzhou
    Letaief, Khaled B.
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2025, 74 (01) : 1365 - 1378
  • [32] Multiagent Deep Reinforcement Learning for Task Offloading and Resource Allocation in Cybertwin-Based Networks
    Hou, Wenjing
    Wen, Hong
    Song, Huanhuan
    Lei, Wenxin
    Zhang, Wei
    IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (22) : 16256 - 16268
  • [33] Deep reinforcement learning-based resource allocation in multi-access edge computing
    Khani, Mohsen
    Sadr, Mohammad Mohsen
    Jamali, Shahram
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2023,
  • [34] Federated Deep Reinforcement Learning for Multimedia Task Offloading and Resource Allocation in MEC Networks
    Zhang, Rongqi
    Pan, Chunyun
    Wang, Yafei
    Yao, Yuanyuan
    Li, Xuehua
    IEICE TRANSACTIONS ON COMMUNICATIONS, 2024, E107B (06) : 446 - 457
  • [35] Federated Deep Reinforcement Learning for Online Task Offloading and Resource Allocation in WPC-MEC Networks
    Zang, Lianqi
    Zhang, Xin
    Guo, Boren
    IEEE ACCESS, 2022, 10 : 9856 - 9867
  • [36] Fairness-Aware Utility Maximization for Multi-UAV-Aided Terrestrial Networks
    Gupta, Nishant
    Agarwal, Satyam
    Fakhreddine, Aymen
    IEEE OPEN JOURNAL OF VEHICULAR TECHNOLOGY, 2024, 5 : 1611 - 1624
  • [37] Deep Reinforcement Learning in Cache-Aided MEC Networks
    Yang, Zhong
    Liu, Yuanwei
    Chen, Yue
    Tyson, Gareth
    ICC 2019 - 2019 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2019,
  • [38] Computation Offloading and Resource Allocation in MEC-Enabled Integrated Aerial-Terrestrial Vehicular Networks: A Reinforcement Learning Approach
    Waqar, Noor
    Hassan, Syed Ali
    Mahmood, Aamir
    Dev, Kapal
    Dinh-Thuan Do
    Gidlund, Mikael
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (11) : 21478 - 21491
  • [39] Joint Offloading and Resource Allocation Using Deep Reinforcement Learning in Mobile Edge Computing
    Zhang, Xinjie
    Zhang, Xinglin
    Yang, Wentao
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2022, 9 (05): : 3454 - 3466
  • [40] Multiobjective Deep Reinforcement Learning Assisted Resource Allocation for MEC-Caching-Coexist System
    Li, Zan
    Zhao, Zhongling
    Shi, Jia
    Si, Jiangbo
    Xiao, Pei
    Tafazolli, Rahim
    Hu, Hang
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (04): : 6158 - 6170