Deep Reinforcement Learning Based Resource Allocation in Multi-UAV-Aided MEC Networks

被引:60
作者
Chen, Jingxuan [1 ,2 ]
Cao, Xianbin [1 ,2 ,3 ]
Yang, Peng [1 ,2 ,3 ]
Xiao, Meng [1 ,2 ]
Ren, Siqiao [1 ,2 ]
Zhao, Zhongliang [1 ,2 ,3 ]
Wu, Dapeng Oliver [4 ]
机构
[1] Beihang Univ, Sch Elect & Informat Engn, Beijing 100191, Peoples R China
[2] Beihang Univ, Key Lab Adv Technol Near Space Informat Syst, Minist Ind & Informat Technol China, Beijing 100191, Peoples R China
[3] Peng Cheng Lab, Dept Math & Theories, Shenzhen 518055, Guangdong, Peoples R China
[4] City Univ Hong Kong, Dept Comp Sci, Kowloon, Hong Kong, Peoples R China
基金
中国国家自然科学基金;
关键词
Energy consumption; Resource management; Autonomous aerial vehicles; Task analysis; Optimization; Trajectory; Energy efficiency; MEC; UAV; resource allocation; movement control; DRL; EDGE; OPTIMIZATION;
D O I
10.1109/TCOMM.2022.3226193
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Resource allocation for mobile edge computing (MEC) in unmanned aerial vehicle (UAV) networks has been a popular research issue. Different from existing works, this paper considers a multi-UAV-aided uplink communication scenario and investigates a resource allocation problem of minimizing the total system latency and the energy consumption, subject to constraints on transmit power of mobile users (MUs), system latency caused by transmission and computation. The problem is confirmed to be a challenging time-series mixed-integer non-convex programming problem, and we propose a joint UAV Movement control, MU Association and MU Power control (UMAP) algorithm to solve it effectively, where three sub-problems are optimized iteratively. Specifically, UAV movement and MU association are optimized utilizing deep reinforcement learning (DRL) to decrease the energy consumption and system latency. Next, a closed-form solution of the MU transmit power is derived. Finally, simulation results show that the UMAP algorithm can significantly decrease the system latency and energy consumption and increase the coverage rate compared with benchmark algorithms.
引用
收藏
页码:296 / 309
页数:14
相关论文
共 50 条
  • [41] Collaborative Multi-Agent Deep Reinforcement Learning for Energy-Efficient Resource Allocation in Heterogeneous Mobile Edge Computing Networks
    Xiao, Yang
    Song, Yuqian
    Liu, Jun
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (06) : 6653 - 6668
  • [42] Robust Cooperative Communication Optimization for Multi-UAV-Aided Vehicular Networks
    Zhang, Songge
    Zhou, Jianshan
    Tian, Daxin
    Sheng, Zhengguo
    Duan, Xuting
    Leung, Victor C. M.
    [J]. IEEE WIRELESS COMMUNICATIONS LETTERS, 2021, 10 (04) : 780 - 784
  • [43] Deep Reinforcement Learning-Based Resource Management for UAV-Assisted Mobile Edge Computing Against Jamming
    Shao, Ziling
    Yang, Helin
    Xiao, Liang
    Su, Wei
    Chen, Yifan
    Xiong, Zehui
    [J]. IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (12) : 13358 - 13374
  • [44] Deep-Reinforcement-Learning-Based Computation Offloading in UAV-Assisted Vehicular Edge Computing Networks
    Yan, Junjie
    Zhao, Xiaohui
    Li, Zan
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (11): : 19882 - 19897
  • [45] Joint Resource Allocation and 3D-Position Optimization for UAV-Assisted MEC Network With NOMA
    Yu, Xiangbin
    Zhang, Xinyi
    Rui, Yun
    Dang, Xiaoyu
    Jia, Guoqing
    Guizani, Mohsen
    [J]. IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2025, 12 (03): : 1440 - 1456
  • [46] Dense Multiagent Reinforcement Learning Aided Multi-UAV Information Coverage for Vehicular Networks
    Fu, Hang
    Wang, Jingjing
    Chen, Jianrui
    Ren, Pengfei
    Zhang, Zheng
    Zhao, Guodong
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (12): : 21274 - 21286
  • [47] Deep Reinforcement Learning-Based Energy Minimization Task Offloading and Resource Allocation for Air Ground Integrated Heterogeneous Networks
    Qin, Peng
    Wang, Shuo
    Lu, Zhou
    Xie, Yuanbo
    Zhao, Xiongwen
    [J]. IEEE SYSTEMS JOURNAL, 2023, 17 (03): : 4958 - 4968
  • [48] AoI-Aware Joint Resource Allocation in Multi-UAV Aided Multi-Access Edge Computing Systems
    Shen, Shuai
    Yang, Halvin
    Yang, Kun
    Wang, Kezhi
    Zhang, Guopeng
    [J]. IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2024, 11 (03): : 2596 - 2609
  • [49] Multiagent Deep Reinforcement Learning for Wireless-Powered UAV Networks
    Oubbati, Omar Sami
    Lakas, Abderrahmane
    Guizani, Mohsen
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (17): : 16044 - 16059
  • [50] Deep Reinforcement Learning Based Cooperative Partial Task Offloading and Resource Allocation for IIoT Applications
    Zhang, Fan
    Han, Guangjie
    Liu, Li
    Martinez-Garcia, Miguel
    Peng, Yan
    [J]. IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2023, 10 (05): : 2991 - 3006