Deep Reinforcement Learning Based Resource Allocation in Multi-UAV-Aided MEC Networks

被引:60
作者
Chen, Jingxuan [1 ,2 ]
Cao, Xianbin [1 ,2 ,3 ]
Yang, Peng [1 ,2 ,3 ]
Xiao, Meng [1 ,2 ]
Ren, Siqiao [1 ,2 ]
Zhao, Zhongliang [1 ,2 ,3 ]
Wu, Dapeng Oliver [4 ]
机构
[1] Beihang Univ, Sch Elect & Informat Engn, Beijing 100191, Peoples R China
[2] Beihang Univ, Key Lab Adv Technol Near Space Informat Syst, Minist Ind & Informat Technol China, Beijing 100191, Peoples R China
[3] Peng Cheng Lab, Dept Math & Theories, Shenzhen 518055, Guangdong, Peoples R China
[4] City Univ Hong Kong, Dept Comp Sci, Kowloon, Hong Kong, Peoples R China
基金
中国国家自然科学基金;
关键词
Energy consumption; Resource management; Autonomous aerial vehicles; Task analysis; Optimization; Trajectory; Energy efficiency; MEC; UAV; resource allocation; movement control; DRL; EDGE; OPTIMIZATION;
D O I
10.1109/TCOMM.2022.3226193
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Resource allocation for mobile edge computing (MEC) in unmanned aerial vehicle (UAV) networks has been a popular research issue. Different from existing works, this paper considers a multi-UAV-aided uplink communication scenario and investigates a resource allocation problem of minimizing the total system latency and the energy consumption, subject to constraints on transmit power of mobile users (MUs), system latency caused by transmission and computation. The problem is confirmed to be a challenging time-series mixed-integer non-convex programming problem, and we propose a joint UAV Movement control, MU Association and MU Power control (UMAP) algorithm to solve it effectively, where three sub-problems are optimized iteratively. Specifically, UAV movement and MU association are optimized utilizing deep reinforcement learning (DRL) to decrease the energy consumption and system latency. Next, a closed-form solution of the MU transmit power is derived. Finally, simulation results show that the UMAP algorithm can significantly decrease the system latency and energy consumption and increase the coverage rate compared with benchmark algorithms.
引用
收藏
页码:296 / 309
页数:14
相关论文
共 50 条
  • [21] Resource Scheduling Based on Deep Reinforcement Learning in UAV Assisted Emergency Communication Networks
    Wang, Chaowei
    Deng, Danhao
    Xu, Lexi
    Wang, Weidong
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2022, 70 (06) : 3834 - 3848
  • [22] Energy-Efficient Resource Allocation in a Multi-UAV-Aided NOMA Network
    Xi, Xing
    Cao, Xianbin
    Yang, Peng
    Chen, Jingxuan
    Wu, Dapeng
    2021 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2021,
  • [23] Multi-Agent Deep Reinforcement Learning for Trajectory Design and Power Allocation in Multi-UAV Networks
    Zhao, Nan
    Liu, Zehua
    Cheng, Yiqiang
    IEEE ACCESS, 2020, 8 : 139670 - 139679
  • [24] Secure Video Offloading in Multi-UAV-Enabled MEC Networks: A Deep Reinforcement Learning Approach
    Zhao, Tantan
    Li, Fan
    He, Lijun
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (02) : 2950 - 2963
  • [25] Dinkelbach-Guided Deep Reinforcement Learning for Secure Communication in UAV-Aided MEC Networks
    Lu, Weidang
    Ding, Yu
    Feng, Yunqi
    Huang, Guoxing
    Zhao, Nan
    Nallanathan, Arumugam
    Yang, Xiaoniu
    2022 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM 2022), 2022, : 1740 - 1745
  • [26] Multi-Agent Deep Reinforcement Learning-Based Task Scheduling and Resource Sharing for O-RAN-Empowered Multi-UAV-Assisted Wireless Sensor Networks
    Betalo, Mesfin Leranso
    Leng, Supeng
    Abishu, Hayla Nahom
    Dharejo, Fayaz Ali
    Seid, Abegaz Mohammed
    Erbad, Aiman
    Naqvi, Rizwan Ali
    Zhou, Longyu
    Guizani, Mohsen
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (07) : 9247 - 9261
  • [27] Layerwise Quantum Deep Reinforcement Learning for Joint Optimization of UAV Trajectory and Resource Allocation
    Silvirianti
    Narottama, Bhaskara
    Shin, Soo Young
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (01) : 430 - 443
  • [28] Multi-Agent Deep Reinforcement Learning-Based Resource Allocation for Cognitive Radio Networks
    Mei, Ruru
    Wang, Zhugang
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2025, 74 (03) : 4744 - 4757
  • [29] Multi-Agent Reinforcement Learning-Based Resource Allocation for UAV Networks
    Cui, Jingjing
    Liu, Yuanwei
    Nallanathan, Arumugam
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2020, 19 (02) : 729 - 743
  • [30] Resource Allocation in UAV-Assisted Networks: A Clustering-Aided Reinforcement Learning Approach
    Zhou, Shiyang
    Cheng, Yufan
    Lei, Xia
    Peng, Qihang
    Wang, Jun
    Li, Shaoqian
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (11) : 12088 - 12103