Reconfigurable Intelligent Surface-Assisted Multi-UAV Networks: Efficient Resource Allocation With Deep Reinforcement Learning

被引:49
|
作者
Khoi Khac Nguyen [1 ]
Khosravirad, Saeed R. [2 ]
da Costa, Daniel Benevides [3 ]
Nguyen, Long D. [4 ]
Duong, Trung Q. [1 ]
机构
[1] Queens Univ Belfast, Sch Elect Elect Engn & Comp Sci, Belfast BT7 1NN, Antrim, North Ireland
[2] Nokia Bell Labs, Murray Hill, NJ 07964 USA
[3] Natl Yunlin Univ Sci & Technol Douliou, Future Technol Res Ctr, Touliu 64002, Yunlin, Taiwan
[4] Dong Nai Univ, Dong Nai, Vietnam
关键词
Optimization; Wireless networks; Signal processing algorithms; Resource management; Autonomous aerial vehicles; Array signal processing; Delays; Deep reinforcement learning; multi-UAV; reconfigurable intelligent surface; resource allocation; COMMUNICATION; DESIGN; OPTIMIZATION; INFORMATION;
D O I
10.1109/JSTSP.2021.3134162
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this paper, we propose reconfigurable intelligent surface (RIS)-assisted unmanned aerial vehicles (UAVs) networks that can utilise both advantages of UAV's agility and RIS's reflection for enhancing the network's performance. To aim at maximising the energy efficiency (EE) of the considered networks, we jointly optimise the power allocation of the UAVs and the phase-shift matrix of the RIS. A deep reinforcement learning (DRL) approach is proposed for solving the continuous optimisation problem with time-varying channels in a centralised fashion. Moreover, parallel learning approach is also proposed for reducing the latency of information transmission requirement of the centralised approach. Numerical results show a significant improvement of our proposed schemes compared with the conventional approaches in terms of EE, flexibility, and processing time. Our proposed DRL methods for RIS-assisted UAV networks can be used for real-time applications due to their capability of instant decision-making and handling the time-varying channel with the dynamic environmental setting.
引用
收藏
页码:358 / 368
页数:11
相关论文
共 50 条
  • [1] Trajectory Design and Resource Allocation for Multi-UAV Networks: Deep Reinforcement Learning Approaches
    Chang, Zheng
    Deng, Hengwei
    You, Li
    Min, Geyong
    Garg, Sahil
    Kaddoum, Georges
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2023, 10 (05): : 2940 - 2951
  • [2] Resource Allocation for Power Minimization in RIS-Assisted Multi-UAV Networks With NOMA
    Feng, Wanmei
    Tang, Jie
    Wu, Qingqing
    Fu, Yuli
    Zhang, Xiuyin
    So, Daniel K. C.
    Wong, Kai-Kit
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2023, 71 (11) : 6662 - 6676
  • [3] Throughput Maximization in NOMA Enhanced RIS-Assisted Multi-UAV Networks: A Deep Reinforcement Learning Approach
    Tang, Runzhi
    Wang, Junxuan
    Zhang, Yanyan
    Jiang, Fan
    Zhang, Xuewei
    Du, Jianbo
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2025, 74 (01) : 730 - 745
  • [4] Energy-Efficient Resource Allocation in Multi-UAV Networks With NOMA
    Najmeddin, Saif
    Aissa, Sonia
    Tahar, Sofiene
    IEEE TRANSACTIONS ON GREEN COMMUNICATIONS AND NETWORKING, 2021, 5 (04): : 1906 - 1917
  • [5] Joint Task Offloading and Resource Allocation in Multi-UAV Multi-Server Systems: An Attention-Based Deep Reinforcement Learning Approach
    Wu, Guohua
    Liu, Zelin
    Fan, Mingfeng
    Wu, Keyu
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (08) : 11964 - 11978
  • [6] Deep Reinforcement Learning-Based Resource Allocation in Cooperative UAV-Assisted Wireless Networks
    Luong, Phuong
    Gagnon, Francois
    Tran, Le-Nam
    Labeau, Fabrice
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (11) : 7610 - 7625
  • [7] Resource Allocation and Collaborative Offloading in Multi-UAV-Assisted IoV With Federated Deep Reinforcement Learning
    Chen, Zheyi
    Huang, Zhiqin
    Zhang, Junjie
    Cheng, Hongju
    Li, Jie
    IEEE INTERNET OF THINGS JOURNAL, 2025, 12 (05): : 4629 - 4640
  • [8] Deep reinforcement learning based trajectory design and resource allocation for task-aware multi-UAV enabled MEC networks
    Li, Zewu
    Xu, Chen
    Zhang, Zhanpeng
    Wu, Runze
    COMPUTER COMMUNICATIONS, 2024, 213 : 88 - 98
  • [9] Deep Reinforcement Learning Based Resource Allocation in Multi-UAV-Aided MEC Networks
    Chen, Jingxuan
    Cao, Xianbin
    Yang, Peng
    Xiao, Meng
    Ren, Siqiao
    Zhao, Zhongliang
    Wu, Dapeng Oliver
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2023, 71 (01) : 296 - 309
  • [10] Multi-Agent Deep Reinforcement Learning for Trajectory Design and Power Allocation in Multi-UAV Networks
    Zhao, Nan
    Liu, Zehua
    Cheng, Yiqiang
    IEEE ACCESS, 2020, 8 : 139670 - 139679