Reconfigurable Intelligent Surface-Assisted Multi-UAV Networks: Efficient Resource Allocation With Deep Reinforcement Learning

被引:48
|
作者
Khoi Khac Nguyen [1 ]
Khosravirad, Saeed R. [2 ]
da Costa, Daniel Benevides [3 ]
Nguyen, Long D. [4 ]
Duong, Trung Q. [1 ]
机构
[1] Queens Univ Belfast, Sch Elect Elect Engn & Comp Sci, Belfast BT7 1NN, Antrim, North Ireland
[2] Nokia Bell Labs, Murray Hill, NJ 07964 USA
[3] Natl Yunlin Univ Sci & Technol Douliou, Future Technol Res Ctr, Touliu 64002, Yunlin, Taiwan
[4] Dong Nai Univ, Dong Nai, Vietnam
关键词
Optimization; Wireless networks; Signal processing algorithms; Resource management; Autonomous aerial vehicles; Array signal processing; Delays; Deep reinforcement learning; multi-UAV; reconfigurable intelligent surface; resource allocation; COMMUNICATION; DESIGN; OPTIMIZATION; INFORMATION;
D O I
10.1109/JSTSP.2021.3134162
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this paper, we propose reconfigurable intelligent surface (RIS)-assisted unmanned aerial vehicles (UAVs) networks that can utilise both advantages of UAV's agility and RIS's reflection for enhancing the network's performance. To aim at maximising the energy efficiency (EE) of the considered networks, we jointly optimise the power allocation of the UAVs and the phase-shift matrix of the RIS. A deep reinforcement learning (DRL) approach is proposed for solving the continuous optimisation problem with time-varying channels in a centralised fashion. Moreover, parallel learning approach is also proposed for reducing the latency of information transmission requirement of the centralised approach. Numerical results show a significant improvement of our proposed schemes compared with the conventional approaches in terms of EE, flexibility, and processing time. Our proposed DRL methods for RIS-assisted UAV networks can be used for real-time applications due to their capability of instant decision-making and handling the time-varying channel with the dynamic environmental setting.
引用
收藏
页码:358 / 368
页数:11
相关论文
共 50 条
  • [31] Resource Allocation in UAV-Assisted Wireless Networks Using Reinforcement Learning
    Luong, Phuong
    Gagnon, Francois
    Labeau, Fabrice
    2020 IEEE 92ND VEHICULAR TECHNOLOGY CONFERENCE (VTC2020-FALL), 2020,
  • [32] Active Reconfigurable Intelligent Surface-Assisted Mainlobe Wideband RFI Mitigation With Deep Reinforcement Learning for a Large Reflector Antenna
    Peng, Junhui
    Cao, Hailin
    Fan, Jin
    Zhang, Zhengjie
    Wu, Decheng
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 15
  • [33] Resource Allocation for Intelligent Reflecting Surface-Assisted Cognitive Radio Networks (Invited Paper)
    Xu, Dongfang
    Yu, Xianghao
    Schober, Robert
    PROCEEDINGS OF THE 21ST IEEE INTERNATIONAL WORKSHOP ON SIGNAL PROCESSING ADVANCES IN WIRELESS COMMUNICATIONS (IEEE SPAWC2020), 2020,
  • [34] Optimal Resource Allocation for Reconfigurable Intelligent Surface Assisted Dynamic Wireless Network via Online Reinforcement Learning
    Zhang, Yuzhu
    Xu, Hao
    2022 IEEE INTERNATIONAL CONFERENCE ON SENSING, COMMUNICATION, AND NETWORKING (SECON WORKSHOPS), 2022, : 13 - 18
  • [35] Reconfigurable Intelligent Surface-assisted Networks: Phase Alignment Categories
    Xu, Jiaqi
    Liu, Yuanwei
    IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2021), 2021,
  • [36] Opportunistic Reflection in Reconfigurable Intelligent Surface-Assisted Wireless Networks
    Jiang, Wei
    Schotten, Hans D.
    2023 IEEE 34TH ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS, PIMRC, 2023,
  • [37] Throughput Maximization in NOMA Enhanced RIS-Assisted Multi-UAV Networks: A Deep Reinforcement Learning Approach
    Tang, Runzhi
    Wang, Junxuan
    Zhang, Yanyan
    Jiang, Fan
    Zhang, Xuewei
    Du, Jianbo
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2025, 74 (01) : 730 - 745
  • [38] Robust Energy Efficiency Resource Allocation Algorithm in Reconfigurable Intelligent Surface-assisted Non-Orthogonal Multiple Access Networks
    Liu Qilie
    Xin Yanan
    Gao Junpeng
    Zhou Jihua
    Huang Dong
    Zhao Tao
    JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2022, 44 (07) : 2332 - 2341
  • [39] Aerial Reconfigurable Intelligent Surface-Assisted Secrecy: A Learning Approach
    Jiang, Tianqi
    Niu, Lirong
    Tang, Xu
    Tang, Xiao
    Zhai, Daosen
    IEEE COMMUNICATIONS LETTERS, 2022, 26 (01) : 18 - 22
  • [40] Deep Reinforcement Learning Based Resource Allocation for Intelligent Reflecting Surface Assisted Dynamic Spectrum Sharing
    Guo, Jianxin
    Wang, Zhe
    Li, Jun
    Zhang, Jie
    2022 14TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS AND SIGNAL PROCESSING, WCSP, 2022, : 1178 - 1183