Reconfigurable Intelligent Surface-Assisted Multi-UAV Networks: Efficient Resource Allocation With Deep Reinforcement Learning

被引:48
|
作者
Khoi Khac Nguyen [1 ]
Khosravirad, Saeed R. [2 ]
da Costa, Daniel Benevides [3 ]
Nguyen, Long D. [4 ]
Duong, Trung Q. [1 ]
机构
[1] Queens Univ Belfast, Sch Elect Elect Engn & Comp Sci, Belfast BT7 1NN, Antrim, North Ireland
[2] Nokia Bell Labs, Murray Hill, NJ 07964 USA
[3] Natl Yunlin Univ Sci & Technol Douliou, Future Technol Res Ctr, Touliu 64002, Yunlin, Taiwan
[4] Dong Nai Univ, Dong Nai, Vietnam
关键词
Optimization; Wireless networks; Signal processing algorithms; Resource management; Autonomous aerial vehicles; Array signal processing; Delays; Deep reinforcement learning; multi-UAV; reconfigurable intelligent surface; resource allocation; COMMUNICATION; DESIGN; OPTIMIZATION; INFORMATION;
D O I
10.1109/JSTSP.2021.3134162
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this paper, we propose reconfigurable intelligent surface (RIS)-assisted unmanned aerial vehicles (UAVs) networks that can utilise both advantages of UAV's agility and RIS's reflection for enhancing the network's performance. To aim at maximising the energy efficiency (EE) of the considered networks, we jointly optimise the power allocation of the UAVs and the phase-shift matrix of the RIS. A deep reinforcement learning (DRL) approach is proposed for solving the continuous optimisation problem with time-varying channels in a centralised fashion. Moreover, parallel learning approach is also proposed for reducing the latency of information transmission requirement of the centralised approach. Numerical results show a significant improvement of our proposed schemes compared with the conventional approaches in terms of EE, flexibility, and processing time. Our proposed DRL methods for RIS-assisted UAV networks can be used for real-time applications due to their capability of instant decision-making and handling the time-varying channel with the dynamic environmental setting.
引用
收藏
页码:358 / 368
页数:11
相关论文
共 50 条
  • [41] Multi-Agent Deep Reinforcement Learning for Full-Duplex Multi-UAV Networks
    Dai, Chen
    Zhu, Kun
    Hossain, Ekram
    2022 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2022, : 2232 - 2237
  • [42] Intelligent Reflecting Surface-Assisted Interference Mitigation With Deep Reinforcement Learning for Radio Astronomy
    Peng, Junhui
    Cao, Hailin
    Ali, Zahid
    Wu, Xiaodong
    Fan, Jin
    IEEE ANTENNAS AND WIRELESS PROPAGATION LETTERS, 2022, 21 (09): : 1757 - 1761
  • [43] Energy Harvesting Reconfigurable Intelligent Surface for UAV Based on Robust Deep Reinforcement Learning
    Peng, Haoran
    Wang, Li-Chun
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2023, 22 (10) : 6826 - 6838
  • [44] Hybrid Active-Passive Reconfigurable Intelligent Surface-Assisted UAV Communications
    Nguyen, Nhan T.
    V-Dinh Nguyen
    Wu, Qingqing
    Tolli, Antti
    Chatzinotas, Symeon
    Juntti, Markku
    2022 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM 2022), 2022, : 3126 - 3131
  • [45] Deep Reinforcement Learning Assisted UAV Trajectory and Resource Optimization for NOMA Networks
    Chen, Peixin
    Zhao, Jian
    Shen, Furao
    2022 14TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS AND SIGNAL PROCESSING, WCSP, 2022, : 933 - 938
  • [46] Deep Reinforcement Learning Approach for Joint Trajectory Design in Multi-UAV IoT Networks
    Xu, Shu
    Zhan, Xiangyu
    Li, Chunguo
    Wang, Dongming
    Yang, Luxi
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (03) : 3389 - 3394
  • [47] Multi-UAV Dynamic Wireless Networking With Deep Reinforcement Learning
    Wang, Qiang
    Zhang, Wenqi
    Liu, Yuanwei
    Liu, Ying
    IEEE COMMUNICATIONS LETTERS, 2019, 23 (12) : 2243 - 2246
  • [48] Multi-Agent Low-Bias Reinforcement Learning for Resource Allocation in UAV-Assisted Networks
    Zhou, Shiyang
    Cheng, Yufan
    Lei, Xia
    2022 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS WORKSHOPS (ICC WORKSHOPS), 2022, : 1011 - 1016
  • [49] Resource Allocation in Wireless Networks Assisted by Reconfigurable Intelligent Surfaces
    Buzzi, S.
    D'Andrea, C.
    Zappone, A.
    Fresia, M.
    Zhang, Y-P
    Feng, S.
    2020 IEEE 31ST ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS (IEEE PIMRC), 2020,
  • [50] Reconfigurable Intelligent Surface-Assisted Secure Mobile Edge Computing Networks
    Mao, Sun
    Liu, Lei
    Zhang, Ning
    Dong, Mianxiong
    Zhao, Jun
    Wu, Jinsong
    Leung, Victor C. M.
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (06) : 6647 - 6660