Reconfigurable Intelligent Surface-Assisted Multi-UAV Networks: Efficient Resource Allocation With Deep Reinforcement Learning

被引:48
|
作者
Khoi Khac Nguyen [1 ]
Khosravirad, Saeed R. [2 ]
da Costa, Daniel Benevides [3 ]
Nguyen, Long D. [4 ]
Duong, Trung Q. [1 ]
机构
[1] Queens Univ Belfast, Sch Elect Elect Engn & Comp Sci, Belfast BT7 1NN, Antrim, North Ireland
[2] Nokia Bell Labs, Murray Hill, NJ 07964 USA
[3] Natl Yunlin Univ Sci & Technol Douliou, Future Technol Res Ctr, Touliu 64002, Yunlin, Taiwan
[4] Dong Nai Univ, Dong Nai, Vietnam
关键词
Optimization; Wireless networks; Signal processing algorithms; Resource management; Autonomous aerial vehicles; Array signal processing; Delays; Deep reinforcement learning; multi-UAV; reconfigurable intelligent surface; resource allocation; COMMUNICATION; DESIGN; OPTIMIZATION; INFORMATION;
D O I
10.1109/JSTSP.2021.3134162
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this paper, we propose reconfigurable intelligent surface (RIS)-assisted unmanned aerial vehicles (UAVs) networks that can utilise both advantages of UAV's agility and RIS's reflection for enhancing the network's performance. To aim at maximising the energy efficiency (EE) of the considered networks, we jointly optimise the power allocation of the UAVs and the phase-shift matrix of the RIS. A deep reinforcement learning (DRL) approach is proposed for solving the continuous optimisation problem with time-varying channels in a centralised fashion. Moreover, parallel learning approach is also proposed for reducing the latency of information transmission requirement of the centralised approach. Numerical results show a significant improvement of our proposed schemes compared with the conventional approaches in terms of EE, flexibility, and processing time. Our proposed DRL methods for RIS-assisted UAV networks can be used for real-time applications due to their capability of instant decision-making and handling the time-varying channel with the dynamic environmental setting.
引用
收藏
页码:358 / 368
页数:11
相关论文
共 50 条
  • [1] RECONFIGURABLE INTELLIGENT SURFACE-ASSISTED AERIAL NONTERRESTRIAL NETWORKS An Intelligent Synergy With Deep Reinforcement Learning
    Umer, Muhammad
    Mohsin, Muhammad Ahmed
    Kaushik, Aryan
    Nadeem, Qurrat-Ul-Ain
    Nasir, Ali Arshad
    Hassan, Syed Ali
    IEEE VEHICULAR TECHNOLOGY MAGAZINE, 2025,
  • [2] Trajectory Design and Resource Allocation for Multi-UAV Networks: Deep Reinforcement Learning Approaches
    Chang, Zheng
    Deng, Hengwei
    You, Li
    Min, Geyong
    Garg, Sahil
    Kaddoum, Georges
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2023, 10 (05): : 2940 - 2951
  • [3] Robust Resource Allocation for Reconfigurable Intelligent Surface-Assisted Multi-User NOMA Networks
    Hu, Lin
    Liu, Xi-Yan
    Qi, Qian
    Chen, Qian-Bin
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2024, 52 (10): : 3359 - 3367
  • [4] Deep Reinforcement Learning-Driven Reconfigurable Intelligent Surface-Assisted Radio Surveillance With a Fixed-Wing UAV
    Yuan, Xin
    Hu, Shuyan
    Ni, Wei
    Wang, Xin
    Jamalipour, Abbas
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2023, 18 : 4546 - 4560
  • [5] Joint Optimal Placement and Dynamic Resource Allocation for multi-UAV Enhanced Reconfigurable Intelligent Surface Assisted Wireless Network
    Zhang, Yuzhu
    Qian, Lijun
    Xu, Hao
    2023 IEEE 20TH CONSUMER COMMUNICATIONS & NETWORKING CONFERENCE, CCNC, 2023,
  • [6] Aerial Reconfigurable Intelligent Surface-Assisted Secrecy Energy-Efficient Communication Based on Deep Reinforcement Learning
    Zhang, Wenyue
    Zhao, Rui
    Xu, Yichao
    2024 12TH INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTING AND WIRELESS OPTICAL COMMUNICATIONS, ICWOC, 2024, : 60 - 65
  • [7] Joint Multi-UAV Deployment and Resource Allocation based on Personalized Federated Deep Reinforcement Learning
    Xu, Xinyi
    Feng, Gang
    Qin, Shuang
    Liu, Yijing
    Sun, Yao
    ICC 2023-IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, 2023, : 5677 - 5682
  • [8] Resource Allocation in High Dynamic Multi-UAV Networks for Coverage Continuity: A Reinforcement Learning Approach
    Zhou, Chengyi
    Li, Jiandong
    Liu, Junyu
    Sheng, Min
    Zhao, Nan
    2023 INTERNATIONAL CONFERENCE ON FUTURE COMMUNICATIONS AND NETWORKS, FCN, 2023,
  • [9] Reinforcement Learning-based MAC for Reconfigurable Intelligent Surface-Assisted Wireless Sensor Networks
    Ahmed, Faisal
    Shitiri, Ethungshan
    Cho, Ho-Shin
    2022 THIRTEENTH INTERNATIONAL CONFERENCE ON UBIQUITOUS AND FUTURE NETWORKS (ICUFN), 2022, : 253 - 255
  • [10] Multi-Agent Deep Reinforcement Learning for Trajectory Design and Power Allocation in Multi-UAV Networks
    Zhao, Nan
    Liu, Zehua
    Cheng, Yiqiang
    IEEE ACCESS, 2020, 8 : 139670 - 139679