Throughput Maximization in NOMA Enhanced RIS-Assisted Multi-UAV Networks: A Deep Reinforcement Learning Approach

被引:1
作者
Tang, Runzhi [1 ]
Wang, Junxuan [1 ]
Zhang, Yanyan [1 ]
Jiang, Fan [1 ]
Zhang, Xuewei [1 ]
Du, Jianbo [1 ]
机构
[1] Xian Univ Posts & Telecommun, Sch Commun & Informat Engn, Xian 710121, Peoples R China
基金
中国国家自然科学基金;
关键词
Autonomous aerial vehicles; NOMA; Trajectory; Throughput; Reconfigurable intelligent surfaces; Optimization; Resource management; UAV communications; non-orthogonal multiple access; deep reinforcement learning; reconfigurable intelligent surface; TRAJECTORY DESIGN; COMMUNICATION; ACCESS; ALLOCATION; 5G; OPTIMIZATION; PERFORMANCE; EFFICIENT; SYSTEMS;
D O I
10.1109/TVT.2024.3452979
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this paper, a novel reconfigurable intelligent surface (RIS) aided communication system with multiple unmanned aerial vehicles (UAVs) is investigated. To achieve better system performance, we employ the non-orthogonal multiple access (NOMA) technique, and consider imperfect successive interference cancellation (SIC) at each user equipment (UE). To maximize the system throughput, we jointly optimize the three-dimensional (3D) trajectories of UAVs, the power allocation strategy, and the phase shift of the RIS. Due to the movement of UEs and UAVs, the formulated problem is difficult to solve. To address the formulated problem, we propose a two-step approach, named throughput maximization by trajectories design, power allocation and phase shift optimization (TM-TDPAPO). Specifically, a K-means based UE clustering algorithm is adopted to group UEs. Then, a double deep Q-network (DDQN) approach is utilized to deal with the formulated problem. Extensive simulations are conducted, and results demonstrate that: (1) the TM-TDPAPO algorithm is effective in improving the system throughput, especially, the proposed approach achieves approximately 57$\%$ higher throughput gain compared to the conventional DQN algorithm; (2) by applying the imperfect SIC at each UE, the proposed scheme yields 23$\%$ performance gain than orthogonal multiple access (OMA) case; (3) the considered system with the deployment of RIS benefits from 29$\%$ throughput gain over the system without RIS.
引用
收藏
页码:730 / 745
页数:16
相关论文
共 48 条
[1]  
3GPP, 2018, 36777 3GPP TR
[2]   Down-Link NOMA Networks in the Presence of IQI and Imperfect SIC: Receiver Design and Performance Analysis [J].
Alsmadi, Malek M. ;
Abu Ali, Najah ;
Hayajneh, Mohammed ;
Ikki, Salama S. .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2020, 69 (06) :6793-6797
[3]   Lyapunov-Guided Deep Reinforcement Learning for Stable Online Computation Offloading in Mobile-Edge Computing Networks [J].
Bi, Suzhi ;
Huang, Liang ;
Wang, Hui ;
Zhang, Ying-Jun Angela .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (11) :7519-7537
[4]   Energy-Efficient Optimization Scheme for RIS-Assisted Communication Underlaying UAV with NOMA [J].
Budhiraja, Ishan ;
Vishnoi, Vineet ;
Kumar, Neeraj ;
Garg, Deepak ;
Tyagi, Sudhanshu .
IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2022), 2022,
[5]   Resource Allocation and 3D Trajectory Design for Power-Efficient IRS-Assisted UAV-NOMA Communications [J].
Cai, Yuanxin ;
Wei, Zhiqiang ;
Hu, Shaokang ;
Liu, Chang ;
Ng, Derrick Wing Kwan ;
Yuan, Jinhong .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2022, 21 (12) :10315-10334
[6]   Multidimensional Signal Space Non-Orthogonal Multiple Access With Imperfect SIC: A Novel SIC Reduction Technique [J].
Chauhan, Ankita ;
Jaiswal, Anshul .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (02) :2374-2389
[7]   Joint Optimization of Trajectory and User Association via Reinforcement Learning for UAV-Aided Data Collection in Wireless Networks [J].
Chen, Gong ;
Zhai, Xiangping Bryce ;
Li, Congduan .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2023, 22 (05) :3128-3143
[8]   Unsupervised Machine Learning-Based User Clustering in Millimeter-Wave-NOMA Systems [J].
Cui, Jingjing ;
Ding, Zhiguo ;
Fan, Pingzhi ;
Al-Dhahir, Naofal .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2018, 17 (11) :7425-7440
[9]   A Survey of Non-Orthogonal Multiple Access for 5G [J].
Dai, Linglong ;
Wang, Bichai ;
Ding, Zhiguo ;
Wang, Zhaocheng ;
Chen, Sheng ;
Hanzo, Lajos .
IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2018, 20 (03) :2294-2323
[10]   Unmanned-Aerial-Vehicle-Assisted Wireless Networks: Advancements, Challenges, and Solutions [J].
Dai, Minghui ;
Huang, Ning ;
Wu, Yuan ;
Gao, Jie ;
Su, Zhou .
IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (05) :4117-4147