Meta Reinforcement Learning for Resource Allocation in Aerial Active-RIS-Assisted Networks With Rate-Splitting Multiple Access

被引:12
作者
Faramarzi, Sajad [1 ]
Javadi, Sepideh [2 ]
Zeinali, Farshad [2 ]
Zarini, Hosein [3 ]
Mili, Mohammad Robat [2 ,4 ]
Bennis, Mehdi [6 ]
Li, Yonghui [5 ]
Wong, Kai-Kit [6 ,7 ]
机构
[1] Iran Univ Sci & Technol, Sch Elect Engn, Tehran 1684613114, Iran
[2] Pasargad Inst Adv Innovat Solut, Dept Comp & Elect Engn, Tehran 1991633361, Iran
[3] Sharif Univ Technol, Dept Comp Engn, Tehran 111559466, Iran
[4] Univ Oulu, Dept Elect Engn, Oulu 90570, Finland
[5] Univ Sydney, Sch Elect & Informat Engn, Sydney, NSW 2006, Australia
[6] UCL, Dept Elect & Elect Engn, London WC1E 7JE, England
[7] Yonsei Univ, Yonsei Frontier Lab, Seoul 03722, South Korea
基金
英国工程与自然科学研究理事会;
关键词
Autonomous aerial vehicles; Resource management; NOMA; Power demand; Interference; Heuristic algorithms; Array signal processing; Aerial active reconfigurable intelligent surface (AARIS); deep reinforcement learning (DRL); energy efficiency (EE); meta-learning; rate-splitting multiple access (RSMA); RIS; RECONFIGURABLE INTELLIGENT SURFACE; ENERGY EFFICIENCY; UAV; DESIGN; OPTIMIZATION;
D O I
10.1109/JIOT.2024.3397007
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Mounting a reconfigurable intelligent surface (RIS) on an unmanned aerial vehicle (UAV) holds promise for improving traditional terrestrial network performance. Unlike conventional methods deploying the passive RIS on UAVs, this study delves into the efficacy of an aerial active RIS (AARIS). Specifically, the downlink transmission of an AARIS network is investigated, where the base station (BS) leverages rate-splitting multiple access (RSMA) for effective interference management and benefits from the support of an AARIS for jointly amplifying and reflecting the BS's transmit signals. Considering both the nontrivial energy consumption of the active RIS and the limited energy storage of the UAV, we propose an innovative element selection strategy for optimizing the on/off status of active RIS elements, which adaptively and remarkably manages the system's power consumption. To this end, a resource management problem is formulated, aiming to maximize the system energy efficiency (EE) by jointly optimizing the transmit beamforming at the BS, the element activation, the phase shift and the amplification factor at the active RIS, the RSMA common data rate at users, as well as the UAV's trajectory. Due to the dynamicity nature of the UAV and user mobility, a deep reinforcement learning (DRL) algorithm is designed for resource allocation, utilizing meta-learning to adaptively handle fast time-varying system dynamics. According to simulations, integrating meta-learning yields a notable 36% increase in the system EE. Additionally, substituting AARIS for fixed terrestrial active RIS results in a 26% EE enhancement.
引用
收藏
页码:26366 / 26383
页数:18
相关论文
共 54 条
[1]   BACKPROPAGATION AND STOCHASTIC GRADIENT DESCENT METHOD [J].
AMARI, S .
NEUROCOMPUTING, 1993, 5 (4-5) :185-196
[2]   Reinforcement Learning for Energy-Efficient Trajectory Design of UAVs [J].
Arani, Atefeh Hajijamali ;
Azari, M. Mahdi ;
Hu, Peng ;
Zhu, Yeying ;
Yanikomeroglu, Halim ;
Safavi-Naeini, Safieddin .
IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (11) :9060-9070
[3]   RIS Selection Scheme for UAV-Based Multi-RIS-Aided Multiuser Downlink Network With Imperfect and Outdated CSI [J].
Bansal, Ankur ;
Agrawal, Neelima ;
Singh, Keshav ;
Li, Chih-Peng ;
Mumtaz, Shahid .
IEEE TRANSACTIONS ON COMMUNICATIONS, 2023, 71 (08) :4650-4664
[4]   Resource Allocation and 3D Trajectory Design for Power-Efficient IRS-Assisted UAV-NOMA Communications [J].
Cai, Yuanxin ;
Wei, Zhiqiang ;
Hu, Shaokang ;
Liu, Chang ;
Ng, Derrick Wing Kwan ;
Yuan, Jinhong .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2022, 21 (12) :10315-10334
[5]   Massive Access for 5G and Beyond [J].
Chen, Xiaoming ;
Ng, Derrick Wing Kwan ;
Yu, Wei ;
Larsson, Erik G. ;
Al-Dhahir, Naofal ;
Schober, Robert .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2021, 39 (03) :615-637
[6]   A Primer on Rate-Splitting Multiple Access: Tutorial, Myths, and Frequently Asked Questions [J].
Clerckx, Bruno ;
Mao, Yijie ;
Jorswieck, Eduard A. ;
Yuan, Jinhong ;
Love, David J. ;
Erkip, Elza ;
Niyato, Dusit .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2023, 41 (05) :1265-1308
[7]  
Dongfang Xu, 2021, 2021 55th Asilomar Conference on Signals, Systems, and Computers, P113, DOI 10.1109/IEEECONF53345.2021.9723093
[8]   Beamforming for STAR-RIS-Aided Integrated Sensing and Communication Using Meta DRL [J].
Eghbali, Yasoub ;
Faramarzi, Sajad ;
Taskou, Shiva Kazemi ;
Mili, Mohammad Robat ;
Rasti, Mehdi ;
Hossain, Ekram .
IEEE WIRELESS COMMUNICATIONS LETTERS, 2024, 13 (04) :919-923
[9]  
Finn C, 2017, PR MACH LEARN RES, V70
[10]  
Fujimoto S, 2018, PR MACH LEARN RES, V80