Meta Reinforcement Learning-Based Spectrum Sharing Between RIS-Assisted Cellular Communications and MIMO Radar

被引:2
|
作者
Saikia, Prajwalita [1 ]
Singh, Keshav [1 ]
Taghizadeh, Omid [2 ]
Huang, Wan-Jen [1 ]
Biswas, Sudip [3 ]
机构
[1] Natl Sun Yat Sen Univ, Inst Commun Engn, Kaohsiung 804, Taiwan
[2] Lenovo Deutschland GmbH, 5G Wireless Res Grp, D-70563 Stuttgart, Germany
[3] Indian Inst Informat Technol Guwahati, Dept Elect & Commun Engn, Gauhati 781015, India
关键词
Radar; Interference; Optimization; MIMO radar; Communication systems; Heuristic algorithms; Wireless communication; Meta reinforcement learning (MRL); multiple-input multiple-output (MIMO); spectrum sharing; reconfigurable intelligent surface (RIS); SYSTEMS; DESIGN; COEXISTENCE; TRACKING; ACCESS;
D O I
10.1109/TCCN.2023.3319543
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
New wireless networks together with fixed spectrum allocation have resulted in spectrum paucity, which has led to the idea of spectrum sharing between radar and communication systems. In this work, we consider a spectrum-sharing framework between a reconfigurable intelligent surface (RIS)-assisted cellular system and a multiple-input multiple-output (MIMO) radar and investigate its performance. In particular, we formulate an optimization problem to jointly optimize the communication transmit precoder matrix, RIS phase shift matrix, and transmit waveform of radar while maintaining the operational fairness of the proposed system, including the limitation on permissible interference towards the radar system. Thereafter, to address the non-convexity of the problem, we propose a low-complexity meta-reinforcement learning (MRL) algorithm that solves the problem in continuous action spaces by reducing the overall training overhead. Exhaustive simulation results are presented that demonstrate the benefit of using the MRL algorithm for the proposed spectrum-sharing framework along with the utility of the deployment of RIS in terms of controlling the interference from the base station to the radar. It is also shown that the proposed MRL technique outperforms traditional block coordinate descent (BCD)-based solutions, meta-heuristic approaches and other reinforcement learning (RL) algorithms such as twin delayed deep deterministic (TD3) and deep deterministic policy gradient (DDPG).
引用
收藏
页码:164 / 179
页数:16
相关论文
共 50 条
  • [31] Joint Beamforming for RIS-Assisted Hybrid MIMO Systems Based on Model-Driven Deep Learning
    Hu, Peiqi
    Zhang, Jing
    Jin, Weijie
    Wen, Chao-Kai
    Jin, Shi
    2024 IEEE/CIC INTERNATIONAL CONFERENCE ON COMMUNICATIONS IN CHINA, ICCC, 2024,
  • [32] A Geometry-Based RIS-Assisted Multi-User Channel Model with Deep Reinforcement Learning
    Yuan, Yuan
    He, Ruisi
    Ai, Bo
    Wu, Tong
    Chen, Ruifeng
    Zhang, Zhengyu
    Jin, Yunwei
    Zhong, Zhangdui
    2024 IEEE 99TH VEHICULAR TECHNOLOGY CONFERENCE, VTC2024-SPRING, 2024,
  • [33] Deep Reinforcement Learning based Joint Active and Passive Beamforming Design for RIS-Assisted MISO Systems
    Zhu, Yuqian
    Bo, Zhu
    Li, Ming
    Liu, Yang
    Liu, Qian
    Chang, Zheng
    Hu, Yulin
    2022 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2022, : 477 - 482
  • [34] Efficient exploration in reinforcement learning-based cognitive radio spectrum sharing
    Jiang, T.
    Grace, D.
    Mitchell, P. D.
    IET COMMUNICATIONS, 2011, 5 (10) : 1309 - 1317
  • [35] Energy Efficiency Maximization for RIS-Assisted MISO Symbiotic Radio Systems Based on Deep Reinforcement Learning
    Cao, Kaitian
    Tang, Qi
    IEEE COMMUNICATIONS LETTERS, 2024, 28 (01) : 88 - 92
  • [36] Penalized Reinforcement Learning-Based Energy-Efficient UAV-RIS Assisted Maritime Uplink Communications Against Jamming
    Lin, Kailong
    Yang, Helin
    Zheng, Mengting
    Xiao, Liang
    Huang, Chongwen
    Niyato, Dusit
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (10) : 15768 - 15773
  • [37] A 3D Geometry-Based Non-Stationary MIMO Channel Model for RIS-Assisted Communications
    Sun, Guiqi
    He, Ruisi
    Ma, Zhangfeng
    Ai, Bo
    Zhong, Zhangdui
    2021 IEEE 94TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2021-FALL), 2021,
  • [38] Efficient Two-Level Block-Structured Sparse Bayesian Learning-Based Channel Estimation for RIS-Assisted MIMO IoT Systems
    Chen, Jianqiao
    Ma, Nan
    Xu, Xiaodong
    Qin, Xiaoqi
    Li, Ya
    Zhang, Ping
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (14): : 24933 - 24947
  • [39] Unsupervised Learning-Based Joint Precoding and Phase Shift Design for RIS-Assisted mmWave Communication Systems
    Jiao, Yang
    Han, Yu
    Li, Xiao
    Jin, Shi
    2022 14TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS AND SIGNAL PROCESSING, WCSP, 2022, : 303 - 308
  • [40] Max-Min Fairness in RIS-Assisted Anti-Jamming Communications: Optimization Versus Deep Reinforcement Learning Approaches
    Liu, Jun
    Yang, Gang
    Liang, Ying-Chang
    Yuen, Chau
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2024, 72 (07) : 4476 - 4492