Toward Interference Suppression: RIS-Aided High-Speed Railway Networks via Deep Reinforcement Learning

被引:12
作者
Xu, Jianpeng [1 ]
Ai, Bo [2 ,3 ,4 ,5 ]
Quek, Tony Q. S. [6 ]
机构
[1] Hebei Univ, Coll Elect & Informat Engn, Baoding 071002, Peoples R China
[2] Beijing Jiaotong Univ, Frontiers Sci Ctr Smart High Speed Railway Syst, State Key Lab Rail Traff Control & Safety, Beijing 100044, Peoples R China
[3] Beijing Jiaotong Univ, Sch Elect & Informat Engn, Beijing 100044, Peoples R China
[4] Res Ctr Networks & Commun, Peng Cheng Lab, Shenzhen 518055, Peoples R China
[5] Zhengzhou Univ, Henan Joint Int Res Lab Intelligent Networking & D, Zhengzhou 450001, Peoples R China
[6] Singapore Univ Technol & Design, Informat Syst Technol & Design Pillar, Singapore 487372, Singapore
基金
新加坡国家研究基金会; 中国国家自然科学基金;
关键词
Reconfigurable intelligent surface (RIS); capacity maximization; interference suppression; high-speed railway (HSR) network; deep reinforcement learning (DRL); RECONFIGURABLE INTELLIGENT SURFACE; WIRELESS COMMUNICATION-SYSTEMS; REFLECTING SURFACE; SECURE TRANSMISSION; POWER ALLOCATION; ROBUST; OPTIMIZATION; MODULATION; CAPACITY; DESIGN;
D O I
10.1109/TWC.2022.3224009
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Providing satisfactory quality of service (QoS) in high-speed railway (HSR) network is being strangled by external interference as well as jamming. To address this issue, we study the reconfigurable intelligent surface (RIS)-aided HSR network, where one RIS is deployed nearby the onboard mobile relay (MR) to suppress the interference as well as jamming in HSR system. Aiming at enhancing the HSR network capacity against the interference, we formulate an optimization problem for designing the phase shifts at the RIS. Since the HSR environment is time-varying and complicated, the optimization problem is challenging to settle. Inspired by the recent advances of deep reinforcement learning (DRL), we propose a deep deterministic policy gradient (DDPG)-based scheme to settle the problem through designing the action space, the state space as well as the reward function. Simulation results present that 1) deploying the RIS nearby the onboard MR is strongly facilitative of suppressing the interference; 2) the proposed DDPG scheme can achieve better capacity than the baseline schemes, and be gradually close to the upper boundary with the number of RIS elements increasing.
引用
收藏
页码:4188 / 4201
页数:14
相关论文
共 39 条
  • [21] Deep Reinforcement Learning Based on Location-Aware Imitation Environment for RIS-Aided mmWave MIMO Systems
    Xu, Wangyang
    An, Jiancheng
    Huang, Chongwen
    Gan, Lu
    Yuen, Chau
    IEEE WIRELESS COMMUNICATIONS LETTERS, 2022, 11 (07) : 1493 - 1497
  • [22] Deep Reinforcement Learning for RIS-Aided Secure Mobile Edge Computing in Industrial Internet of Things
    Xu, Jianpeng
    Xu, Aoshuo
    Chen, Liangyu
    Chen, Yali
    Liang, Xiaolin
    Ai, Bo
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2024, 20 (02) : 2455 - 2464
  • [23] Deep Reinforcement Learning-Based Resource Allocation for Secure RIS-aided UAV Communication
    Iqbal, Amjad
    Al-Habashna, Ala'a
    Wainer, Gabriel
    Bouali, Faouzi
    Boudreau, Gary
    Wali, Khan
    2023 IEEE 98TH VEHICULAR TECHNOLOGY CONFERENCE, VTC2023-FALL, 2023,
  • [24] Deep Reinforcement Learning-Based Downlink Beamforming and Phase Optimization for RIS-Aided Communication System
    Li, Lingjie
    Yang, Yang
    Bao, Lingyan
    Gao, Zhen
    Wu, Yongpeng
    Xiang, Honglin
    IEEE WIRELESS COMMUNICATIONS LETTERS, 2023, 12 (12) : 2263 - 2267
  • [25] Elastic Tracking Operation Method for High-Speed Railway Using Deep Reinforcement Learning
    Zhang, Liqing
    Hou, Leong U.
    Zhou, Mingliang
    Yang, Feiyu
    IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2024, 70 (01) : 3384 - 3391
  • [26] Intelligent Beam Management Based on Deep Reinforcement Learning in High-Speed Railway Scenarios
    Qiao, Yuanyuan
    Niu, Yong
    Zhang, Xiangfei
    Chen, Sheng
    Zhong, Zhangdui
    Wang, Ning
    Ai, Bo
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (03) : 3917 - 3931
  • [27] Reinforcement learning based joint trajectory design and resource allocation for RIS-aided UAV multicast networks
    Ji, Pengshuo
    Jia, Jie
    Chen, Jian
    Guo, Liang
    Du, An
    Wang, Xingwei
    COMPUTER NETWORKS, 2023, 227
  • [28] A Deep Reinforcement Learning-Based Physical Layer Security Enhancement Design for RIS-Aided mmWave Communications With Practical Constraints
    Tu, Qingqing
    Dong, Zheng
    Xie, Chenfei
    Zou, Xianbing
    Wei, Ning
    Li, Ya
    Xu, Fei
    TRANSACTIONS ON EMERGING TELECOMMUNICATIONS TECHNOLOGIES, 2024, 35 (11):
  • [29] Deep reinforcement learning empowered joint mode selection and resource allocation for RIS-aided D2D communications
    Guo, Liang
    Jia, Jie
    Chen, Jian
    Du, An
    Wang, Xingwei
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (25) : 18231 - 18249
  • [30] Deep Reinforcement Learning for Communication and Computing Resource Allocation in RIS Aided MEC Networks
    Xi, Jianpeng
    Ai, Bo
    Chen, Liangyu
    Wu, Lina
    IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2022), 2022, : 3184 - 3189