Toward Interference Suppression: RIS-Aided High-Speed Railway Networks via Deep Reinforcement Learning

被引:12
作者
Xu, Jianpeng [1 ]
Ai, Bo [2 ,3 ,4 ,5 ]
Quek, Tony Q. S. [6 ]
机构
[1] Hebei Univ, Coll Elect & Informat Engn, Baoding 071002, Peoples R China
[2] Beijing Jiaotong Univ, Frontiers Sci Ctr Smart High Speed Railway Syst, State Key Lab Rail Traff Control & Safety, Beijing 100044, Peoples R China
[3] Beijing Jiaotong Univ, Sch Elect & Informat Engn, Beijing 100044, Peoples R China
[4] Res Ctr Networks & Commun, Peng Cheng Lab, Shenzhen 518055, Peoples R China
[5] Zhengzhou Univ, Henan Joint Int Res Lab Intelligent Networking & D, Zhengzhou 450001, Peoples R China
[6] Singapore Univ Technol & Design, Informat Syst Technol & Design Pillar, Singapore 487372, Singapore
基金
中国国家自然科学基金; 新加坡国家研究基金会;
关键词
Reconfigurable intelligent surface (RIS); capacity maximization; interference suppression; high-speed railway (HSR) network; deep reinforcement learning (DRL); RECONFIGURABLE INTELLIGENT SURFACE; WIRELESS COMMUNICATION-SYSTEMS; REFLECTING SURFACE; SECURE TRANSMISSION; POWER ALLOCATION; ROBUST; OPTIMIZATION; MODULATION; CAPACITY; DESIGN;
D O I
10.1109/TWC.2022.3224009
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Providing satisfactory quality of service (QoS) in high-speed railway (HSR) network is being strangled by external interference as well as jamming. To address this issue, we study the reconfigurable intelligent surface (RIS)-aided HSR network, where one RIS is deployed nearby the onboard mobile relay (MR) to suppress the interference as well as jamming in HSR system. Aiming at enhancing the HSR network capacity against the interference, we formulate an optimization problem for designing the phase shifts at the RIS. Since the HSR environment is time-varying and complicated, the optimization problem is challenging to settle. Inspired by the recent advances of deep reinforcement learning (DRL), we propose a deep deterministic policy gradient (DDPG)-based scheme to settle the problem through designing the action space, the state space as well as the reward function. Simulation results present that 1) deploying the RIS nearby the onboard MR is strongly facilitative of suppressing the interference; 2) the proposed DDPG scheme can achieve better capacity than the baseline schemes, and be gradually close to the upper boundary with the number of RIS elements increasing.
引用
收藏
页码:4188 / 4201
页数:14
相关论文
共 39 条
[31]   Deep Reinforcement Learning Based Joint Downlink Beamforming and RIS Configuration in RIS-aided MU-MISO Systems Under Hardware Impairments and Imperfect CSI [J].
Saglam, Baturay ;
Gurgunoglu, Doga ;
Kozat, Suleyman S. .
2023 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS WORKSHOPS, ICC WORKSHOPS, 2023, :66-72
[32]   Information Timeliness Driven Statistical QoS Guarantee in RIS-Enabled Wireless Networks via Deep Reinforcement Learning [J].
Liu, Long ;
Qin, Xiaoqi ;
Chen, Hao ;
Xu, Xiaodong ;
Ma, Nan ;
Zhang, Ping .
IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (14) :25185-25197
[33]   Deep reinforcement learning empowered joint mode selection and resource allocation for RIS-aided D2D communications [J].
Liang Guo ;
Jie Jia ;
Jian Chen ;
An Du ;
Xingwei Wang .
Neural Computing and Applications, 2023, 35 :18231-18249
[34]   Reinforcement-Learning-Based Offloading for RIS-Aided Cloud-Edge Computing in IoT Networks: Modeling, Analysis, and Optimization [J].
Zhang, Tiantian ;
Xu, Dongyang ;
Tolba, Amr ;
Yu, Keping ;
Song, Houbing ;
Yu, Shui .
IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (11) :19421-19439
[35]   Cooperative Hierarchical Deep Reinforcement Learning-Based Joint Sleep and Power Control in RIS-Aided Energy-Efficient RAN [J].
Zhou, Hao ;
Elsayed, Medhat ;
Bavand, Majid ;
Gaigalas, Raimundas ;
Furr, Steve ;
Erol-Kantarci, Melike .
IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2025, 11 (01) :489-504
[36]   Experience-Driven Power Allocation Using Multi-Agent Deep Reinforcement Learning for Millimeter-Wave High-Speed Railway Systems [J].
Xu, Jianpeng ;
Ai, Bo .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (06) :5490-5500
[37]   A deep learning-based model for High-Speed Users' Mobility Prediction in Small Cell and Femtocell Networks [J].
Khoa Dinh Nguyen Dang ;
Fazio, Peppino ;
Voznak, Miroslav .
2021 29TH TELECOMMUNICATIONS FORUM (TELFOR), 2021,
[38]   Harmonics suppression in high-speed railway via single-phase traction converter with an LCL filter using fuzzy logic control strategy [J].
Aissaoui, M. ;
Bouzeria, H. ;
Benidir, M. ;
Labed, M. A. .
ELECTRICAL ENGINEERING & ELECTROMECHANICS, 2024, (02) :16-22
[39]   A Hybrid Optimization Approach Combining Rolling Horizon with Deep-Learning-Embedded NSGA-II Algorithm for High-Speed Railway Train Rescheduling Under Interruption Conditions [J].
Zhao, Wenqiang ;
Zhou, Leishan ;
Han, Chang .
SUSTAINABILITY, 2025, 17 (06)