Deep Reinforcement Learning Based Intelligent Reflecting Surface Optimization for MISO Communication Systems

被引:267
作者
Feng, Keming [1 ]
Wang, Qisheng [1 ]
Li, Xiao [1 ]
Wen, Chao-Kai [2 ]
机构
[1] Southeast Univ, Natl Mobile Commun Res Lab, Nanjing 210096, Peoples R China
[2] Natl Sun Yat Sen Univ, Inst Commun Engn, Kaohsiung 80424, Taiwan
基金
中国国家自然科学基金;
关键词
Signal to noise ratio; Reinforcement learning; Training; Wireless communication; MISO communication; Optimization; Complexity theory; Intelligent reflecting surface; non-convex optimization; deep reinforcement learning; phase shift design;
D O I
10.1109/LWC.2020.2969167
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This letter investigates the intelligent reflecting surface (IRS)-aided multiple-input single-output wireless transmission system. Particularly, the optimization of the passive phase shift of each element at IRS to maximize the downlink received signal-to-noise ratio is considered. Inspired by the huge success of deep reinforcement learning (DRL) on resolving complicated control problems, we develop a DRL based framework to solve this non-convex optimization problem. Numerical results reveal that the proposed DRL based framework can achieve almost the upper bound of the received SNR with relatively low time consumption.
引用
收藏
页码:745 / 749
页数:5
相关论文
共 16 条
[1]  
Abeywickrama S., 2019, INTELLIGENT REFLECTI
[2]  
[Anonymous], 2015, COMPUTER SCI
[3]  
Cao Y., 2019, INTELLIGENT REFLECTI
[4]   Large Intelligent Surface-Assisted Wireless Communication Exploiting Statistical CSI [J].
Han, Yu ;
Tang, Wankai ;
Jin, Shi ;
Wen, Chao-Kai ;
Ma, Xiaoli .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2019, 68 (08) :8238-8242
[5]  
Huang C., 2019, INDOOR SIGNAL FOCUSI
[6]   Statistical 3-D Beamforming for Large-Scale MIMO Downlink Systems Over Rician Fading Channels [J].
Li, Xiao ;
Jin, Shi ;
Suraweera, Himal A. ;
Hou, Jia ;
Gao, Xiqi .
IEEE TRANSACTIONS ON COMMUNICATIONS, 2016, 64 (04) :1529-1543
[7]   Human-level control through deep reinforcement learning [J].
Mnih, Volodymyr ;
Kavukcuoglu, Koray ;
Silver, David ;
Rusu, Andrei A. ;
Veness, Joel ;
Bellemare, Marc G. ;
Graves, Alex ;
Riedmiller, Martin ;
Fidjeland, Andreas K. ;
Ostrovski, Georg ;
Petersen, Stig ;
Beattie, Charles ;
Sadik, Amir ;
Antonoglou, Ioannis ;
King, Helen ;
Kumaran, Dharshan ;
Wierstra, Daan ;
Legg, Shane ;
Hassabis, Demis .
NATURE, 2015, 518 (7540) :529-533
[8]   Guidelines for the prevention of intravascular catheter-related infections [J].
O'Grady, NP ;
Alexander, M ;
Dellinger, EP ;
Gerberding, JL ;
Heard, SO ;
Maki, DG ;
Masur, H ;
McCormick, RD ;
Mermel, LA ;
Pearson, ML ;
Raad, II ;
Randolph, A ;
Weinstein, RA .
INFECTION CONTROL AND HOSPITAL EPIDEMIOLOGY, 2002, 23 (12) :759-769
[9]   Affective learning - a manifesto [J].
Picard, RW ;
Papert, S ;
Bender, W ;
Blumberg, B ;
Breazeal, C ;
Cavallo, D ;
Machover, T ;
Resnick, M ;
Roy, D ;
Strohecker, C .
BT TECHNOLOGY JOURNAL, 2004, 22 (04) :253-269
[10]  
Sutton RS, 2000, ADV NEUR IN, V12, P1057