Power Allocation Based on Reinforcement Learning for MIMO System With Energy Harvesting

被引:13
作者
Mu, Xingchi [1 ]
Zhao, Xiaohui [1 ]
Liang, Hui [1 ]
机构
[1] Jilin Univ, Coll Commun Engn, Changchun 130012, Peoples R China
基金
中国国家自然科学基金;
关键词
Resource management; MIMO communication; Wireless communication; Approximation algorithms; Energy harvesting; Transmitters; Batteries; Power allocation; throughout maximization; reinforcement learning; energy harvesting; multiple-input multiple-output; MASSIVE MIMO; TRANSMISSION; WIRELESS; NETWORKS; SECURITY;
D O I
10.1109/TVT.2020.2993275
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper focuses on the use of a reinforcement learning (RL) approach to find two online power allocation policies in a point to point EH-MIMO wireless communication system. In our study, we train the power allocation policies in order to learn the map between the environment and the agent. Particularly, in order to avoid "dimension disaster" problem which may happen in our proposed SARSA power allocation policy, we introduce a linear approximation method to get an approximate SARSA power allocation policy. The linear approximation can handle infinite number of states and trade-off between complexity and performance of power allocation is significantly improved. The simulation results show that the proposed SARSA and approximate SARSA power allocation policies have a considerable throughput increase compared with the benchmark policies, such as greedy, random and conservative policies.
引用
收藏
页码:7622 / 7633
页数:12
相关论文
共 40 条
[1]  
[Anonymous], 2014, Markov decision processes: discrete stochastic dynamic programming
[2]  
[Anonymous], 2016, P IEEE ICC
[3]  
[Anonymous], 1998, INTRO REINFORCEMENT
[4]  
Bai Q, 2013, 2013 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), P4232
[5]  
Bathurst JN, 2018, IEEE RAD CONF, P316, DOI 10.1109/RADAR.2018.8378577
[6]   Massive MIMO Has Unlimited Capacity [J].
Bjornson, Emil ;
Hoydis, Jakob ;
Sanguinetti, Luca .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2018, 17 (01) :574-590
[7]   A Learning Theoretic Approach to Energy Harvesting Communication System Optimization [J].
Blasco, Pol ;
Guenduez, Deniz ;
Dohler, Mischa .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2013, 12 (04) :1872-1882
[8]   Communicating or Computing Over the MAC: Function-Centric Wireless Networks [J].
Chen, Li ;
Zhao, Nan ;
Chen, Yunfei ;
Yu, F. Richard ;
Wei, Guo .
IEEE TRANSACTIONS ON COMMUNICATIONS, 2019, 67 (09) :6127-6138
[9]   Over-the-Air Computation for IoT Networks: Computing Multiple Functions With Antenna Arrays [J].
Chen, Li ;
Zhao, Nan ;
Chen, Yunfei ;
Yu, F. Richard ;
Wei, Guo .
IEEE INTERNET OF THINGS JOURNAL, 2018, 5 (06) :5296-5306
[10]   Q-learning algorithms for constrained Markov decision processes with randomized monotone policies:: Application to MIMO transmission control [J].
Djonin, Dejan V. ;
Krishnamurthy, Vikram .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2007, 55 (05) :2170-2181