Towards Self-Driving Radios: Physical-Layer Control using Deep Reinforcement Learning

被引:14
作者
Joseph, Samuel [1 ]
Misra, Rakesh [1 ]
Katti, Sachin [1 ]
机构
[1] Stanford Univ, Stanford, CA 94305 USA
来源
HOTMOBILE '19 - PROCEEDINGS OF THE 20TH INTERNATIONAL WORKSHOP ON MOBILE COMPUTING SYSTEMS AND APPLICATIONS | 2019年
关键词
Radios; Physical layer; Cellular networks; Reinforcement learning; Deep learning; LTE; 5G;
D O I
10.1145/3301293.3302374
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Modern radios, such as 5G NewRadio, feature a large set of physicallayer control knobs in order to support an increasing number of communication scenarios spanning multiple use cases, device categories and wireless environments. The challenge however is that each scenario requires a different control algorithm to optimally determine how these knobs are adapted to the varying operating conditions. The traditional approach of manually designing different algorithms for different scenarios is increasingly becoming not just difficult to repeat but also suboptimal for new scenarios that previous-generation radios were not designed for. In this paper, we ask: can we make a radio automatically learn the optimal physical-layer control algorithm for any scenario given only high-level design speciications for the scenario, i.e., can we design a self-driving radio? We describe howrecent advances in deep reinforcement learning can be applied to train a self-driving radio for several illustrative scenarios, and show that such a learning-based approach not only is easily repeatable but also performs closer to optimal than the current state of the art.
引用
收藏
页码:69 / 74
页数:6
相关论文
共 15 条
  • [1] 3GPP, 2018, 38213 3GPP TS
  • [2] 3GPP, 2018, Tech. Rep. 38.211
  • [3] [Anonymous], 2015, Recommendation ITU-R M.2083-0. 1
  • [4] [Anonymous], 2015, BLACKHAT US
  • [5] [Anonymous], 2018, ARXIV180304311
  • [6] Chinchali S., 2018, AAAI C ART INT
  • [7] Daniels R., IEEE EUR WIR C 2010, P718
  • [8] He Y., IEEE INT C COMM ICC, P1
  • [9] Mao H., P SIGCOMM 17 NEW YOR, P197
  • [10] Mismar F., 2017, Q LEARNING ALGORITHM