AIF: An Artificial Intelligence Framework for Smart Wireless Network Management

被引:45
作者
Cao, Gang [1 ]
Lu, Zhaoming [1 ]
Wen, Xiangming [1 ]
Lei, Tao [1 ]
Hu, Zhiqun [1 ]
机构
[1] Beijing Univ Posts & Telecommun, Beijing 100876, Peoples R China
关键词
Smart wireless network; deep learning; reinforcement learning; resource management;
D O I
10.1109/LCOMM.2017.2776917
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
To solve the policy optimizing problem in many scenarios of smart wireless network management using a single universal algorithm, this letter proposes a universal learning framework, which is called AI framework based on deep reinforcement learning (DRL). This framework can also solve the problem that the state is painful to design in traditional RL. This AI framework adopts convolutional neural network and recurrent neural network to model the potential spatial features (i.e., location information) and sequential features from the raw wireless signal automatically. These features can be taken as the state definition of DRL. Meanwhile, this framework is suitable for many scenarios, such as resource management and access control due to DRL. The mean value of throughput, the standard deviation of throughput, and handover counts are used to evaluate its performance on the mobility management problem in the wireless local area network on a practical testbed. The results show that the framework gets significant improvements and learns intuitive features automatically.
引用
收藏
页码:400 / 403
页数:4
相关论文
共 11 条
[1]  
[Anonymous], 2015, Mobile and Wireless Communications Enablers for the Twenty-TwentyInformation Society (METIS)
[2]  
Cao G., 2016, P 13 INT S WIR COMM, P1
[3]  
Dong Xia, 2013, 2013 IEEE International Conference on Communications (ICC), P2223, DOI 10.1109/ICC.2013.6654858
[4]  
Goodfellow L, 2016, DEEP LEARNING
[5]   Optimized Resource Management in Heterogeneous Wireless Networks [J].
Kazmi, S. M. Ahsan ;
Tran, Nguyen H. ;
Saad, Walid ;
Le, Long Bao ;
Ho, Tai Manh ;
Hong, Choong Seon .
IEEE COMMUNICATIONS LETTERS, 2016, 20 (07) :1397-1400
[6]   COGNITIVE RADIO RESOURCE MANAGEMENT FOR FUTURE CELLULAR NETWORKS [J].
Lien, Shao-Yu ;
Chen, Kwang-Cheng ;
Liang, Ying-Chang ;
Lin, Yonghua .
IEEE WIRELESS COMMUNICATIONS, 2014, 21 (01) :70-79
[7]   Human-level control through deep reinforcement learning [J].
Mnih, Volodymyr ;
Kavukcuoglu, Koray ;
Silver, David ;
Rusu, Andrei A. ;
Veness, Joel ;
Bellemare, Marc G. ;
Graves, Alex ;
Riedmiller, Martin ;
Fidjeland, Andreas K. ;
Ostrovski, Georg ;
Petersen, Stig ;
Beattie, Charles ;
Sadik, Amir ;
Antonoglou, Ioannis ;
King, Helen ;
Kumaran, Dharshan ;
Wierstra, Daan ;
Legg, Shane ;
Hassabis, Demis .
NATURE, 2015, 518 (7540) :529-533
[8]   Mastering the game of Go with deep neural networks and tree search [J].
Silver, David ;
Huang, Aja ;
Maddison, Chris J. ;
Guez, Arthur ;
Sifre, Laurent ;
van den Driessche, George ;
Schrittwieser, Julian ;
Antonoglou, Ioannis ;
Panneershelvam, Veda ;
Lanctot, Marc ;
Dieleman, Sander ;
Grewe, Dominik ;
Nham, John ;
Kalchbrenner, Nal ;
Sutskever, Ilya ;
Lillicrap, Timothy ;
Leach, Madeleine ;
Kavukcuoglu, Koray ;
Graepel, Thore ;
Hassabis, Demis .
NATURE, 2016, 529 (7587) :484-+
[9]  
Sun H., 2017, LEARNING OPTIMIZE TR
[10]  
Sutton R., 1999, REINFORCEMENT LEARNI