Power Allocation in Multi-cell Networks Using Deep Reinforcement Learning

被引:0
作者
Zhang, Yong [1 ]
Kang, Canping [1 ]
Ma, Tengteng [1 ]
Teng, Yinglei [1 ]
Guo, Da [1 ]
机构
[1] Beijing Univ Posts & Telecommun, Sch Elect Engn, Beijing, Peoples R China
来源
2018 IEEE 88TH VEHICULAR TECHNOLOGY CONFERENCE (VTC-FALL) | 2018年
基金
中国国家自然科学基金;
关键词
Deep Learning; Reinforcement Learning; Power allocation; resource allocation; multi-cell networks; power control;
D O I
暂无
中图分类号
U [交通运输];
学科分类号
08 ; 0823 ;
摘要
In this paper, multi-cell power allocation approach is researched. Different from the traditional optimization decomposition method, Deep Reinforcement Learning (DRL) method is employed to solve the power allocation issue which is an NP-hard problem. The objective of our work is to maximize the overall capacity of the entire network in the scenario where the base stations are randomly and densely distributed. We propose a wireless resource mapping method and a deep neural network for multi-cell power allocation named as Deep Q -Full-Connected-Network (DQFCNet). Compared with the water-filling power allocation and Q-learning method, DQFCNet can achieve a higher overall capacity. Furthermore, the simulation results show that DQFCNet has significant improvement in convergence speed and stability.
引用
收藏
页数:6
相关论文
共 19 条
[1]   A Survey of Self Organisation in Future Cellular Networks [J].
Aliu, Osianoh Glenn ;
Imran, Ali ;
Imran, Muhammad Ali ;
Evans, Barry .
IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2013, 15 (01) :336-361
[2]  
[Anonymous], 2014, P IEEE S COMP COMM I
[3]  
[Anonymous], 2018, DEEP LEARNING MOBILE
[4]  
[Anonymous], 2 IFIP WIRELESS DAYS
[5]  
Burkov Andriy, 2010, DRAA
[6]  
Kingma D. P., P 3 INT C LEARN REPR
[7]   Energy-Efficient Joint Scheduling and Power Control in Multi-Cell Wireless Networks [J].
Lahoud, Samer ;
Khawam, Kinda ;
Martin, Steven ;
Feng, Gang ;
Liang, Zhewen ;
Nasreddine, Jad .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2016, 34 (12) :3409-3426
[8]   Human-level control through deep reinforcement learning [J].
Mnih, Volodymyr ;
Kavukcuoglu, Koray ;
Silver, David ;
Rusu, Andrei A. ;
Veness, Joel ;
Bellemare, Marc G. ;
Graves, Alex ;
Riedmiller, Martin ;
Fidjeland, Andreas K. ;
Ostrovski, Georg ;
Petersen, Stig ;
Beattie, Charles ;
Sadik, Amir ;
Antonoglou, Ioannis ;
King, Helen ;
Kumaran, Dharshan ;
Wierstra, Daan ;
Legg, Shane ;
Hassabis, Demis .
NATURE, 2015, 518 (7540) :529-533
[9]   Graph-Based Multicell Scheduling in OFDMA-Based Small Cell Networks [J].
Pateromichelakis, Emmanouil ;
Shariat, Mehrdad ;
Quddus, Atta Ul ;
Tafazolli, Rahim .
IEEE ACCESS, 2014, 2 :897-908
[10]  
Saad H, 2014, IEEE WCNC, P1490, DOI 10.1109/WCNC.2014.6952410