Deep Reinforcement Learning and Graph Neural Networks for Efficient Resource Allocation in 5G Networks

被引:2
作者
Randall, Martin [1 ,2 ]
Belzarena, Pablo [1 ]
Larroca, Federico [1 ]
Casas, Pedro [2 ]
机构
[1] Univ la Republ, Fac Ingn, Inst Ingn Elect, Montevideo, Uruguay
[2] Austrian Inst Technol, AIT, Vienna, Austria
来源
2022 IEEE LATIN-AMERICAN CONFERENCE ON COMMUNICATIONS (LATINCOM) | 2022年
关键词
User Association; Mobile Networks; Reinforcement Learning; Graph Neural Networks; USER ASSOCIATION; MANAGEMENT;
D O I
10.1109/LATINCOM56090.2022.10000511
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The increased sophistication of mobile networks such as 5G and beyond, and the plethora of devices and novel use cases to be supported by these networks, make of the already complex problem of resource allocation in wireless networks a paramount challenge. We address the specific problem of user association, a largely explored yet open resource allocation problem in wireless systems. We introduce GROWS, a deep reinforcement learning (DRL) driven approach to efficiently assign mobile users to base stations, which combines a well-known extension of Deep Q Networks (DQNs) with Graph Neural Networks (GNNs) to better model the function of expected rewards. We show how GROWS can learn a user association policy which improves over currently applied assignation heuristics, as well as compared against more traditional Q-learning approaches, improving utility by more than 10%, while reducing user rejections up to 20%.
引用
收藏
页数:6
相关论文
共 35 条
[1]  
Almasan P., 2019, arXiv
[2]  
[Anonymous], 2006, Proceedings IEEE INFOCOM 2006. 25TH IEEE International Conference on Computer Communications
[3]   Handover scheme for 5G small cell networks with non-orthogonal multiple access [J].
Calhan, Ali ;
Cicioglu, Murtaza .
COMPUTER NETWORKS, 2020, 183 (183)
[4]   Unfolding WMMSE Using Graph Neural Networks for Efficient Power Allocation [J].
Chowdhury, Arindam ;
Verma, Gunjan ;
Rao, Chirag ;
Swami, Ananthram ;
Segarra, Santiago .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (09) :6004-6017
[5]  
Cranmer M, 2020, PR MACH LEARN RES, V148, P272
[6]   Multi-Agent Reinforcement Learning-Based Resource Allocation for UAV Networks [J].
Cui, Jingjing ;
Liu, Yuanwei ;
Nallanathan, Arumugam .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2020, 19 (02) :729-743
[7]  
Dai HJ, 2017, ADV NEUR IN, V30
[8]   Optimal Wireless Resource Allocation With Random Edge Graph Neural Networks [J].
Eisen, Mark ;
Ribeiro, Alejandro .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2020, 68 :2977-2991
[9]   Learning Optimal Resource Allocations in Wireless Systems [J].
Eisen, Mark ;
Zhang, Clark ;
Chamon, Luiz F. O. ;
Lee, Daniel D. ;
Ribeiro, Alejandro .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2019, 67 (10) :2775-2790
[10]   Downlink and Uplink Cell Association With Traditional Macrocells and Millimeter Wave Small Cells [J].
Elshaer, Hisham ;
Kulkarni, Mandar N. ;
Boccardi, Federico ;
Andrews, Jeffrey G. ;
Dohler, Mischa .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2016, 15 (09) :6244-6258