Resource Allocation and User Association Using Reinforcement Learning via Curriculum in a Wireless Network with High User Mobility

被引:7
作者
Kim, Dong Uk [1 ]
Park, Seong Bae [1 ]
Hong, Choong Seon [1 ]
Huh, Eui Nam [1 ]
机构
[1] Kyung Hee Univ, Dept Comp Sci & Engn, Yongin 446701, South Korea
来源
2023 INTERNATIONAL CONFERENCE ON INFORMATION NETWORKING, ICOIN | 2023年
基金
新加坡国家研究基金会;
关键词
wireless networks; user mobility; resource allocation; user association; deep reinforcement learning; curriculum learning;
D O I
10.1109/ICOIN56518.2023.10048927
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the rapid development of wireless networks and artificial intelligence technologies, various applications in mobile networks have emerged. Especially when the user's mobility is high, such as Internet of Vehicles, Resource allocation is more complex, and handover issues also occur more frequently. In addition, the problem of resource allocation in wireless networks is known as the NP-Hard problem. Using reinforcement learning to solve this problem is a promising solution. However, designing a reward function is very difficult, and an incorrect design of the reward function can lead to entirely unexpected results. In this paper, we propose a curriculum learning technique to solve the above problem so that the reinforcement learning agent can learn more accurately. We made the model learn accurately by sequentially increasing the mobility of each user during learning. The proposed method demonstrates a faster convergence rate and better performance.
引用
收藏
页码:382 / 386
页数:5
相关论文
共 10 条
[1]  
Ahmadi S, 2019, 5G NR: ARCHITECTURE, TECHNOLOGY, IMPLEMENTATION, AND OPERATION OF 3GPP NEW RADIO STANDARDS, P1
[2]  
Ariyakhajorn J, 2006, 2006 INTERNATIONAL SYMPOSIUM ON COMMUNICATIONS AND INFORMATION TECHNOLOGIES,VOLS 1-3, P79
[3]   Federated Deep Reinforcement Learning for User Access Control in Open Radio Access Networks [J].
Cao, Yang ;
Lien, Shao-Yu ;
Liang, Ying-Chang ;
Chen, Kwang-Cheng .
IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2021), 2021,
[4]  
Heess N, 2017, Arxiv, DOI [arXiv:1707.02286, 10.48550/arXiv.1707.02286]
[5]   Mobility Support for Millimeter Wave Communications: Opportunities and Challenges [J].
Li, Jing ;
Niu, Yong ;
Wu, Hao ;
Ai, Bo ;
Chen, Sheng ;
Feng, Zhiyong ;
Zhong, Zhangdui ;
Wang, Ning .
IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2022, 24 (03) :1816-1842
[6]   Software Defined 5G and 6G Networks: a Survey [J].
Long, Qingyue ;
Chen, Yanliang ;
Zhang, Haijun ;
Lei, Xianfu .
MOBILE NETWORKS & APPLICATIONS, 2022, 27 (05) :1792-1812
[7]   Applications of Deep Reinforcement Learning in Communications and Networking: A Survey [J].
Luong, Nguyen Cong ;
Hoang, Dinh Thai ;
Gong, Shimin ;
Niyato, Dusit ;
Wang, Ping ;
Liang, Ying-Chang ;
Kim, Dong In .
IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2019, 21 (04) :3133-3174
[8]  
Narvekar S, 2020, Arxiv, DOI arXiv:2003.04960
[9]   A Survey on Resource Allocation in Vehicular Networks [J].
Noor-A-Rahim, Md ;
Liu, Zilong ;
Lee, Haeyoung ;
Ali, G. G. Md Nawaz ;
Pesch, Dirk ;
Xiao, Pei .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (02) :701-721
[10]  
Schulman J, 2017, Arxiv, DOI arXiv:1707.06347