Traffic Steering for 5G Multi-RAT Deployments using Deep Reinforcement Learning

被引:5
作者
Habib, Md Arafat [1 ]
Zhou, Hao [1 ]
Iturria-Rivera, Pedro Enrique [1 ]
Elsayed, Medhat [2 ]
Bavand, Majid [2 ]
Gaigalas, Raimundas [2 ]
Furr, Steve [2 ]
Erol-Kantarci, Melike [1 ]
机构
[1] Univ Ottawa, Sch Elect Engn & Comp Sci, Ottawa, ON, Canada
[2] Ericsson Inc, Ottawa, ON, Canada
来源
2023 IEEE 20TH CONSUMER COMMUNICATIONS & NETWORKING CONFERENCE, CCNC | 2023年
基金
加拿大自然科学与工程研究理事会;
关键词
Multi-RAT; traffic steering; reinforcement learning;
D O I
10.1109/CCNC51644.2023.10060026
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
In 5G non-standalone mode, traffic steering is a critical technique to take full advantage of 5G new radio while optimizing dual connectivity of 5G and LTE networks in multiple radio access technology (RAT). An intelligent traffic steering mechanism can play an important role to maintain seamless user experience by choosing appropriate RAT (5G or LTE) dynamically for a specific user traffic flow with certain QoS requirements. In this paper, we propose a novel traffic steering mechanism based on Deep Q-learning that can automate traffic steering decisions in a dynamic environment having multiple RATs, and maintain diverse QoS requirements for different traffic classes. The proposed method is compared with two baseline algorithms: a heuristic-based algorithm and Q-learning-based traffic steering. Compared to the Q-learning and heuristic baselines, our results show that the proposed algorithm achieves better performance in terms of 6% and 10% higher average system throughput, and 23% and 33% lower network delay, respectively.
引用
收藏
页数:6
相关论文
共 16 条
[11]   Characterizing throughput and convergence time in dynamic multi-connectivity 5G deployments [J].
Pirmagomedov, Rustam ;
Moltchanov, Dmitri ;
Samuylov, Andrey ;
Orsino, Antonino ;
Torsner, Johan ;
Andreev, Sergey ;
Koucheryavy, Yevgeni .
COMPUTER COMMUNICATIONS, 2022, 187 :45-58
[12]  
Prasad A, 2016, IEEE VTS VEH TECHNOL
[13]   Traffic Steering and Network Selection in 5G Networks based on Reinforcement Learning [J].
Priscoli, Francesco Delli ;
Giuseppi, Alessandro ;
Liberati, Francesco ;
Pietrabissa, Antonio .
2020 EUROPEAN CONTROL CONFERENCE (ECC 2020), 2020, :595-601
[14]  
Ramaswamy V, 2019, 2019 IEEE 2ND 5G WORLD FORUM (5GWF), P484, DOI [10.1109/5GWF.2019.8911684, 10.1109/5gwf.2019.8911684]
[15]  
Sutton RS, 2018, ADAPT COMPUT MACH LE, P1
[16]   RAN Resource Slicing in 5G Using Multi-Agent Correlated Q-Learning [J].
Zhou, Hao ;
Elsayed, Medhat ;
Erol-Kantarci, Melike .
2021 IEEE 32ND ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS (PIMRC), 2021,