Traffic Steering for 5G Multi-RAT Deployments using Deep Reinforcement Learning

被引:5
作者
Habib, Md Arafat [1 ]
Zhou, Hao [1 ]
Iturria-Rivera, Pedro Enrique [1 ]
Elsayed, Medhat [2 ]
Bavand, Majid [2 ]
Gaigalas, Raimundas [2 ]
Furr, Steve [2 ]
Erol-Kantarci, Melike [1 ]
机构
[1] Univ Ottawa, Sch Elect Engn & Comp Sci, Ottawa, ON, Canada
[2] Ericsson Inc, Ottawa, ON, Canada
来源
2023 IEEE 20TH CONSUMER COMMUNICATIONS & NETWORKING CONFERENCE, CCNC | 2023年
基金
加拿大自然科学与工程研究理事会;
关键词
Multi-RAT; traffic steering; reinforcement learning;
D O I
10.1109/CCNC51644.2023.10060026
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
In 5G non-standalone mode, traffic steering is a critical technique to take full advantage of 5G new radio while optimizing dual connectivity of 5G and LTE networks in multiple radio access technology (RAT). An intelligent traffic steering mechanism can play an important role to maintain seamless user experience by choosing appropriate RAT (5G or LTE) dynamically for a specific user traffic flow with certain QoS requirements. In this paper, we propose a novel traffic steering mechanism based on Deep Q-learning that can automate traffic steering decisions in a dynamic environment having multiple RATs, and maintain diverse QoS requirements for different traffic classes. The proposed method is compared with two baseline algorithms: a heuristic-based algorithm and Q-learning-based traffic steering. Compared to the Q-learning and heuristic baselines, our results show that the proposed algorithm achieves better performance in terms of 6% and 10% higher average system throughput, and 23% and 33% lower network delay, respectively.
引用
收藏
页数:6
相关论文
共 50 条
  • [21] Energy Optimization With Multi-Sleeping Control in 5G Heterogeneous Networks Using Reinforcement Learning
    Amine, Ali El
    Chaiban, Jean-Paul
    Hassan, Hussein Al Haj
    Dini, Paolo
    Nuaymi, Loutfi
    Achkar, Roger
    [J]. IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2022, 19 (04): : 4310 - 4322
  • [22] SMART USAGE OF MULTIPLE RAT IN IOT-ORIENTED 5G NETWORKS: A REINFORCEMENT LEARNING APPROACH
    Sandoval, Ruben M.
    Canovas-Carrasco, Sebastian
    Garcia-Sanchez, Antonio-Javier
    Garcia-Haro, Joan
    [J]. 2018 ITU KALEIDOSCOPE: MACHINE LEARNING FOR A 5G FUTURE (ITU K), 2018,
  • [23] Programmable and Customized Intelligence for Traffic Steering in 5G Networks Using Open RAN Architectures
    Lacava, Andrea
    Polese, Michele
    Sivaraj, Rajarajan
    Soundrarajan, Rahul
    Bhati, Bhawani Shanker
    Singh, Tarunjeet
    Zugno, Tommaso
    Cuomo, Francesca
    Melodia, Tommaso
    [J]. IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (04) : 2882 - 2897
  • [24] A survey of deep reinforcement learning application in 5G and beyond network slicing and virtualization
    Ssengonzi, Charles
    Kogeda, Okuthe P.
    Olwal, Thomas O.
    [J]. ARRAY, 2022, 14
  • [25] Toward Scalable and Efficient Hierarchical Deep Reinforcement Learning for 5G RAN Slicing
    Huang, Renlang
    Guo, Miao
    Gu, Chaojie
    He, Shibo
    Chen, Jiming
    Sun, Mingyang
    [J]. IEEE TRANSACTIONS ON GREEN COMMUNICATIONS AND NETWORKING, 2023, 7 (04): : 2153 - 2162
  • [26] Deep active reinforcement learning for privacy preserve data mining in 5G environments
    Ahmed, Usman
    Lin, Jerry Chun-Wei
    Srivastava, Gautam
    Chen, Hsing-Chung
    [J]. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2022, 42 (05) : 4751 - 4758
  • [27] Admission Control for 5G Core Network Slicing Based on Deep Reinforcement Learning
    Villota-Jacome, William F.
    Rendon, Oscar Mauricio Caicedo
    da Fonseca, Nelson L. S.
    [J]. IEEE SYSTEMS JOURNAL, 2022, 16 (03): : 4686 - 4697
  • [28] Towards 5G: A Reinforcement Learning-Based Scheduling Solution for Data Traffic Management
    Comsa, Ioan-Sorin
    Zhang, Sijing
    Aydin, Mehmet Emin
    Kuonen, Pierre
    Lu, Yao
    Trestian, Ramona
    Ghinea, Gheorghita
    [J]. IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2018, 15 (04): : 1661 - 1675
  • [29] Resource allocation for UAV-assisted 5G mMTC slicing networks using deep reinforcement learning
    Rohit Kumar Gupta
    Saubhik Kumar
    Rajiv Misra
    [J]. Telecommunication Systems, 2023, 82 : 141 - 159
  • [30] Resource allocation for UAV-assisted 5G mMTC slicing networks using deep reinforcement learning
    Gupta, Rohit Kumar
    Kumar, Saubhik
    Misra, Rajiv
    [J]. TELECOMMUNICATION SYSTEMS, 2023, 82 (01) : 141 - 159