Traffic Steering for 5G Multi-RAT Deployments using Deep Reinforcement Learning

被引:5
|
作者
Habib, Md Arafat [1 ]
Zhou, Hao [1 ]
Iturria-Rivera, Pedro Enrique [1 ]
Elsayed, Medhat [2 ]
Bavand, Majid [2 ]
Gaigalas, Raimundas [2 ]
Furr, Steve [2 ]
Erol-Kantarci, Melike [1 ]
机构
[1] Univ Ottawa, Sch Elect Engn & Comp Sci, Ottawa, ON, Canada
[2] Ericsson Inc, Ottawa, ON, Canada
来源
2023 IEEE 20TH CONSUMER COMMUNICATIONS & NETWORKING CONFERENCE, CCNC | 2023年
基金
加拿大自然科学与工程研究理事会;
关键词
Multi-RAT; traffic steering; reinforcement learning;
D O I
10.1109/CCNC51644.2023.10060026
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
In 5G non-standalone mode, traffic steering is a critical technique to take full advantage of 5G new radio while optimizing dual connectivity of 5G and LTE networks in multiple radio access technology (RAT). An intelligent traffic steering mechanism can play an important role to maintain seamless user experience by choosing appropriate RAT (5G or LTE) dynamically for a specific user traffic flow with certain QoS requirements. In this paper, we propose a novel traffic steering mechanism based on Deep Q-learning that can automate traffic steering decisions in a dynamic environment having multiple RATs, and maintain diverse QoS requirements for different traffic classes. The proposed method is compared with two baseline algorithms: a heuristic-based algorithm and Q-learning-based traffic steering. Compared to the Q-learning and heuristic baselines, our results show that the proposed algorithm achieves better performance in terms of 6% and 10% higher average system throughput, and 23% and 33% lower network delay, respectively.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] Hierarchical Reinforcement Learning Based Traffic Steering in Multi-RAT 5G Deployments
    Habib, Md Arafat
    Zhou, Hao
    Iturria-Rivera, Pedro Enrique
    Elsayed, Medhat
    Bavand, Majid
    Gaigalas, Raimundas
    Ozcan, Yigit
    Erol-Kantarci, Melike
    ICC 2023-IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, 2023, : 100 - 105
  • [2] Enhanced Multi-RAT Support for 5G
    Nanjundappa, Arjun
    Singh, Sukhdeep
    Jain, Gaurav
    2018 15TH IEEE ANNUAL CONSUMER COMMUNICATIONS & NETWORKING CONFERENCE (CCNC), 2018,
  • [3] A Matching Game Solution for Optimal RAT Selection in 5G Multi-RAT HetNets
    Anany, Mohamed G.
    Elmesalawy, Mahmoud M.
    El Din, Eman Serag
    2019 IEEE 10TH ANNUAL UBIQUITOUS COMPUTING, ELECTRONICS & MOBILE COMMUNICATION CONFERENCE (UEMCON), 2019, : 1022 - 1028
  • [4] 5G Handover using Reinforcement Learning
    Yajnanarayana, Vijaya
    Ryden, Henrik
    Hevizi, Laszlo
    2020 IEEE 3RD 5G WORLD FORUM (5GWF), 2020, : 349 - 354
  • [5] Multi-RAT Spectrum Reallocation including Carrier Aggregation for 5G Networks
    Galanopoulos, Apostolos
    Foukalas, Fotis
    Xenakis, Apostolos
    22ND PAN-HELLENIC CONFERENCE ON INFORMATICS (PCI 2018), 2018, : 22 - 27
  • [6] Joint Network and Mode Selection in 5G Multi-RAT Heterogeneous Networks
    Abdulshakoor, Ahmed I.
    Elmesalawy, Mahmoud M.
    Elmosilhy, Noha A.
    Abd El-Haleem, Ahmed M.
    2019 42ND INTERNATIONAL CONFERENCE ON TELECOMMUNICATIONS AND SIGNAL PROCESSING (TSP), 2019, : 307 - 312
  • [7] Empowering Traffic Steering in 6G Open RAN With Deep Reinforcement Learning
    Kavehmadavani, Fatemeh
    Nguyen, Van-Dinh
    Vu, Thang X.
    Chatzinotas, Symeon
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (10) : 12782 - 12798
  • [8] Multi-RAT Access based on Multi-Agent Reinforcement Learning
    Yan, Mu
    Feng, Gang
    Qin, Shuang
    GLOBECOM 2017 - 2017 IEEE GLOBAL COMMUNICATIONS CONFERENCE, 2017,
  • [9] REVeno: RTT Estimation Based Multipath TCP in 5G Multi-RAT Networks
    Jung, Jaewook
    Lee, Changsung
    Baik, Jungsuk
    Chung, Jong-Moon
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2023, 22 (09) : 5479 - 5491
  • [10] Toward an Automated Data Offloading Framework for Multi-RAT 5G Wireless Networks
    Marvi, Murk
    Aijaz, Adnan
    Khurram, Muhammad
    IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2020, 17 (04): : 2584 - 2597