Latency Equalization Policy of End-to-End Network Slicing Based on Reinforcement Learning

被引:7
|
作者
Bai, Haonan [1 ]
Zhang, Yong [1 ]
Zhang, Zhenyu [1 ]
Yuan, Siyu [1 ]
机构
[1] Beijing Univ Posts & Telecommun, Beijing Key Lab Work Safety Intelligent Monitoring, Beijing 100876, Peoples R China
来源
IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT | 2023年 / 20卷 / 01期
基金
中国国家自然科学基金;
关键词
Network slicing; Resource management; 5G mobile communication; Quality of service; Costs; Ultra reliable low latency communication; Service level agreements; Latency equalization; service level agreement; end-to-end network slicing; reinforcement learning; OPTIMIZATION; ASSOCIATION; ALLOCATION; EMBB;
D O I
10.1109/TNSM.2022.3210012
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Network slicing can provide logically isolated networks on the shared network infrastructure by invoking multiple technologies and administrative domains to fulfill end-to-end (E2E) service level agreements (SLAs). To guarantee the E2E service communication quality in the sliced network, an SLA-based cross-domain orchestration framework is proposed in this paper. The framework includes an E2E cross-domain coordination orchestrator at the upper layer and multiple subordinate domain controllers. Furthermore, we design two latency equalization policies applied to the upper layer orchestrator to divide the latency budget for each lower layer domain. Based on the reinforcement learning approach, Double Deep Q-Network with Prioritized Experience Replay (DDQN-PER) and Pointer Network SFC Mapping (PN-SFC), intra-domain resource allocation/mapping algorithms are designed independently for the lower radio access network (RAN) and core network (CN) domain controllers, respectively. The above algorithms are used to jointly optimize the enhanced mobile broadband (eMBB) users service satisfaction level and maximize the number of E2E accessed users. Simulation results show that our proposed algorithm can effectively guarantee the eMBB users QoS and improve the network capacity.
引用
收藏
页码:88 / 103
页数:16
相关论文
共 50 条
  • [1] OnSlicing: Online End-to-End Network Slicing with Reinforcement Learning
    Liu, Qiang
    Choi, Nakjung
    Han, Tao
    PROCEEDINGS OF THE 17TH INTERNATIONAL CONFERENCE ON EMERGING NETWORKING EXPERIMENTS AND TECHNOLOGIES, CONEXT 2021, 2021, : 141 - 153
  • [2] Deep Reinforcement Learning for End-to-End Network Slicing: Challenges and Solutions
    Liu, Qiang
    Choi, Nakjung
    Han, Tao
    IEEE NETWORK, 2023, 37 (02): : 222 - 228
  • [3] An End-to-End Network Slicing Design Policy
    Wang, Ranyin
    Aghvami, Hamid
    Friderikos, Vasilis
    2020 IEEE 31ST ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS (IEEE PIMRC), 2020,
  • [4] Deep Reinforcement Learning based Handoff Algorithm in End-to-End Network Slicing Enabling HetNets
    Yang, Deng
    Wu, Wenjun
    Wang, Xiaoxi
    Zhang, Yanhua
    Si, Pengbo
    2021 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2021,
  • [5] Network Slicing for End-to-End Latency Provisioning in Internet of Things
    Macheta, Kamil
    Malarski, Krzysztof Mateusz
    Petersen, Martin Nordal
    Ruepp, Sarah
    2019 FOURTH INTERNATIONAL CONFERENCE ON FOG AND MOBILE EDGE COMPUTING (FMEC), 2019, : 197 - 198
  • [6] Improving End-To-End Latency Fairness Using a Reinforcement-Learning-Based Network Scheduler
    Kwon, Juhyeok
    Ryu, Jihye
    Lee, Jee Hang
    Joung, Jinoo
    APPLIED SCIENCES-BASEL, 2023, 13 (06):
  • [7] Multi-Agent Reinforcement Learning-Based Resource Management for End-to-End Network Slicing
    Kim, Yohan
    Lim, Hyuk
    IEEE ACCESS, 2021, 9 : 56178 - 56190
  • [8] OAI-based End-to-End Network Slicing
    Li, Ting
    Zhao, Liqiang
    Song, Fengfei
    Pan, Chengkang
    2018 IEEE 23RD INTERNATIONAL CONFERENCE ON DIGITAL SIGNAL PROCESSING (DSP), 2018,
  • [9] Deep Reinforcement Learning-Based Optimization for End-to-End Network Slicing With Control- and User-Plane Separation
    Wang, Yunfeng
    Zhao, Liqiang
    Chu, Xiaoli
    Song, Shenghui
    Deng, Yansha
    Nallanathan, Arumugam
    Liang, Kai
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (11) : 12179 - 12194
  • [10] End-to-End Network Slicing for Flash Crowds
    Marinova, Simona
    Rakovic, Valentin
    Denkovski, Daniel
    Lin, Thomas
    Atanasovski, Vladimir
    Bannazadeh, Hadi
    Gavrilovska, Liljana
    Leon-Garcia, Alberto
    IEEE COMMUNICATIONS MAGAZINE, 2020, 58 (04) : 31 - 37