Latency Equalization Policy of End-to-End Network Slicing Based on Reinforcement Learning

被引:7
|
作者
Bai, Haonan [1 ]
Zhang, Yong [1 ]
Zhang, Zhenyu [1 ]
Yuan, Siyu [1 ]
机构
[1] Beijing Univ Posts & Telecommun, Beijing Key Lab Work Safety Intelligent Monitoring, Beijing 100876, Peoples R China
来源
IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT | 2023年 / 20卷 / 01期
基金
中国国家自然科学基金;
关键词
Network slicing; Resource management; 5G mobile communication; Quality of service; Costs; Ultra reliable low latency communication; Service level agreements; Latency equalization; service level agreement; end-to-end network slicing; reinforcement learning; OPTIMIZATION; ASSOCIATION; ALLOCATION; EMBB;
D O I
10.1109/TNSM.2022.3210012
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Network slicing can provide logically isolated networks on the shared network infrastructure by invoking multiple technologies and administrative domains to fulfill end-to-end (E2E) service level agreements (SLAs). To guarantee the E2E service communication quality in the sliced network, an SLA-based cross-domain orchestration framework is proposed in this paper. The framework includes an E2E cross-domain coordination orchestrator at the upper layer and multiple subordinate domain controllers. Furthermore, we design two latency equalization policies applied to the upper layer orchestrator to divide the latency budget for each lower layer domain. Based on the reinforcement learning approach, Double Deep Q-Network with Prioritized Experience Replay (DDQN-PER) and Pointer Network SFC Mapping (PN-SFC), intra-domain resource allocation/mapping algorithms are designed independently for the lower radio access network (RAN) and core network (CN) domain controllers, respectively. The above algorithms are used to jointly optimize the enhanced mobile broadband (eMBB) users service satisfaction level and maximize the number of E2E accessed users. Simulation results show that our proposed algorithm can effectively guarantee the eMBB users QoS and improve the network capacity.
引用
收藏
页码:88 / 103
页数:16
相关论文
共 50 条
  • [31] Deterministic Delay of Digital-Twin-Assisted End-to-End Network Slicing in Industrial IoT via Multiagent Deep Reinforcement Learning
    Tang, Lun
    Pu, Zhoulin
    Hou, Qiang
    Fang, Dongxu
    Chen, Qianbin
    IEEE INTERNET OF THINGS JOURNAL, 2025, 12 (01): : 1064 - 1080
  • [32] End-to-End Deep Reinforcement Learning based Recommendation with Supervised Embedding
    Liu, Feng
    Guo, Huifeng
    Li, Xutao
    Tang, Ruiming
    Ye, Yunming
    He, Xiuqiang
    PROCEEDINGS OF THE 13TH INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING (WSDM '20), 2020, : 384 - 392
  • [33] End-to-end slicing of RAN based on next-generation optical access network
    Centofanti, Carlo
    Marotta, Andrea
    Gudepu, Venkateswarlu
    Cassioli, Dajana
    Graziosi, Fabio
    Roberts, Hal
    Bernard, Chris
    Kondepu, Koteswararao
    PHOTONIC NETWORK COMMUNICATIONS, 2024, 48 (1-3) : 26 - 34
  • [34] End-to-End Reinforcement Learning for Torque Based Variable Height Hopping
    Soni, Raghav
    Harnack, Daniel
    Isermann, Hauke
    Fushimi, Sotaro
    Kumar, Shivesh
    Kirchner, Frank
    2023 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2023, : 7531 - 7538
  • [35] Reinforcement Learning Based VNF Scheduling with End-to-End Delay Guarantee
    Li, Junling
    Shi, Weisen
    Zhang, Ning
    Shen, Xuemin Sherman
    2019 IEEE/CIC INTERNATIONAL CONFERENCE ON COMMUNICATIONS IN CHINA (ICCC), 2019,
  • [36] End-to-End Autonomous Driving Decision Based on Deep Reinforcement Learning
    Huang Z.-Q.
    Qu Z.-W.
    Zhang J.
    Zhang Y.-X.
    Tian R.
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2020, 48 (09): : 1711 - 1719
  • [37] Learning-Assisted Secure End-to-End Network Slicing for Cyber-Physical Systems
    Liu, Qiang
    Han, Tao
    Ansari, Nirwan
    IEEE NETWORK, 2020, 34 (03): : 37 - 43
  • [38] Energy-Optimal End-to-End Network Slicing in Cloud-Based Architecture
    Masoudi, Meysam
    Demir, Ozlem Tugfe
    Zander, Jens
    Cavdar, Cicek
    IEEE OPEN JOURNAL OF THE COMMUNICATIONS SOCIETY, 2022, 3 : 574 - 592
  • [39] A machine learning-based optimization for end-to-end latency in TSN networks
    Bezerra, Daniel
    Filho, Assis T. de Oliveira
    Rodrigues, Iago Richard
    Dantas, Marrone
    Barbosa, Gibson
    Souza, Ricardo
    Kelner, Judith
    Sadok, Djamel
    COMPUTER COMMUNICATIONS, 2022, 195 : 424 - 440
  • [40] Complex Network Cognition-Based Federated Reinforcement Learning for End-to-End Urban Autonomous Driving
    Cai, Yingfeng
    Lu, Sikai
    Wang, Hai
    Lian, Yubo
    Chen, Long
    Liu, Qingchao
    IEEE TRANSACTIONS ON TRANSPORTATION ELECTRIFICATION, 2024, 10 (03): : 7513 - 7525