Latency Equalization Policy of End-to-End Network Slicing Based on Reinforcement Learning

被引:10
作者
Bai, Haonan [1 ]
Zhang, Yong [1 ]
Zhang, Zhenyu [1 ]
Yuan, Siyu [1 ]
机构
[1] Beijing Univ Posts & Telecommun, Beijing Key Lab Work Safety Intelligent Monitoring, Beijing 100876, Peoples R China
来源
IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT | 2023年 / 20卷 / 01期
基金
中国国家自然科学基金;
关键词
Network slicing; Resource management; 5G mobile communication; Quality of service; Costs; Ultra reliable low latency communication; Service level agreements; Latency equalization; service level agreement; end-to-end network slicing; reinforcement learning; OPTIMIZATION; ASSOCIATION; ALLOCATION; EMBB;
D O I
10.1109/TNSM.2022.3210012
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Network slicing can provide logically isolated networks on the shared network infrastructure by invoking multiple technologies and administrative domains to fulfill end-to-end (E2E) service level agreements (SLAs). To guarantee the E2E service communication quality in the sliced network, an SLA-based cross-domain orchestration framework is proposed in this paper. The framework includes an E2E cross-domain coordination orchestrator at the upper layer and multiple subordinate domain controllers. Furthermore, we design two latency equalization policies applied to the upper layer orchestrator to divide the latency budget for each lower layer domain. Based on the reinforcement learning approach, Double Deep Q-Network with Prioritized Experience Replay (DDQN-PER) and Pointer Network SFC Mapping (PN-SFC), intra-domain resource allocation/mapping algorithms are designed independently for the lower radio access network (RAN) and core network (CN) domain controllers, respectively. The above algorithms are used to jointly optimize the enhanced mobile broadband (eMBB) users service satisfaction level and maximize the number of E2E accessed users. Simulation results show that our proposed algorithm can effectively guarantee the eMBB users QoS and improve the network capacity.
引用
收藏
页码:88 / 103
页数:16
相关论文
共 50 条
[31]   Reinforcement Learning Based VNF Scheduling with End-to-End Delay Guarantee [J].
Li, Junling ;
Shi, Weisen ;
Zhang, Ning ;
Shen, Xuemin Sherman .
2019 IEEE/CIC INTERNATIONAL CONFERENCE ON COMMUNICATIONS IN CHINA (ICCC), 2019,
[32]   An Extended OVN Architecture for End-to-End QoS Guarantee in Network Slicing [J].
Thanh-Hai Pham ;
Tuan-Anh Nguyen ;
Dong Tran-Van ;
Trung Vu-Thanh ;
Nguyen Tai Hung ;
Nguyen Huu Thanh .
2024 IEEE TENTH INTERNATIONAL CONFERENCE ON COMMUNICATIONS AND ELECTRONICS, ICCE 2024, 2024, :84-89
[33]   The NECOS Approach to End-to-End Cloud-Network Slicing as a Service [J].
Clayman, Stuart ;
Neto, Augusto ;
Verdi, Fabio ;
Correa, Sand ;
Sampaio, Silvio ;
Sakelariou, Ilias ;
Mamatas, Lefteris ;
Pasquini, Rafael ;
Cardoso, Kleber ;
Tusa, Francesco ;
Rothenberg, Christian ;
Serrat, Joan .
IEEE COMMUNICATIONS MAGAZINE, 2021, 59 (03) :91-97
[34]   End-to-End Streaming Video Temporal Action Segmentation With Reinforcement Learning [J].
Zhang, Jin-Rong ;
Wen, Wu-Jun ;
Liu, Sheng-Lan ;
Huang, Gao ;
Li, Yun-Heng ;
Li, Qi-Feng ;
Feng, Lin .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2025,
[35]   Verifiably Safe Exploration for End-to-End Reinforcement Learning [J].
Hunt, Nathan ;
Fulton, Nathan ;
Magliacane, Sara ;
Trong Nghia Hoang ;
Das, Subhro ;
Solar-Lezama, Armando .
HSCC2021: PROCEEDINGS OF THE 24TH INTERNATIONAL CONFERENCE ON HYBRID SYSTEMS: COMPUTATION AND CONTROL (PART OF CPS-IOT WEEK), 2021,
[36]   End-to-End Network Slicing in Radio Access Network, Transport Network and Core Network Domains [J].
Li, Xu ;
Ni, Rui ;
Chen, Jun ;
Lyu, Yibo ;
Rong, Zhichao ;
Du, Rui .
IEEE ACCESS, 2020, 8 (08) :29525-29537
[37]   Prediction-Based End-to-End Dynamic Network Slicing in Hybrid Elastic Fiber-Wireless Networks [J].
Yin, Shan ;
Zhang, Zhan ;
Yang, Chen ;
Chu, Yaqin ;
Huang, Shanguo .
JOURNAL OF LIGHTWAVE TECHNOLOGY, 2021, 39 (07) :1889-1899
[38]   Deep Reinforcement Learning-Based Network Slicing for Beyond 5G [J].
Suh, Kyungjoo ;
Kim, Sunwoo ;
Ahn, Yongjun ;
Kim, Seungnyun ;
Ju, Hyungyu ;
Shim, Byonghyo .
IEEE ACCESS, 2022, 10 :7384-7395
[39]   Resource Management From Single-Domain 5G to End-to-End 6G Network Slicing: A Survey [J].
Ebrahimi, Sina ;
Bouali, Faouzi ;
Haas, Olivier C. L. .
IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2024, 26 (04) :2836-2866
[40]   Utility-Driven End-to-End Network Slicing for Diverse IoT Users in MEC: A Multi-Agent Deep Reinforcement Learning Approach [J].
Ejaz, Muhammad Asim ;
Wu, Guowei ;
Ahmed, Adeel ;
Iftikhar, Saman ;
Bawazeer, Shaikhan .
SENSORS, 2024, 24 (17)