An online cost minimization of the slice broker based on deep reinforcement learning

被引:4
作者
Gohar, Ali [1 ]
Nencioni, Gianfranco [1 ]
机构
[1] Univ Stavanger, Dept Elect Engn & Comp Sci, Stavanger, Norway
关键词
Cost minimization; Slice Broker; Multi-access Edge Computing; Network slicing; Deep Reinforcement Learning; NETWORK FUNCTION PLACEMENT; RESOURCE OPTIMIZATION; NFV; ORCHESTRATION;
D O I
10.1016/j.comnet.2024.110198
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
The fifth generation of mobile networks can provide differentiated services enabled by network slicing and multi-access edge computing. A new business actor, called Slice Broker (SB), is emerging as an intermediate entity that buys networking and computing resources from Infrastructure Providers (InPs) and provides network slices to Slice Tenants (STs). This paper addresses the problem of online jointly allocating all the network slices requested by the STs and selecting the resources to purchase from the InPs. The target of the problem is the minimization of the SB costs. We assume that a network slice is implemented as a sequence of virtual network functions and that the InPs sell the networking and computing resources on predetermined configurations. The addressed problem is solved by using deep reinforcement learning with a model -free policy gradient -based algorithm. The proposed solution is evaluated and compared with benchmark solutions in various scenarios. The results show that the benchmark solutions have a cost that is from 10% to more than twice higher than the proposed solution in all scenarios.
引用
收藏
页数:14
相关论文
共 51 条
[1]   Unbounded knapsack problem: Dynamic programming revisited [J].
Andonov, R ;
Poirriez, V ;
Rajopadhye, S .
EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2000, 123 (02) :394-407
[2]  
[Anonymous], 2013, P 15 ANN C COMPANION, DOI DOI 10.1145/2464576.2482735
[3]  
ATIS, 2019, White Paper ATIS-I-0000075, P48
[4]   End-to-end network slice architecture and distribution across 5G micro-operator leveraging multi-domain and multi-tenancy [J].
Badmus, Idris ;
Laghrissi, Abdelquoddouss ;
Matinmikko-Blue, Marja ;
Pouttu, Ari .
EURASIP JOURNAL ON WIRELESS COMMUNICATIONS AND NETWORKING, 2021, 2021 (01)
[5]  
Baker B, 2020, Arxiv, DOI arXiv:1909.07528
[6]   5G Business Models for Mobile Network Operators-A Survey [J].
Banda, Laurence ;
Mzyece, Mjumo ;
Mekuria, Fisseha .
IEEE ACCESS, 2022, 10 :94851-94886
[7]  
Berner Christopher, 2019, arXiv
[8]   DRL-QOR: Deep Reinforcement Learning-Based QoS/QoE-Aware Adaptive Online Orchestration in NFV-Enabled Networks [J].
Chen, Jing ;
Chen, Jia ;
Zhang, Hongke .
IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2021, 18 (02) :1758-1774
[9]   Reinforcement learning-based QoS/QoE-aware service function chaining in software-driven 5G slices [J].
Chen, Xi ;
Li, Zonghang ;
Zhang, Yupeng ;
Long, Ruiming ;
Yu, Hongfang ;
Du, Xiaojiang ;
Guizani, Mohsen .
TRANSACTIONS ON EMERGING TELECOMMUNICATIONS TECHNOLOGIES, 2018, 29 (11)
[10]   Network Slicing Cost Allocation Model [J].
Chiha, Asma ;
Van der Wee, Marlies ;
Colle, Didier ;
Verbrugge, Sofie .
JOURNAL OF NETWORK AND SYSTEMS MANAGEMENT, 2020, 28 (03) :627-659