Oneshot Deep Reinforcement Learning Approach to Network Slicing for Autonomous IoT Systems

被引:3
作者
Boni, Abdel Kader Chabi Sika [1 ]
Hassan, Hassan [1 ]
Drira, Khalil [1 ]
机构
[1] Univ Toulouse, CNRS, LAAS, F-31031 Toulouse, France
关键词
Internet of Things; Quality of service; Network slicing; Reinforcement learning; Metaheuristics; Costs; Virtual links; Autonomous Internet of Things (IoT) systems; deep reinforcement learning (DRL); network slicing; Quality of Service (QoS);
D O I
10.1109/JIOT.2024.3356750
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the emergence of the Internet of Things (IoT) services, meeting multiple and diverse Quality of Service (QoS) requirements in networks has become a crucial issue. In the new 5G networks, network slicing is presented as the solution to provide a tailored QoS for different network services. This new technology offers better prospects for IoT services and applications. In fact, in modern IoT systems, the number of IoT devices increases, and these systems evolve to be autonomous IoT systems. QoS management must be done without human intervention, making conventional QoS management mechanisms unsuitable. In this article, we introduce an oneshot deep reinforcement learning (DRL) agent capable of autonomously receiving requests for slices and proposing a placement on the physical infrastructure that maximizes the total number of accepted requests while guaranteeing load balancing at the infrastructure resources level. By adopting a new paradigm located at the crossroads between the single DRL agent and the multiagent DRL, our agent manages to generate the placement decision of a slice request in one step, which makes it compatible with the European telecommunications standards institute (ETSI) standard. Numerous simulations and comparisons with six other algorithms allowed us to validate its effectiveness in real-time scenarios where learning from previous placements is required to improve future slice provisioning.
引用
收藏
页码:17034 / 17049
页数:16
相关论文
共 45 条
[1]  
Addis B, 2015, IEEE INT CONF CL NET, P171, DOI 10.1109/CloudNet.2015.7335301
[2]   Network Slicing-Based Customization of 5G Mobile Services [J].
Afolabi, Ibrahim ;
Taleb, Tarik ;
Frangoudis, Pantelis A. ;
Bagaa, Miloud ;
Ksentini, Adlen .
IEEE NETWORK, 2019, 33 (05) :134-141
[3]   Network Slicing and Softwarization: A Survey on Principles, Enabling Technologies, and Solutions [J].
Afolabi, Ibrahim ;
Taleb, Tarik ;
Samdanis, Konstantinos ;
Ksentini, Adlen ;
Flinck, Hannu .
IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2018, 20 (03) :2429-2453
[4]  
Amaldi E, 2016, Electronic Notes in Discrete Mathematics, V52, P213, DOI [10.1016/j.endm.2016.03.028, 10.1016/j.endm.2016.03.028, DOI 10.1016/J.ENDM.2016.03.028, DOI 10.1016/j.endm.2016.03.028]
[5]  
[Anonymous], 2014, ETSI Rep. 2014-12
[6]   Deep Reinforcement Learning A brief survey [J].
Arulkumaran, Kai ;
Deisenroth, Marc Peter ;
Brundage, Miles ;
Bharath, Anil Anthony .
IEEE SIGNAL PROCESSING MAGAZINE, 2017, 34 (06) :26-38
[7]   Orchestrating Virtualized Network Functions [J].
Bari, Md. Faizul ;
Chowdhury, Shihabur Rahman ;
Ahmed, Reaz ;
Boutaba, Raouf ;
Muniz Bandeira Duarte, Otto Carlos .
IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2016, 13 (04) :725-739
[8]  
Dolati M, 2019, IEEE CONF COMPUT, P879, DOI [10.1109/infcomw.2019.8845171, 10.1109/INFCOMW.2019.8845171]
[9]  
Dong Yin, 2021, Journal of Physics: Conference Series, V1757, DOI [10.1088/1742-6596/1757/1/012097, 10.1088/1742-6596/1757/1/012097]
[10]   A Heuristically Assisted Deep Reinforcement Learning Approach for Network Slice Placement [J].
Esteves, Jose Jurandir Alves ;
Boubendir, Amina ;
Guillemin, Fabrice ;
Sens, Pierre .
IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2022, 19 (04) :4794-4806