Resource orchestration in network slicing using GAN-based distributional deep Q-network for industrial applications

被引:5
|
作者
Gupta, Rohit Kumar [1 ]
Mahajan, Shashwat [1 ]
Misra, Rajiv [1 ]
机构
[1] Indian Inst Technol Patna, Dept Comp Sci & Engn, Bihta 801106, Bihar, India
来源
JOURNAL OF SUPERCOMPUTING | 2023年 / 79卷 / 05期
关键词
5G; 6G; Network slicing; Industrial internet of things; Generative adversarial network; Reinforcement learning; C-RAN; MANAGEMENT; 5G;
D O I
10.1007/s11227-022-04867-9
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
The Industrial Internet of Things (IIoT) is an emerging and promising concept that allows intelligent manufacturing through the connectivity of 5G/6G and the interaction of industrial production units. The introduction of network slicing in 5G and beyond has made it possible to manage and allocate resources to various applications according to their requirements. In this paper, we study network slicing within a radio access network containing IIoT devices which include base stations that share the same physical infrastructure. We use deep reinforcement learning-based resource orchestration technique to achieve variable service demands of environment state-value and resource allocation as environment action-value. We describe the cognitive decision objectives to maximise the optimal policy for IIoT reward by achieving higher system throughput, spectral efficiency (SE), service level agreement (SLA), transmission packet rate with low power consumption and transmission delay. We use generative adversarial network-based deep distributional noisy Q-networks (GAN-NoisyNet) to learn the action-value distribution. Furthermore, we introduce dueling GAN-NoisyNet, which employs a duel generator that estimates the action advantage function and state-value distribution. Finally, we conduct extensive simulations to verify the performance of the proposed GAN-NoisyNet and dueling GAN-NoisyNet.
引用
收藏
页码:5109 / 5138
页数:30
相关论文
共 50 条
  • [1] Resource orchestration in network slicing using GAN-based distributional deep Q-network for industrial applications
    Rohit Kumar Gupta
    Shashwat Mahajan
    Rajiv Misra
    The Journal of Supercomputing, 2023, 79 : 5109 - 5138
  • [2] GAN-based Deep Distributional Reinforcement Learning for Resource Management in Network Slicing
    Hua, Yuxiu
    Li, Rongpeng
    Zhao, Zhifeng
    Zhang, Honggang
    Chen, Xianfu
    2019 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2019,
  • [3] Resource slicing and customization in RAN with dueling deep Q-Network
    Sun, Guolin
    Xiong, Kun
    Boateng, Gordon Owusu
    Liu, Guisong
    Jiang, Wei
    JOURNAL OF NETWORK AND COMPUTER APPLICATIONS, 2020, 157
  • [4] Manufacturing Resource Scheduling Based on Deep Q-Network
    ZHANG Yufei
    ZOU Yuanhao
    ZHAO Xiaodong
    Wuhan University Journal of Natural Sciences, 2022, 27 (06) : 531 - 538
  • [5] GAN-Powered Deep Distributional Reinforcement Learning for Resource Management in Network Slicing
    Hua, Yuxiu
    Li, Rongpeng
    Zhao, Zhifeng
    Chen, Xianfu
    Zhang, Honggang
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2020, 38 (02) : 334 - 349
  • [6] Multipath Communication With Deep Q-Network for Industry 4.0 Automation and Orchestration
    Pokhrel, Shiva Raj
    Garg, Sahil
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (04) : 2852 - 2859
  • [7] Deep Q-Network Using Reward Distribution
    Nakaya, Yuta
    Osana, Yuko
    ARTIFICIAL INTELLIGENCE AND SOFT COMPUTING, ICAISC 2018, PT I, 2018, 10841 : 160 - 169
  • [8] Deep Q-Network based Adaptive Resource Allocation with User Grouping on ICIC
    Lee, Chien-Hao
    Lin, Kuang-Hsun
    Wei, Hung-Yu
    2019 IEEE 89TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2019-SPRING), 2019,
  • [9] Inhomogeneous deep Q-network for time sensitive applications
    Chen, Xu
    Wang, Jun
    ARTIFICIAL INTELLIGENCE, 2022, 312
  • [10] GANSlicing: A GAN-Based Software Defined Mobile Network Slicing Scheme for IoT Applications
    Gu, Ruichun
    Zhang, Junxing
    ICC 2019 - 2019 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2019,