Deep Reinforcement Learning Based Edge Computing Network Aided Resource Allocation Algorithm for Smart Grid

被引:5
|
作者
Chi, Yingying [1 ]
Zhang, Yi [2 ]
Liu, Yong [1 ]
Zhu, Hailong [3 ]
Zheng, Zhe [1 ]
Liu, Rui [1 ]
Zhang, Peiying [2 ]
机构
[1] Beijing Smartchip Microelect Technol Co Ltd, Beijing 100192, Peoples R China
[2] China Univ Petr East China, Coll Comp Sci & Technol, Qingdao 266580, Peoples R China
[3] Beijing Univ Posts & Telecommun, State Key Lab Networking & Switching Technol, Beijing 100876, Peoples R China
关键词
Edge computing; Smart grids; Resource management; Delays; User centered design; Computational modeling; Quality of service; Reinforcement learning; Deep learning; Deep reinforcement learning; delay sensitive; edge computing network; resource allocation; smart grid; user request;
D O I
10.1109/ACCESS.2022.3221740
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The dramatic increase in the volume of users and services makes scheduling network resources for smart grids a key challenge. Network slicing is an important technology to solve this problem. We introduce edge computing networks into the smart grid to intelligently allocate resources based on users' quality of service (QoS) and available resources. However, existing heuristic resource scheduling algorithms often lead to resource fragmentation and thus fall into local optima. To this end, we propose a deep reinforcement learning (DRL)-based virtual network embedding algorithm to optimize the resource allocation strategy of smart grids from a network virtualization perspective. We extract the network properties of the smart grid to construct a policy network as a training environment for DRL agents. Finally, DRL derives the probability of each node being embedded based on the extracted attributes of edge computing nodes and completes user request (UR) embedding based on this probability. The experimental results show that the algorithm proposed in this paper has excellent performance with guaranteed low latency, 21% improvement in long-term revenue and 5.6% improvement in UR success rate compared with the other two algorithms.
引用
收藏
页码:6541 / 6550
页数:10
相关论文
共 50 条
  • [1] Novel Resource Allocation Algorithm of Edge Computing Based on Deep Reinforcement Learning Mechanism
    Zhang, Degan
    Fan, Hongrui
    Zhang, Jie
    19TH IEEE INTERNATIONAL SYMPOSIUM ON PARALLEL AND DISTRIBUTED PROCESSING WITH APPLICATIONS (ISPA/BDCLOUD/SOCIALCOM/SUSTAINCOM 2021), 2021, : 437 - 444
  • [2] Smart Resource Allocation for Mobile Edge Computing: A Deep Reinforcement Learning Approach
    Wang, Jiadai
    Zhao, Lei
    Liu, Jiajia
    Kato, Nei
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTING, 2021, 9 (03) : 1529 - 1541
  • [3] Smart Resource Allocation for Mobile Edge Computing: A Deep Reinforcement Learning Approach
    Liu, Jiajia (liujiajia@nwpu.edu.cn), 1600, IEEE Computer Society (09):
  • [4] Resource Allocation Based on Deep Reinforcement Learning in IoT Edge Computing
    Xiong, Xiong
    Zheng, Kan
    Lei, Lei
    Hou, Lu
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2020, 38 (06) : 1133 - 1146
  • [5] Edge Computing Resource Allocation Algorithm for NB-IoT Based on Deep Reinforcement Learning
    Chu, Jiawen
    Pan, Chunyun
    Wang, Yafei
    Yun, Xiang
    LI, Xuehua
    IEICE TRANSACTIONS ON COMMUNICATIONS, 2023, E106B (05) : 439 - 447
  • [6] Deep Reinforcement Learning Based Resource Allocation for Fault Detection with Cloud Edge Collaboration in Smart Grid
    Li, Qiyue
    Zhu, Yadong
    Ding, Jinjin
    Li, Weitao
    Sun, Wei
    Ding, Lijian
    CSEE JOURNAL OF POWER AND ENERGY SYSTEMS, 2024, 10 (03): : 1220 - 1230
  • [7] Deep Reinforcement Learning-Based Smart Grid Resource Allocation System
    Lang, Qiong
    Zhu, La Ba Dun
    Ren, Mi Ma Ci
    Zhang, Rui
    Wu, Yinghen
    He, Wenting
    Li, Mingjia
    2023 IEEE INTERNATIONAL CONFERENCES ON INTERNET OF THINGS, ITHINGS IEEE GREEN COMPUTING AND COMMUNICATIONS, GREENCOM IEEE CYBER, PHYSICAL AND SOCIAL COMPUTING, CPSCOM IEEE SMART DATA, SMARTDATA AND IEEE CONGRESS ON CYBERMATICS,CYBERMATICS, 2024, : 703 - 707
  • [8] Network Resource Allocation Algorithm Using Reinforcement Learning Policy-Based Network in a Smart Grid Scenario
    Zheng, Zhe
    Han, Yu
    Chi, Yingying
    Yuan, Fusheng
    Cui, Wenpeng
    Zhu, Hailong
    Zhang, Yi
    Zhang, Peiying
    ELECTRONICS, 2023, 12 (15)
  • [9] Reinforcement learning-based online resource allocation for edge computing network
    Li Y.-J.
    Jiang H.-T.
    Gao M.-H.
    Kongzhi yu Juece/Control and Decision, 2022, 37 (11): : 2880 - 2886
  • [10] Event-based reinforcement learning algorithm for dynamic resource allocation in smart grid
    Wang, Jiayi
    Hu, Wenfeng
    INTERNATIONAL JOURNAL OF SYSTEMS SCIENCE, 2025,