Deep Reinforcement Learning Based Edge Computing Network Aided Resource Allocation Algorithm for Smart Grid

被引:7
作者
Chi, Yingying [1 ]
Zhang, Yi [2 ]
Liu, Yong [1 ]
Zhu, Hailong [3 ]
Zheng, Zhe [1 ]
Liu, Rui [1 ]
Zhang, Peiying [2 ]
机构
[1] Beijing Smartchip Microelect Technol Co Ltd, Beijing 100192, Peoples R China
[2] China Univ Petr East China, Coll Comp Sci & Technol, Qingdao 266580, Peoples R China
[3] Beijing Univ Posts & Telecommun, State Key Lab Networking & Switching Technol, Beijing 100876, Peoples R China
关键词
Edge computing; Smart grids; Resource management; Delays; User centered design; Computational modeling; Quality of service; Reinforcement learning; Deep learning; Deep reinforcement learning; delay sensitive; edge computing network; resource allocation; smart grid; user request;
D O I
10.1109/ACCESS.2022.3221740
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The dramatic increase in the volume of users and services makes scheduling network resources for smart grids a key challenge. Network slicing is an important technology to solve this problem. We introduce edge computing networks into the smart grid to intelligently allocate resources based on users' quality of service (QoS) and available resources. However, existing heuristic resource scheduling algorithms often lead to resource fragmentation and thus fall into local optima. To this end, we propose a deep reinforcement learning (DRL)-based virtual network embedding algorithm to optimize the resource allocation strategy of smart grids from a network virtualization perspective. We extract the network properties of the smart grid to construct a policy network as a training environment for DRL agents. Finally, DRL derives the probability of each node being embedded based on the extracted attributes of edge computing nodes and completes user request (UR) embedding based on this probability. The experimental results show that the algorithm proposed in this paper has excellent performance with guaranteed low latency, 21% improvement in long-term revenue and 5.6% improvement in UR success rate compared with the other two algorithms.
引用
收藏
页码:6541 / 6550
页数:10
相关论文
共 40 条
[1]   A Deep Learning Approach for Mobility-Aware and Energy-Efficient Resource Allocation in MEC [J].
Ali, Zaiwar ;
Khaf, Sadia ;
Abbas, Ziaul Haq ;
Abbas, Ghulam ;
Muhammad, Fazal ;
Kim, Sunghwan .
IEEE ACCESS, 2020, 8 :179530-179546
[2]   Distributed Vehicle to Grid Integration Over Communication and Physical Networks With Uncertainty Effects [J].
Apostolopoulou, Dimitra ;
Poudineh, Rahmat ;
Sen, Anupama .
IEEE TRANSACTIONS ON SMART GRID, 2022, 13 (01) :626-640
[3]   Consortium Blockchain-Based Spectrum Trading for Network Slicing in 5G RAN: A Multi-Agent Deep Reinforcement Learning Approach [J].
Boateng, Gordon Owusu ;
Sun, Guolin ;
Mensah, Daniel Ayepah ;
Doe, Daniel Mawunyo ;
Ou, Ruijie ;
Liu, Guisong .
IEEE TRANSACTIONS ON MOBILE COMPUTING, 2023, 22 (10) :5801-5815
[4]   Blockchain-Enabled Resource Trading and Deep Reinforcement Learning-Based Autonomous RAN Slicing in 5G [J].
Boateng, Gordon Owusu ;
Ayepah-Mensah, Daniel ;
Doe, Daniel Mawunyo ;
Mohammed, Abegaz ;
Sun, Guolin ;
Liu, Guisong .
IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2022, 19 (01) :216-227
[5]   Deep Reinforcement Learning-Based Dynamic Resource Management for Mobile Edge Computing in Industrial Internet of Things [J].
Chen, Ying ;
Liu, Zhiyong ;
Zhang, Yongchao ;
Wu, Yuan ;
Chen, Xin ;
Zhao, Lian .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (07) :4925-4934
[6]   Resource Allocation for Low-Latency NOMA-V2X Networks Using Reinforcement Learning [J].
Ding, Huiyi ;
Leung, Ka-Cheong .
IEEE CONFERENCE ON COMPUTER COMMUNICATIONS WORKSHOPS (IEEE INFOCOM WKSHPS 2021), 2021,
[7]   ETH Relay: A Cost-efficient Relay for Ethereum-based Blockchains [J].
Frauenthaler, Philipp ;
Sigwart, Marten ;
Spanring, Christof ;
Sober, Michael ;
Schulte, Stefan .
2020 IEEE INTERNATIONAL CONFERENCE ON BLOCKCHAIN (BLOCKCHAIN 2020), 2020, :204-213
[8]  
Gong L, 2014, IEEE INFOCOM SER, P1, DOI 10.1109/INFOCOM.2014.6847918
[9]  
Hee-Gon Kim, 2019, 2019 IEEE Conference on Network Softwarization (NetSoft). Proceedings, P405, DOI 10.1109/NETSOFT.2019.8806687
[10]   Energy-Efficient Heterogeneous Networking for Electric Vehicles Networks in Smart Future Cities [J].
Jiang, Dingde ;
Huo, Liuwei ;
Zhang, Peng ;
Lv, Zhihan .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2021, 22 (03) :1868-1880