Network Security Constrained Distributed Smart Grid Edge-Cloud Collaborative Optimization Scheduling

被引:0
|
作者
Pan, Xi'an [1 ]
Ai, Xin [1 ]
Hu, Junjie [1 ]
Wang, Kunyu [1 ]
Wang, Haoyang [1 ]
机构
[1] State Key Laboratory of Alternate Electrical Power System with Renewable Energy Sources, North China Electric Power University, Beijing,102206, China
来源
Diangong Jishu Xuebao/Transactions of China Electrotechnical Society | 2024年 / 39卷 / 19期
关键词
Associative storage - Benchmarking - Deep reinforcement learning - Depreciation - Distributed cloud - Dynamic programming - Edge computing - Electric load flow - Fire alarm systems - Fog computing - Geophysical prospecting - Geothermal fields - HVAC - HVDC power transmission - Integer programming - Job analysis - Linear programming - Mineral exploration - Organs (musical instruments) - Parallel processing systems - Passive solar - Phosphate deposits - Power management (telecommunication) - Random access storage - Reinforcement learning - Resource allocation - Springs (water) - Surface waters - Traffic congestion - Uninterruptible power systems - Virtual storage - Voltage scaling - Voltage stabilizing circuits;
D O I
10.19595/j.cnki.1000-6753.tces.231352
中图分类号
学科分类号
摘要
With the increasing penetration of distributed generation and the growing demand for power system flexibility, issues like voltage rise at the edge of distribution networks and network congestion under bidirectional power flow are becoming more prominent. Integrating and coordinating flexible resources at the user side through Distributed Smart Grids (DSG) is significant for enhancing the accommodation of distributed generation and the real-time supply-demand balancing capability of distribution systems. Considering the large quantity and high dispersion of flexible resource devices and the distinct characteristics of different prosumers, traditional centralized optimization and dispatch schemes as well as distributed computing methods will face greater challenges in solving efficiency and decision delivery timeliness. Against this background, this paper aims to develop a DSG system collaborative optimization and dispatch method that takes into account operational economy, energy network security, and decision timeliness concurrently. Firstly, mapping real-world prosumers who control and own flexible resources to intelligent agents in reinforcement learning, the optimization and dispatch of flexible resources in DSG is formulated as a multi-agent collaborative optimization model. The existing edge-cloud collaborative framework is extended to the optimization of flexible resources considering energy network security constraints, and a hierarchical optimization and dispatch framework of flexible resource-prosumer-DSG is established. Secondly, considering the differentiated characteristics of prosumers in aspects like types of flexible resource devices, photovoltaics (PV) is taken as distributed generation, and electric vehicles (EV), heating, ventilation and air conditioning (HVAC) of buildings, and energy storage systems (ESS) are taken as demand-side flexible resources. A heterogeneous intelligent agent interactive environment model is built based on the operational characteristics of different flexible resources. Meanwhile, to balance flexible resource operational requirements, overall economic efficiency and energy network security of the DSG system, user satisfaction evaluation of EV and HVAC operation and ESS operation cost are considered as local rewards, while system energy cost and energy network security evaluation are taken as global rewards, and a combined global-local reward mechanism for heterogeneous intelligent agents is proposed. Finally, to adapt to the collaborative training task of the heterogeneous intelligent agent system, an improved multi-agent proximal policy optimization (MAPPO) algorithm is proposed based on asynchronous update of agent policies in random order. Case studies on the IEEE 33-node system are conducted for analysis. Firstly, the proposed improved MAPPO algorithm is compared with existing multi-agent collaborative training schemes in the offline training stage. Secondly, the differences in flexible resource prosumers' power decisions with and without considering energy network constraints are analyzed in the online dispatch stage. Finally, the proposed method is compared with traditional mathematical programming and particle swarm optimization methods regarding optimization performance in real-time dispatch. The main conclusions are: (1) The edge-cloud collaborative hierarchical optimization and dispatch framework for DSG systems is established, which can obtain dispatch decisions faster in real-time dispatch compared to traditional centralized optimization and thus improve the timeliness of DSG power dispatch decisions. (2) The combined global-local reward mechanism for heterogeneous intelligent agents can achieve overall DSG system optimization and collaborative training objectives of balancing user comfort, economic efficiency and energy network security. (3) The proposed improved MAPPO algorithm adapted for heterogeneous intelligent agent training can maintain independent decision spaces for each agent while ensuring environment state stability in collaborative training through asynchronous policy updates in random order. © 2024 China Machine Press. All rights reserved.
引用
收藏
页码:6104 / 6118
相关论文
共 50 条
  • [31] An Edge-Cloud Collaborative Object Detection System
    Xu, Lei
    Yang, Dingkun
    UBIQUITOUS SECURITY, 2022, 1557 : 371 - 378
  • [32] Study on Edge-Cloud Collaborative Production Scheduling Based on Enterprises With Multi-Factory
    Ma, Jing
    Zhou, Hua
    Liu, Changchun
    E, Mingcheng
    Jiang, Zengqiang
    Wang, Qiang
    IEEE ACCESS, 2020, 8 : 30069 - 30080
  • [33] Edge-Cloud Collaborative Processing for Intelligent Internet of Things: A Case Study on Smart Surveillance
    Mudassar, Burhan A.
    Ko, Jong Hwan
    Mukhopadhyay, Saibal
    2018 55TH ACM/ESDA/IEEE DESIGN AUTOMATION CONFERENCE (DAC), 2018,
  • [34] BBNet: A Novel Convolutional Neural Network Structure in Edge-Cloud Collaborative Inference
    Zhou, Hongbo
    Zhang, Weiwei
    Wang, Chengwei
    Ma, Xin
    Yu, Haoran
    SENSORS, 2021, 21 (13)
  • [35] Edge-cloud Computing Systems for Smart Grid: State-of-the-art, Architecture, and Applications
    Li, Junlong
    Gu, Chenghong
    Xiang, Yue
    Li, Furong
    JOURNAL OF MODERN POWER SYSTEMS AND CLEAN ENERGY, 2022, 10 (04) : 805 - 817
  • [36] Edge-cloud Computing Systems for Smart Grid:State-of-the-art, Architecture, and Applications
    Junlong Li
    Chenghong Gu
    Yue Xiang
    Furong Li
    JournalofModernPowerSystemsandCleanEnergy, 2022, 10 (04) : 805 - 817
  • [37] DPS: Dynamic Pricing and Scheduling for Distributed Machine Learning Jobs in Edge-Cloud Networks
    Zhou, Ruiting
    Wang, Ne
    Huang, Yifeng
    Pang, Jinlong
    Chen, Hao
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2023, 22 (11) : 6377 - 6393
  • [38] Distributed Dataflow Across the Edge-Cloud Continuum
    Ekaireb, Tyler
    Brand, Lukas
    Avaraddy, Nagarjun
    Mock, Markus
    Krintz, Chandra
    Wolski, Rich
    2024 IEEE 17TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING, CLOUD 2024, 2024, : 316 - 327
  • [39] Collaborative Service Placement, Task Scheduling, and Resource Allocation for Task Offloading With Edge-Cloud Cooperation
    Fan, Wenhao
    Zhao, Liang
    Liu, Xun
    Su, Yi
    Li, Shenmeng
    Wu, Fan
    Liu, Yuan'an
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (01) : 238 - 256
  • [40] Cur-CoEdge: Curiosity-Driven Collaborative Request Scheduling in Edge-Cloud Systems
    Zhao, Yunfeng
    Qiu, Chao
    Shi, Xiaoyun
    Wang, Xiaofei
    Niyato, Dusit
    Leung, Victor C. M.
    IEEE INFOCOM 2024-IEEE CONFERENCE ON COMPUTER COMMUNICATIONS, 2024, : 411 - 420