Meta-learning and proximal policy optimization driven two-stage emergency allocation strategy for multi-energy system against typhoon disasters

被引:0
作者
Zhang, Guozhou [1 ]
Hu, Weihao [2 ]
Zhao, Yincheng [2 ]
Cui, Zhengjie [2 ]
Chen, Jianjun [2 ]
Tang, Chao [1 ]
Chen, Zhe [3 ]
机构
[1] Southwest Univ, Coll Engn & Technol, Chongqing, Peoples R China
[2] Univ Elect Sci & Technol China, Sch Mech & Elect Engn, Chengdu, Peoples R China
[3] Aalborg Univ, Dept Energy Technol, Pontoppidanstr 111, Aalborg, Denmark
基金
中国国家自然科学基金;
关键词
Multi-energy system; Resilience improvement; Two-stage optimization framework; Meta-learning; Deep reinforcement learning; POWER GRID RESILIENCE; WIND ENERGY; ENHANCEMENT; OPERATION; MODEL;
D O I
10.1016/j.renene.2024.121806
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
To achieve resilience improvement of the multi-energy system against typhoon disasters, this study designs a novel two-stage optimization framework that considers the emergency allocation of distributed resources under typhoon disasters to fully exploit the potential of distributed resources for resilience enhancement. Firstly, we formulate the emergency allocation of distributed resources as a Markov decision process. Then, a meta-learningdriven proximal policy optimization method is utilized to solve it. Different from that the existing reinforcement learning methods always ignore the unpredictable change caused by typhoon and keep multi-energy system dynamics invariant, limiting its control performance. The proposed method embeds meta-learning to fine-tune the pre-trained allocation policy to new tasks with high adaptability and few interactions. Finally, comparison results with other benchmark methods are carried out and shows that the proposed method can learn the appropriate resource allocation policy for multi-energy system and achieve better resilience enhancement, yielding fast application efficiency and good generalization ability for emergency fault conditions.
引用
收藏
页数:18
相关论文
共 41 条
[1]  
[Anonymous], 2021, Billion Dollar Weather and Climate Disasters: Overview
[2]   Exergoeconomic and environmental impact evaluation of wind energy assisted hybrid solar dryer and conventional solar dryer [J].
Atalay, Halil .
RENEWABLE ENERGY, 2022, 200 :1416-1425
[3]   Design of robust MPPT controller for grid-connected PMSG-Based wind turbine via perturbation observation based nonlinear adaptive control [J].
Chen, Jian ;
Yao, Wei ;
Zhang, Chuan-Ke ;
Ren, Yaxing ;
Jiang, Lin .
RENEWABLE ENERGY, 2019, 134 :478-495
[4]   A Novel Knowledge Sharing Method for Rolling Bearing Fault Detection Against Impact of Different Signal Sampling Frequencies [J].
Chen, Jianjun ;
Hu, Weihao ;
Zhang, Guozhou ;
Hu, Jiaxiang ;
Huang, Qi ;
Chen, Zhe ;
Blaabjerg, Frede .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
[5]   Intelligent hurricane resilience enhancement of power distribution systems via deep reinforcement learning [J].
Dehghani, Nariman L. ;
Jeddi, Ashkan B. ;
Shafieezadeh, Abdollah .
APPLIED ENERGY, 2021, 285
[6]   Power System Resilience Enhancement in Typhoons Using a Three-Stage Day-Ahead Unit Commitment [J].
Ding, Tao ;
Qu, Ming ;
Wang, Zekai ;
Chen, Bo ;
Chen, Chen ;
Shahidehpour, Mohammad .
IEEE TRANSACTIONS ON SMART GRID, 2021, 12 (03) :2153-2164
[7]   Resilient Operation of Distribution Grids Using Deep Reinforcement Learning [J].
Hosseini, Mohammad Mehdi ;
Parvania, Masood .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2022, 18 (03) :2100-2109
[8]   Research and application of a hybrid model based on Meta learning strategy for wind power deterministic and probabilistic forecasting [J].
Hu, Jianming ;
Heng, Jiani ;
Tang, Jingwei ;
Guo, Miaolin .
ENERGY CONVERSION AND MANAGEMENT, 2018, 173 :197-209
[9]   Integration of Preventive and Emergency Responses for Power Grid Resilience Enhancement [J].
Huang, Gang ;
Wang, Jianhui ;
Chen, Chen ;
Qi, Junjian ;
Guo, Chuangxin .
IEEE TRANSACTIONS ON POWER SYSTEMS, 2017, 32 (06) :4451-4463
[10]  
[姜涛 Jiang Tao], 2022, [中国电机工程学报, Proceedings of the Chinese Society of Electrical Engineering], V42, P6625