Resilient Optimal Defensive Strategy of TSK Fuzzy-Model-Based Microgrids' System via a Novel Reinforcement Learning Approach

被引:57
作者
Zhang, Huifeng [1 ]
Yue, Dong [1 ]
Dou, Chunxia [1 ]
Xie, Xiangpeng [1 ]
Li, Kang [2 ]
Hancke, Gerhardus P. [3 ,4 ]
机构
[1] Nanjing Univ Posts & Telecommun, Inst Adv Technol, Nanjing 210023, Jiangsu, Peoples R China
[2] Univ Leeds, Sch Elect & Elect Engn, Leeds LS2 9JT, W Yorkshire, England
[3] Nanjing Univ Posts & Telecommun, Coll Automat, Nanjing 210023, Jiangsu, Peoples R China
[4] Univ Pretoria, Dept Comp Engn, ZA-0028 Pretoria, South Africa
关键词
Microgrids; Security; Indexes; Economics; Power system stability; Propagation losses; Uncertainty; reinforcement learning (RL); resilient optimal defensive; Takagi-Sugeuo-Kang (TSK) fuzzy system; ECONOMIC EMISSION; DIFFERENTIAL EVOLUTION; WIND POWER; UNCERTAINTY;
D O I
10.1109/TNNLS.2021.3105668
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With consideration of false data injection (FDI) on the demand side, it brings a great challenge for the optimal defensive strategy with the security issue, voltage stability, power flow, and economic cost indexes. This article proposes a Takagi-Sugeuo-Kang (TSK) fuzzy system-based reinforcement learning approach for the resilient optimal defensive strategy of interconnected microgrids. Due to FDI uncertainty of the system load, TSK-based deep deterministic policy gradient (DDPG) is proposed to learn the actor network and the critic network, where multiple indexes' assessment occurs in the critic network, and the security switching control strategy is made in the actor network. Alternating direction method of multipliers (ADMM) method is improved for policy gradient with online coordination between the actor network and the critic network learning, and its convergence and optimality are proved properly. On the basis of security switching control strategy, the penalty-based boundary intersection (PBI)-based multiobjective optimization method is utilized to solve economic cost and emission issues simultaneously with considering voltage stability and rate-of-change of frequency (RoCoF) limits. According to simulation results, it reveals that the proposed resilient optimal defensive strategy can be a viable and promising alternative for tackling uncertain attack problems on interconnected microgrids.
引用
收藏
页码:1921 / 1931
页数:11
相关论文
共 34 条
[1]   Scenario-based dynamic economic emission dispatch considering load and wind power uncertainties [J].
Aghaei, Jamshid ;
Niknam, Taher ;
Azizipanah-Abarghooee, Rasoul ;
Arroyo, Jose M. .
INTERNATIONAL JOURNAL OF ELECTRICAL POWER & ENERGY SYSTEMS, 2013, 47 :351-367
[2]   Energy Management in Multi-Microgrid Systems-Development and Assessment [J].
Arefifar, Seyed Ali ;
Ordonez, Martin ;
Mohamed, Yasser Abdel-Rady I. .
IEEE TRANSACTIONS ON POWER SYSTEMS, 2017, 32 (02) :910-922
[3]  
Boyd S., 2011, FOUND TRENDS MACH LE, DOI DOI 10.1561/2200000016
[4]   Power System Resilience Enhancement in Typhoons Using a Three-Stage Day-Ahead Unit Commitment [J].
Ding, Tao ;
Qu, Ming ;
Wang, Zekai ;
Chen, Bo ;
Chen, Chen ;
Shahidehpour, Mohammad .
IEEE TRANSACTIONS ON SMART GRID, 2021, 12 (03) :2153-2164
[5]   A New Model for Resilient Distribution Systems by Microgrids Formation [J].
Ding, Tao ;
Lin, Yanling ;
Li, Gengfeng ;
Bie, Zhaohong .
IEEE TRANSACTIONS ON POWER SYSTEMS, 2017, 32 (05) :4145-4147
[6]   Resilient Distributed DC Optimal Power Flow Against Data Integrity Attack [J].
Duan, Jie ;
Zeng, Wente ;
Chow, Mo-Yuen .
IEEE TRANSACTIONS ON SMART GRID, 2018, 9 (04) :3543-3552
[7]   Resilience Assessment of Distribution Systems Integrated With Distributed Energy Resources [J].
Gautam, Prajjwal ;
Piya, Prasanna ;
Karki, Rajesh .
IEEE TRANSACTIONS ON SUSTAINABLE ENERGY, 2021, 12 (01) :338-348
[8]   Reliability Assessment of a Cyber Physical Microgrid System in Island Mode [J].
Guo, Jing ;
Liu, Wenxia ;
Syed, Furcian R. ;
Zhang, Jianhua .
CSEE JOURNAL OF POWER AND ENERGY SYSTEMS, 2019, 5 (01) :46-55
[9]   Resilient Frequency Control Design for Microgrids Under False Data Injection [J].
Khalghani, Mohammad Reza ;
Solanki, Jignesh ;
Solanki, Sarika Khushalani ;
Khooban, Mohammad Hassan ;
Sargolzaei, Arman .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2021, 68 (03) :2151-2162
[10]   Reserve Capability Assessment Considering Correlated Uncertainty in Microgrid [J].
Khan, Sohail ;
Gawlik, Wolfgang ;
Palensky, Peter .
IEEE TRANSACTIONS ON SUSTAINABLE ENERGY, 2016, 7 (02) :637-646