Data-Driven Load Frequency Control for Stochastic Power Systems: A Deep Reinforcement Learning Method With Continuous Action Search

被引:276
作者
Yan, Ziming [1 ]
Xu, Yan [1 ]
机构
[1] Nanyang Technol Univ, Sch Elect & Elect Engn, Singapore 639798, Singapore
关键词
Continuous action search; deep reinforcement learning; load frequency control; stochastic power system;
D O I
10.1109/TPWRS.2018.2881359
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This letter proposes a data-driven, model-free method for load frequency control (LFC) against renewable energy uncertainties based on deep reinforcement learning (DRL) in continuous action domain. The proposed method can nonlinearly derive control strategies to minimize frequency deviation with faster response speed and stronger adaptability for unmolded system dynamics. It consists of offline optimization of LFC strategies with DRL and continuous action search, and online control with policy network where features are extracted by stacked denoising auto-encoders. Numerical simulations verify the effectiveness and advantages of proposed method over existing approaches.
引用
收藏
页码:1653 / 1656
页数:4
相关论文
共 8 条
[1]  
Bevrani H, 2014, POWER ELECTRON POWER, P1, DOI 10.1007/978-3-319-07278-4
[2]   Multiobjective design of load frequency control using genetic algorithms [J].
Daneshfar, Fatemeh ;
Bevrani, Hassan .
INTERNATIONAL JOURNAL OF ELECTRICAL POWER & ENERGY SYSTEMS, 2012, 42 (01) :257-263
[3]   A Robust Load Frequency Control Scheme for Power Systems Based on Second-Order Sliding Mode and Extended Disturbance Observer [J].
Liao, Kai ;
Xu, Yan .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2018, 14 (07) :3076-3086
[4]  
Lillicrap T., 2016, INT C MACH LEARN NEW
[5]  
Vincent P, 2010, J MACH LEARN RES, V11, P3371
[6]   Artificial emotional reinforcement learning for automatic generation control of large-scale interconnected power grids [J].
Yin, Linfei ;
Yu, Tao ;
Zhou, Lv ;
Huang, Linni ;
Zhang, Xiaoshun ;
Zheng, Baomin .
IET GENERATION TRANSMISSION & DISTRIBUTION, 2017, 11 (09) :2305-2313
[7]   Load Frequency Control of a Multi-Area Power System: An Adaptive Fuzzy Logic Approach [J].
Yousef, Hassan A. ;
AL-Kharusi, Khalfan ;
Albadi, Mohammed H. ;
Hosseinzadeh, Nasser .
IEEE TRANSACTIONS ON POWER SYSTEMS, 2014, 29 (04) :1822-1830
[8]   Stochastic Optimal Relaxed Automatic Generation Control in Non-Markov Environment Based on Multi-Step Q(λ) Learning [J].
Yu, Tao ;
Zhou, Bin ;
Chan, Ka Wing ;
Chen, Liang ;
Yang, Bo .
IEEE TRANSACTIONS ON POWER SYSTEMS, 2011, 26 (03) :1272-1282