Enhancing cybersecurity in wind turbines: A resilient reinforcement learning-based optimal control for mitigating FDI attacks

被引:5
作者
Mazare, Mahmood [1 ]
Ramezani, Hossein
机构
[1] Clemson Univ, Dept Elect & Comp Engn, Clemson, SC 29634 USA
关键词
Wind turbine; Security; Anomaly detection; Optimal resilient control; Reinforcement learning; MODEL-PREDICTIVE CONTROL;
D O I
10.1016/j.apenergy.2024.123939
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
The growing importance of wind energy underscores the critical importance of cybersecurity protocols, especially in identifying vulnerabilities and developing defenses. In particular, False Data Injection (FDI) attacks targeting the communication link between rotor speed sensors and wind turbine (WT) controllers (WT) pose a significant threat and can lead to operational disruptions such as drive train overload and reduced power generation efficiency. In response to these challenges, this study presents an innovative and robust learning-based control framework for WT systems with state constraints. This framework integrates an actor-critic Reinforcement Learning (RL) mechanism with a backstepping approach that utilizes a Barrier Lyapunov Function (BLF) to limit rotor speeds uniformly within a predetermined range to ensure adaptation to a smoothly feasible set. The learning-based control strategy, augmented by backstepping techniques, is formulated using a constrained Hamilton-Jacobi-Bellman (HJB) function. This architecture incorporates adaptive neural network identifiers that enable iterative updates of both actor and critic components. The key advance of this approach lies in its theoretical foundations, which show that the developed elastic scheme guarantees the boundedness of all system states within the predefined compact set. Finally, empirical results from implementation experiments confirm the effectiveness and robustness of the proposed control methodology.
引用
收藏
页数:16
相关论文
共 37 条
[11]   Model predictive control for wind power gradients [J].
Hovgaard, Tobias Gybel ;
Boyd, Stephen ;
Jorgensen, John Bagterp .
WIND ENERGY, 2015, 18 (06) :991-1006
[12]   On the design and tuning of linear model predictive control for wind turbines [J].
Jain, Achin ;
Schildbach, Georg ;
Fagiano, Lorenzo ;
Morari, Manfred .
RENEWABLE ENERGY, 2015, 80 :664-673
[13]   Combined Feedback-Feedforward Control of Wind Turbines Using State-Constrained Model Predictive Control [J].
Koerber, Arne ;
King, Rudibert .
IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY, 2013, 21 (04) :1117-1128
[14]   Stable feedback linearization-based economic MPC scheme for thermal power plant [J].
Kong, Xiaobing ;
Abdelbaky, Mohamed Abdelkarim ;
Liu, Xiangjie ;
Lee, Kwang Y. .
ENERGY, 2023, 268
[15]  
Kumari Apama, 2021, Proceedings of the 2021 International Conference on Computing, Communication, and Intelligent Systems (ICCCIS), P972, DOI 10.1109/ICCCIS51004.2021.9397241
[16]   Multi-agent-based decentralized residential energy management using Deep Reinforcement Learning [J].
Kumari, Aparna ;
Kakkar, Riya ;
Tanwar, Sudeep ;
Garg, Deepak ;
Polkowski, Zdzislaw ;
Alqahtani, Fayez ;
Tolba, Amr .
JOURNAL OF BUILDING ENGINEERING, 2024, 87
[17]   SV2G-ET: A Secure Vehicle-to-Grid Energy Trading Scheme Using Deep Reinforcement Learning [J].
Kumari, Aparna ;
Trivedi, Mihir ;
Tanwar, Sudeep ;
Sharma, Gulshan ;
Sharma, Ravi .
INTERNATIONAL TRANSACTIONS ON ELECTRICAL ENERGY SYSTEMS, 2022, 2022
[18]   A Reinforcement-Learning-Based Secure Demand Response Scheme for Smart Grid System [J].
Kumari, Aparna ;
Tanwar, Sudeep .
IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (03) :2180-2191
[19]   Q-Learning based Maximum Power Extraction for Wind Energy Conversion System With Variable Wind Speed [J].
Kushwaha, Ashish ;
Gopal, Madan ;
Singh, Bhim .
IEEE TRANSACTIONS ON ENERGY CONVERSION, 2020, 35 (03) :1160-1170
[20]  
Leonardo Bergami, 2017, Individual pitch control for load mitigation