Enhancing cybersecurity in wind turbines: A resilient reinforcement learning-based optimal control for mitigating FDI attacks

被引:5
作者
Mazare, Mahmood [1 ]
Ramezani, Hossein
机构
[1] Clemson Univ, Dept Elect & Comp Engn, Clemson, SC 29634 USA
关键词
Wind turbine; Security; Anomaly detection; Optimal resilient control; Reinforcement learning; MODEL-PREDICTIVE CONTROL;
D O I
10.1016/j.apenergy.2024.123939
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
The growing importance of wind energy underscores the critical importance of cybersecurity protocols, especially in identifying vulnerabilities and developing defenses. In particular, False Data Injection (FDI) attacks targeting the communication link between rotor speed sensors and wind turbine (WT) controllers (WT) pose a significant threat and can lead to operational disruptions such as drive train overload and reduced power generation efficiency. In response to these challenges, this study presents an innovative and robust learning-based control framework for WT systems with state constraints. This framework integrates an actor-critic Reinforcement Learning (RL) mechanism with a backstepping approach that utilizes a Barrier Lyapunov Function (BLF) to limit rotor speeds uniformly within a predetermined range to ensure adaptation to a smoothly feasible set. The learning-based control strategy, augmented by backstepping techniques, is formulated using a constrained Hamilton-Jacobi-Bellman (HJB) function. This architecture incorporates adaptive neural network identifiers that enable iterative updates of both actor and critic components. The key advance of this approach lies in its theoretical foundations, which show that the developed elastic scheme guarantees the boundedness of all system states within the predefined compact set. Finally, empirical results from implementation experiments confirm the effectiveness and robustness of the proposed control methodology.
引用
收藏
页数:16
相关论文
共 37 条
[1]  
Aparna Kumari, 2021, 2021 IEEE GLOB WORKS, P1
[2]   Analysis of aeroelastic loads and their contributions to fatigue damage [J].
Bergami, L. ;
Gaunaa, M. .
SCIENCE OF MAKING TORQUE FROM WIND 2012, 2014, 555
[3]   Reinforcement-Based Robust Variable Pitch Control of Wind Turbines [J].
Chen, Peng ;
Han, Dezhi ;
Tan, Fuxiao ;
Wang, Jun .
IEEE ACCESS, 2020, 8 :20493-20502
[4]   Reinforcement Learning-Based Wind Farm Control: Toward Large Farm Applications via Automatic Grouping and Transfer Learning [J].
Dong, Hongyang ;
Zhao, Xiaowei .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2023, 19 (12) :11833-11845
[5]  
Ehsan Hosseini, 2020, Renew Energy, V157, P897
[6]   Wind turbine pitch reinforcement learning control improved by PID regulator and learning observer [J].
Enrique Sierra-Garcia, J. ;
Santos, Matilde ;
Pandit, Ravi .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2022, 111
[7]  
Felipe Alarcon O, 2017, 2017 CHILEAN C EL EN, P1
[8]   Actor-critic continuous state reinforcement learning for wind-turbine control robust optimization [J].
Fernandez-Gauna, Borja ;
Grana, Manuel ;
Osa-Amilibia, Juan-Luis ;
Larrucea, Xabier .
INFORMATION SCIENCES, 2022, 591 :365-380
[9]   Efficiency Enhancements of Wind Energy Conversion Systems Using Soft Switching Multiple Model Predictive Control [J].
Gavgani, Babak Mehdizadeh ;
Farnam, Arash ;
De Kooning, Jeroen D. M. ;
Crevecoeur, Guillaume .
IEEE TRANSACTIONS ON ENERGY CONVERSION, 2022, 37 (02) :1187-1199
[10]   Maximum Power Point Tracking and Output Power Control on Pressure Coupling Wind Energy Conversion System [J].
Hoang Thinh Do ;
Tri Dung Dang ;
Hoai Vu Anh Truong ;
Kyoung Kwan Ahn .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2018, 65 (02) :1316-1324