Enhancing cybersecurity in wind turbines: A resilient reinforcement learning-based optimal control for mitigating FDI attacks

被引:5
作者
Mazare, Mahmood [1 ]
Ramezani, Hossein
机构
[1] Clemson Univ, Dept Elect & Comp Engn, Clemson, SC 29634 USA
关键词
Wind turbine; Security; Anomaly detection; Optimal resilient control; Reinforcement learning; MODEL-PREDICTIVE CONTROL;
D O I
10.1016/j.apenergy.2024.123939
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
The growing importance of wind energy underscores the critical importance of cybersecurity protocols, especially in identifying vulnerabilities and developing defenses. In particular, False Data Injection (FDI) attacks targeting the communication link between rotor speed sensors and wind turbine (WT) controllers (WT) pose a significant threat and can lead to operational disruptions such as drive train overload and reduced power generation efficiency. In response to these challenges, this study presents an innovative and robust learning-based control framework for WT systems with state constraints. This framework integrates an actor-critic Reinforcement Learning (RL) mechanism with a backstepping approach that utilizes a Barrier Lyapunov Function (BLF) to limit rotor speeds uniformly within a predetermined range to ensure adaptation to a smoothly feasible set. The learning-based control strategy, augmented by backstepping techniques, is formulated using a constrained Hamilton-Jacobi-Bellman (HJB) function. This architecture incorporates adaptive neural network identifiers that enable iterative updates of both actor and critic components. The key advance of this approach lies in its theoretical foundations, which show that the developed elastic scheme guarantees the boundedness of all system states within the predefined compact set. Finally, empirical results from implementation experiments confirm the effectiveness and robustness of the proposed control methodology.
引用
收藏
页数:16
相关论文
共 37 条
[21]   An Extended Differential Flatness Approach for the Health-Conscious Nonlinear Model Predictive Control of Lithium-Ion Batteries [J].
Liu, Ji ;
Li, Guang ;
Fathy, Hosam K. .
IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY, 2017, 25 (05) :1882-1889
[22]   Offshore wind power generation system control using robust economic MPC scheme [J].
Ma, Lele ;
Kong, Xiaobing ;
Liu, Xiangjie ;
Abdelbaky, Mohamed Abdelkarim ;
Besheer, Ahmad H. ;
Wang, Mingyu ;
Lee, Kwang Y. .
OCEAN ENGINEERING, 2023, 283
[23]  
Mahmood Mazare, 2024, Appl Energy, V353
[24]   Attack-resilient pitch angle control for variable-speed wind turbine systems under cyber threats [J].
Mazare, Mahmood ;
Taghizadeh, Mostafa ;
Asharioun, Hadi .
INTERNATIONAL JOURNAL OF ADAPTIVE CONTROL AND SIGNAL PROCESSING, 2023, 37 (06) :1423-1439
[25]   Uncertainty estimator-based dual layer adaptive fault-tolerant control for wind turbines [J].
Mazare, Mahmood ;
Taghizadeh, Mostafa .
RENEWABLE ENERGY, 2022, 188 :545-560
[26]   Fault tolerant control of wind turbines with simultaneous actuator and sensor faults using adaptive time delay control [J].
Mazare, Mahmood ;
Taghizadeh, Mostafa ;
Ghaf-Ghanbari, Pegah .
RENEWABLE ENERGY, 2021, 174 :86-101
[27]   Nonlinear PI control for variable pitch wind turbine [J].
Ren, Yaxing ;
Li, Liuying ;
Brindley, Joseph ;
Jiang, Lin .
CONTROL ENGINEERING PRACTICE, 2016, 50 :84-94
[28]  
Tavakol Aghaei Vahid, 2023, Appl Energy, V341
[29]   Online adaptive algorithm for optimal control with integral reinforcement learning [J].
Vamvoudakis, Kyriakos G. ;
Vrabie, Draguna ;
Lewis, Frank L. .
INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2014, 24 (17) :2686-2710
[30]   Online actor-critic algorithm to solve the continuous-time infinite horizon optimal control problem [J].
Vamvoudakis, Kyriakos G. ;
Lewis, Frank L. .
AUTOMATICA, 2010, 46 (05) :878-888