Damping control by fusion of reinforcement learning and control Lyapunov functions

被引:1
|
作者
Glavic, Mevludin [1 ]
Ernst, Damien [1 ]
Wehenkel, Louis [1 ]
机构
[1] Univ Liege, Dept Comp Sci & Elect Engn, Sart Tilman B28, B-4000 Liege, Belgium
来源
2006 38TH ANNUAL NORTH AMERICAN POWER SYMPOSIUM, NAPS-2006 PROCEEDINGS | 2006年
关键词
reinforcement learning; control Lyapunov functions; power system damping control;
D O I
10.1109/NAPS.2006.359598
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
The main idea behind the concept, proposed in the paper, is the opportunity to make control systems with increased capabilities by synergetic fusion of the domain-specific knowledge and the methodologies from control theory and artificial intelligence. The particular approach considered combines Control Lyapunov Functions (CLF), a constructive control technique, and Reinforcement Learning (RL) in attempt to optimize a mix of system stability and performance. Two control schemes are proposed and the capabilities of the resulting controllers are illustrated on a control problem involving a Thyristor Controlled Series Capacitor (TCSC) for damping oscillations in a four-machine power system.
引用
收藏
页码:361 / +
页数:2
相关论文
共 50 条
  • [1] Construction of control Lyapunov functions for damping stabilization of control affine systems
    Hudon, N.
    Guay, M.
    SYSTEMS & CONTROL LETTERS, 2013, 62 (11) : 1009 - 1017
  • [2] Nonlinear Control System with Reinforcement Learning and Neural Networks Based Lyapunov Functions
    Rego, Rosana Cibely Batista
    Araujo, Fabio Meneghetti Ugulino de
    IEEE LATIN AMERICA TRANSACTIONS, 2021, 19 (08) : 1253 - 1260
  • [3] Safe Learning for Control using Control Lyapunov Functions and Control Barrier Functions: A Review
    Anand, Akhil
    Seel, Katrine
    Gjaerum, Vilde
    Hakansson, Anne
    Robinson, Haakon
    Saad, Aya
    KNOWLEDGE-BASED AND INTELLIGENT INFORMATION & ENGINEERING SYSTEMS (KSE 2021), 2021, 192 : 3987 - 3997
  • [4] Linguistic Lyapunov reinforcement learning control for robotic manipulators
    Kumar, Abhishek
    Sharma, Rajneesh
    NEUROCOMPUTING, 2018, 272 : 84 - 95
  • [5] Reinforcement Learning for Optimal Primary Frequency Control: A Lyapunov Approach
    Cui, Wenqi
    Jiang, Yan
    Zhang, Baosen
    IEEE TRANSACTIONS ON POWER SYSTEMS, 2023, 38 (02) : 1676 - 1688
  • [6] Lyapunov-based distributed reinforcement learning control with stability guarantee
    Yao, Jingshi
    Han, Minghao
    Yin, Xunyuan
    COMPUTERS & CHEMICAL ENGINEERING, 2025, 195
  • [7] Stable Inverse Reinforcement Learning: Policies From Control Lyapunov Landscapes
    Tesfazgi, Samuel
    Sprandl, Leonhard
    Lederer, Armin
    Hirche, Sandra
    IEEE OPEN JOURNAL OF CONTROL SYSTEMS, 2024, 3 : 358 - 374
  • [8] Behavioral-Fusion Control Based on Reinforcement Learning
    Hwang, Kao-Shing
    Chen, Yu-Jen
    Wu, Chun-Ju
    Wu, Cheng-Shong
    2009 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN AND CYBERNETICS (SMC 2009), VOLS 1-9, 2009, : 401 - 406
  • [9] Control and anti-control of chaos based on the moving largest Lyapunov exponent using reinforcement learning
    Han, Yanyan
    Ding, Jianpeng
    Du, Lin
    Lei, Youming
    PHYSICA D-NONLINEAR PHENOMENA, 2021, 428
  • [10] Finite Time Lyapunov Exponent Analysis of Model Predictive Control and Reinforcement Learning
    Krishna, Kartik
    Brunton, Steven L.
    Song, Zhuoyuan
    IEEE ACCESS, 2023, 11 : 118916 - 118930