Damping control by fusion of reinforcement learning and control Lyapunov functions

被引:1
|
作者
Glavic, Mevludin [1 ]
Ernst, Damien [1 ]
Wehenkel, Louis [1 ]
机构
[1] Univ Liege, Dept Comp Sci & Elect Engn, Sart Tilman B28, B-4000 Liege, Belgium
来源
2006 38TH ANNUAL NORTH AMERICAN POWER SYMPOSIUM, NAPS-2006 PROCEEDINGS | 2006年
关键词
reinforcement learning; control Lyapunov functions; power system damping control;
D O I
10.1109/NAPS.2006.359598
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
The main idea behind the concept, proposed in the paper, is the opportunity to make control systems with increased capabilities by synergetic fusion of the domain-specific knowledge and the methodologies from control theory and artificial intelligence. The particular approach considered combines Control Lyapunov Functions (CLF), a constructive control technique, and Reinforcement Learning (RL) in attempt to optimize a mix of system stability and performance. Two control schemes are proposed and the capabilities of the resulting controllers are illustrated on a control problem involving a Thyristor Controlled Series Capacitor (TCSC) for damping oscillations in a four-machine power system.
引用
收藏
页码:361 / +
页数:2
相关论文
共 50 条
  • [11] Safe Reinforcement Learning Using Robust Control Barrier Functions
    Emam, Yousef
    Notomista, Gennaro
    Glotfelter, Paul
    Kira, Zsolt
    Egerstedt, Magnus
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2025, 10 (03): : 2886 - 2893
  • [12] APPLICATION OF REINFORCEMENT LEARNING IN MULTISENSOR FUSION PROBLEMS WITH CONFLICTING CONTROL OBJECTIVES
    Ou, Shichao
    Fagg, Andrew H.
    Shenoy, Prashant
    Chen, Liancheng
    INTELLIGENT AUTOMATION AND SOFT COMPUTING, 2009, 15 (02): : 223 - 235
  • [13] Numerical Construction of Nonsmooth Control Lyapunov Functions
    Baier, Robert
    Braun, Philipp
    Gruene, Lars
    Kellett, Christopher M.
    LARGE-SCALE AND DISTRIBUTED OPTIMIZATION, 2018, 2227 : 343 - 373
  • [14] Control Lyapunov functions and Zubov's method
    Camilli, Fabio
    Gruene, Lars
    Wirth, Fabian
    SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2008, 47 (01) : 301 - 326
  • [15] HOMOGENEOUS FEEDBACK CONTROL OF NONLINEAR SYSTEMS BASED ON CONTROL LYAPUNOV FUNCTIONS
    Zhang, Junfeng
    Han, Zhengzhi
    Huang, Jun
    ASIAN JOURNAL OF CONTROL, 2014, 16 (04) : 1082 - 1090
  • [16] Scalable Designs for Reinforcement Learning-Based Wide-Area Damping Control
    Mukherjee, Sayak
    Chakrabortty, Aranya
    Bai, He
    Darvishi, Atena
    Fardanesh, Bruce
    IEEE TRANSACTIONS ON SMART GRID, 2021, 12 (03) : 2389 - 2401
  • [17] Premium control with reinforcement learning
    Palmborg, Lina
    Lindskog, Filip
    ASTIN BULLETIN-THE JOURNAL OF THE INTERNATIONAL ACTUARIAL ASSOCIATION, 2023, : 233 - 257
  • [18] Reinforcement learning for robot control
    Smart, WD
    Kaelbling, LP
    MOBILE ROBOTS XVI, 2002, 4573 : 92 - 103
  • [19] Reinforcement learning for control of valves
    Siraskar, Rajesh
    MACHINE LEARNING WITH APPLICATIONS, 2021, 4
  • [20] Constructing Action Set from Basis Functions for Reinforcement Learning of Robot Control
    Yamaguchi, Akihiko
    Takamatsu, Jun
    Ogasawara, Tsukasa
    ICRA: 2009 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, VOLS 1-7, 2009, : 4173 - 4180