A Multiagent Deep Reinforcement Learning-Enabled Dual-Branch Damping Controller for Multimode Oscillation

被引:5
|
作者
Zhang, Guozhou [1 ]
Zhao, Junbo [2 ]
Hu, Weihao [1 ]
Cao, Di [1 ]
Kamwa, Innocent [3 ]
Duan, Nan [4 ]
Chen, Zhe [5 ]
机构
[1] Univ Elect Sci & Technol China, Sch Mech & Elect Engn, Chengdu 610054, Peoples R China
[2] Univ Connecticut, Dept Elect & Comp Engn, Storrs, CT 06269 USA
[3] Laval Univ, Quebec City, PQ G1V 0A6, Canada
[4] Lawrence Livermore Natl Lab, Livermore, CA 94550 USA
[5] Aalborg Univ, Dept Energy Technol, DK-9220 Aalborg, Denmark
关键词
Damping; Torque; Oscillators; Tuning; Robustness; Resonant frequency; Power system stability; Dual-branch (DB) damping controller; low-frequency oscillation (LFO); multiagent deep reinforcement learning (MADRL); power system control; ultralow-frequency oscillation (ULFO); ULTRALOW-FREQUENCY OSCILLATIONS; INTERAREA OSCILLATIONS; POWER-SYSTEMS; PERFORMANCE; SELECTION;
D O I
10.1109/TCST.2022.3176736
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This study develops a multiagent deep reinforcement learning (MADRL)-enabled framework for the decentralized cooperative control of a novel dual-branch (DB) damping controller for both low-frequency oscillation (LFO) and ultralow-frequency oscillation (ULFO). It has two branches, each of which consists of a proportional resonance (PR) and a second-order polynomial that is designed to handle target oscillation modes. To improve the robustness of the controller to system uncertainties, MADRL is developed, where multiagents are centrally trained to obtain the coordinated adaptive control policy while being executed in a decentralized manner to provide the optimal parameter setting for each controller with only local states. Comparisons with the IEEE 10-machine 39-bus system demonstrate that the proposed method achieves better robustness to uncertainties, lower communication delay, and single-point failure, as well as damping control performances for both LFO and ULFO.
引用
收藏
页码:483 / 492
页数:10
相关论文
共 48 条
  • [21] A Novel Multi-Agent Deep Reinforcement Learning-enabled Distributed Power Allocation Scheme for mmWave Cellular Networks
    Zhang, Xiang
    Bhuyan, Arupjyoti
    Kasera, Sneha Kumar
    Ji, Mingyue
    2023 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS WORKSHOPS, ICC WORKSHOPS, 2023, : 73 - 79
  • [22] Optimal Computation Offloading in Collaborative LEO-IoT Enabled MEC: A Multiagent Deep Reinforcement Learning Approach
    Lyu, Yifeng
    Liu, Zhi
    Fan, Rongfei
    Zhan, Cheng
    Hu, Han
    An, Jianping
    IEEE TRANSACTIONS ON GREEN COMMUNICATIONS AND NETWORKING, 2023, 7 (02): : 996 - 1011
  • [23] Multiagent Deep Reinforcement Learning for Dynamic Avatar Migration in AIoT-Enabled Vehicular Metaverses With Trajectory Prediction
    Chen, Junlong
    Kang, Jiawen
    Xu, Minrui
    Xiong, Zehui
    Niyato, Dusit
    Chen, Chuan
    Jamalipour, Abbas
    Xie, Shengli
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (01) : 70 - 83
  • [24] A digital twin-based sim-to-real transfer for deep reinforcement learning-enabled industrial robot grasping
    Liu, Yongkui
    Xu, He
    Liu, Ding
    Wang, Lihui
    ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING, 2022, 78
  • [25] Automating venous thromboembolism risk assessment: a dual-branch deep learning method using electronic medical records
    Yang, Jianhua
    He, Jianfeng
    Zhang, Hongjiang
    FRONTIERS IN MEDICINE, 2023, 10
  • [26] Y-Net: a dual-branch deep learning network for nonlinear absorption tomography with wavelength modulation spectroscopy
    Wang, Zhenhai
    Zhu, Ning
    Wang, Weitian
    Chao, Xing
    OPTICS EXPRESS, 2022, 30 (02) : 2156 - 2172
  • [27] Deep learning enhanced super-resolution x-ray fluorescence microscopy by a dual-branch network
    Zheng, Xiaoyin
    Kankanallu, Varun R.
    Lo, Chang-An
    Pattammattel, Ajith
    Chu, Yong
    Chen-Wiegart, Yu-Chen Karen
    Huang, Xiaojing
    OPTICA, 2024, 11 (02): : 146 - 154
  • [28] Deep Reinforcement Learning Enabled Bi-level Robust Parameter Optimization of Hydropower-dominated Systems for Damping Ultra-low Frequency Oscillation
    Guozhou Zhang
    Junbo Zhao
    Weihao Hu
    Di Cao
    Nan Duan
    Zhe Chen
    Frede Blaabjerg
    Journal of Modern Power Systems and Clean Energy, 2023, 11 (06) : 1770 - 1783
  • [29] Deep Reinforcement Learning Enabled Bi-Level Robust Parameter Optimization of Hydropower-Dominated Systems for Damping Ultra-Low Frequency Oscillation
    Zhang, Guozhou
    Zhao, Junbo
    Hu, Weihao
    Cao, Di
    Duan, Nan
    Chen, Zhe
    Blaabjerg, Frede
    JOURNAL OF MODERN POWER SYSTEMS AND CLEAN ENERGY, 2023, 11 (06) : 1770 - 1783
  • [30] Cooperative Management for PV/ESS-Enabled Electric Vehicle Charging Stations: A Multiagent Deep Reinforcement Learning Approach
    Shin, MyungJae
    Choi, Dae-Hyun
    Kim, Joongheon
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2020, 16 (05) : 3493 - 3503