Multi-Agent Deep Reinforcement Learning for Sectional AGC Dispatch

被引:17
|
作者
Li, Jiawen [1 ]
Yu, Tao [1 ]
Zhu, Hanxin [1 ]
Li, Fusheng [1 ]
Lin, Dan [1 ]
Li, Zhuohuan [1 ]
机构
[1] South China Univ Technol, Coll Elect Power, Guangzhou 510640, Peoples R China
来源
IEEE ACCESS | 2020年 / 8卷
基金
中国国家自然科学基金;
关键词
Automatic generation control; Security; Power grids; Training; Phasor measurement units; Optimization; Voltage measurement; hierarchical multi-agent deep deterministic policy gradient; sectional AGC dispatch; reinforcement learning; AUTOMATIC-GENERATION CONTROL;
D O I
10.1109/ACCESS.2020.3019929
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Aiming at the problem of coordinating system economy, security and control performance in secondary frequency regulation of the power grid, a sectional automatic generation control (AGC) dispatch framework is proposed. The dispatch of AGC is classified as three sections with the sectional dispatch method. Besides, a hierarchical multi-agent deep deterministic policy gradient (HMA-DDPG) algorithm is proposed for the framework in this paper. This algorithm, considering economy and security of the system in AGC dispatch, can ensure the control performance of AGC. Furthermore, through simulation, the control effect of the sectional dispatch method and several AGC dispatch methods on the Guangdong province power grid system and the IEEE 39 bus system is compared. The result shows that the best effect can be achieved with the sectional dispatch method.
引用
收藏
页码:158067 / 158081
页数:15
相关论文
共 50 条
  • [1] QSOD: Hybrid Policy Gradient for Deep Multi-agent Reinforcement Learning
    Rehman, Hafiz Muhammad Raza Ur
    On, Byung-Won
    Ningombam, Devarani Devi
    Yi, Sungwon
    Choi, Gyu Sang
    IEEE ACCESS, 2021, 9 : 129728 - 129741
  • [2] Multi-agent deep reinforcement learning: a survey
    Gronauer, Sven
    Diepold, Klaus
    ARTIFICIAL INTELLIGENCE REVIEW, 2022, 55 (02) : 895 - 943
  • [3] Multi-agent deep reinforcement learning: a survey
    Sven Gronauer
    Klaus Diepold
    Artificial Intelligence Review, 2022, 55 : 895 - 943
  • [4] Decentralized Multi-Agent Pursuit Using Deep Reinforcement Learning
    de Souza, Cristino, Jr.
    Newbury, Rhys
    Cosgun, Akansel
    Castillo, Pedro
    Vidolov, Boris
    Kulic, Dana
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (03): : 4552 - 4559
  • [5] Applications of Multi-Agent Deep Reinforcement Learning: Models and Algorithms
    Ibrahim, Abdikarim Mohamed
    Yau, Kok-Lim Alvin
    Chong, Yung-Wey
    Wu, Celimuge
    APPLIED SCIENCES-BASEL, 2021, 11 (22):
  • [6] Multi-agent deep reinforcement learning strategy for distributed energy
    Xi, Lei
    Sun, Mengmeng
    Zhou, Huan
    Xu, Yanchun
    Wu, Junnan
    Li, Yanying
    MEASUREMENT, 2021, 185
  • [7] Effective credit assignment deep policy gradient multi-agent reinforcement learning for vehicle dispatch
    Xiaohui Huang
    Xiong Zhang
    Jiahao Ling
    Xuebo Cheng
    Applied Intelligence, 2023, 53 : 23457 - 23469
  • [8] Effective credit assignment deep policy gradient multi-agent reinforcement learning for vehicle dispatch
    Huang, Xiaohui
    Zhang, Xiong
    Ling, Jiahao
    Cheng, Xuebo
    APPLIED INTELLIGENCE, 2023, 53 (20) : 23457 - 23469
  • [9] A review of cooperative multi-agent deep reinforcement learning
    Oroojlooy, Afshin
    Hajinezhad, Davood
    APPLIED INTELLIGENCE, 2023, 53 (11) : 13677 - 13722
  • [10] A review of cooperative multi-agent deep reinforcement learning
    Afshin Oroojlooy
    Davood Hajinezhad
    Applied Intelligence, 2023, 53 : 13677 - 13722