Reinforcement learning based PID controller design for LFC in a microgrid

被引:20
|
作者
Esmaeili, Mehran [1 ]
Shayeghi, Hossein [1 ]
Nejad, Hamid Mohammad [1 ]
Younesi, Abdollah [1 ]
机构
[1] Univ Mohaghegh Ardabili, Tech Engn Dept, Ardebil, Iran
关键词
Design optimization; Control theory; Adaptive fuzzy logic control; Electrical power systems; Microgrid; Reinforcement learning; FREQUENCY CONTROL; ENERGY; SYSTEM;
D O I
10.1108/COMPEL-09-2016-0408
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Purpose - This paper aims to propose an improved reinforcement learning-based fuzzy-PID controller for load frequency control (LFC) of an island microgrid. Design/methodology/approach - To evaluate the performance of the proposed controller, three different types of controllers including optimal proportional-integral-derivative (PID) controller, optimal fuzzy PID controller and the proposed reinforcement learning-based fuzzy-PID controller are compared. Optimal PID controller and classic fuzzy-PID controller parameters are tuned using Non-dominated Sorting Genetic Algorithm-II algorithm to minimize overshoot, settling time and integral square error over a wide range of load variations. The simulations are carried out usingMATLAB/SIMULINK package. Findings - Simulation results indicated the superiority of the proposed reinforcement learning-based controller over fuzzy-PID and optimal-PID controllers in the same operational conditions. Originality/value - In this paper, an improved reinforcement learning-based fuzzy-PID controller is proposed for LFC of an island microgrid. The main advantage of the reinforcement learning-based controllers is their hardiness behavior along with uncertainties and parameters variations. Also, they do not need any knowledge about the system under control; thus, they can control any large system with high nonlinearities.
引用
收藏
页码:1287 / 1297
页数:11
相关论文
共 50 条
  • [1] Design of a Reinforcement Learning PID controller
    Guan, Zhe
    Yamamoto, Tom
    2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [2] Design of a reinforcement learning PID controller
    Guan, Zhe
    Yamamoto, Toru
    IEEJ TRANSACTIONS ON ELECTRICAL AND ELECTRONIC ENGINEERING, 2021, 16 (10) : 1354 - 1360
  • [3] Adaptive type-2 fuzzy PID controller for LFC in AC microgrid
    Sabahi, Kamel
    Tavan, Mehdi
    Hajizadeh, Amin
    SOFT COMPUTING, 2021, 25 (11) : 7423 - 7434
  • [4] Adaptive type-2 fuzzy PID controller for LFC in AC microgrid
    Kamel Sabahi
    Mehdi Tavan
    Amin Hajizadeh
    Soft Computing, 2021, 25 : 7423 - 7434
  • [5] Design of ABR Flow Controller Based on Reinforcement Learning-PID Method
    Zhao, Xin
    Li, Xin
    2008 CHINESE CONTROL AND DECISION CONFERENCE, VOLS 1-11, 2008, : 397 - +
  • [6] Intelligent PID Controller Based on Deep Reinforcement Learning
    Zhai, Yinhe
    Zhao, Qiang
    Han, Yinghua
    Wang, Jinkuan
    Zeng, Wenying
    2024 8TH INTERNATIONAL CONFERENCE ON ROBOTICS, CONTROL AND AUTOMATION, ICRCA 2024, 2024, : 343 - 348
  • [7] Fuzzy PID Controller for UAV Based on Reinforcement Learning
    Zhang, Benyi
    Zhang, Weiping
    Mou, Jiawang
    Yang, Runmin
    Zhang, Yichen
    PROCEEDINGS OF 2022 INTERNATIONAL CONFERENCE ON AUTONOMOUS UNMANNED SYSTEMS, ICAUS 2022, 2023, 1010 : 1724 - 1732
  • [8] A Proposal of Adaptive PID Controller Based on Reinforcement Learning
    WANG, Xue-song
    CHENG, Yu-hu
    SUN, Wei
    Journal of China University of Mining and Technology, 2007, 17 (01): : 40 - 44
  • [9] Fuzzy PID Controller Design for LFC in Electric Power Systems
    Osinski, C.
    Villar, G.
    da Costa, G.
    IEEE LATIN AMERICA TRANSACTIONS, 2019, 17 (01) : 147 - 154
  • [10] Fuzzy PID controller design for LFC in electric power systems
    Osinski C.
    Villar Leandro G.
    Da Costa Oliveira G.H.
    IEEE Latin America Transactions, 2019, 17 (01): : 147 - 154