Distributed game coordination control method based on reinforcement learning for multi-microgrid

被引:6
作者
Liu, Wei [1 ]
Zhang, Sicong [1 ]
Zhang, Xiao-Ping [2 ]
Qian, Zhihao [1 ]
Hu, Tianhuan [1 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Automat, Nanjing 210094, Peoples R China
[2] Univ Birmingham, Dept Elect Elect & Syst Engn, Birmingham B15 2TT, W Midlands, England
基金
中国国家自然科学基金;
关键词
Multi-microgrid (MMG); Potential game (PG); Q-learning; Distributed coordinated control;
D O I
10.1016/j.egyr.2023.05.016
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
The traditional centralized control method hardly meets the coordination control demand for multi-microgrid (MMG), due to the conflict between the individual interests of a single microgrid (MG) and the global interests of MMG. In this study, a distributed coordination control method that integrates potential game (PG) and reinforcement learning (RL) is proposed to achieve balance of interests of an MMG. The proposed method fully exploits the distributed characteristic of the PG by considering each MG as an agent. It also establishes a PG-based distributed coordination control structure to maximize and balance the economy of single MG and overall MMG. Then, it combines the PG with the RL algorithm by the parameter transfer to obtain the optimal Nash equilibrium (NE) solution and improve the optimization performance based on Q-learning algorithm. Eventually, a simulation model is performed in MATLAB to demonstrate the effectiveness and superiority of the proposed control method. (c) 2023 The Author(s). Published by Elsevier Ltd. This is an open access article under theCCBY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
引用
收藏
页码:912 / 921
页数:10
相关论文
共 14 条
[1]   A Multiagent-Based Hierarchical Energy Management Strategy for Multi-Microgrids Considering Adjustable Power and Demand Response [J].
Bui, Van-Hai ;
Hussain, Akhtar ;
Kim, Hak-Man .
IEEE TRANSACTIONS ON SMART GRID, 2018, 9 (02) :1323-1333
[2]   Distributed Energy Trading and Scheduling Among Microgrids via Multiagent Reinforcement Learning [J].
Gao, Guanyu ;
Wen, Yonggang ;
Tao, Dacheng .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (12) :10638-10652
[3]   Game Theory Based Profit Maximization Model for Microgrid Aggregators With Presence of EDRP Using Information Gap Decision Theory [J].
Gazijahani, Farhad Samadi ;
Salehi, Javad .
IEEE SYSTEMS JOURNAL, 2019, 13 (02) :1767-1775
[4]  
Ge RLT, 2020, Renew Energy Resour, V38, P205
[5]   Fuzzy Q-Learning for multi-agent decentralized energy management in microgrids [J].
Kofinas, P. ;
Dounis, A., I ;
Vouros, G. A. .
APPLIED ENERGY, 2018, 219 :53-67
[6]   Game Theoretic Non-Cooperative Distributed Coordination Control for Multi-Microgrids [J].
Liu, Wei ;
Gu, Wei ;
Wang, Jianhui ;
Yu, Wenwu ;
Xi, Xinze .
IEEE TRANSACTIONS ON SMART GRID, 2018, 9 (06) :6986-6997
[7]  
[倪爽 Ni Shuang], 2021, [电力系统自动化, Automation of Electric Power Systems], V45, P77
[8]  
Sheng W., 2020, Technology and Application of Renewable Energy Power Generation Cluster
[9]   Economic optimization method of multi-stakeholder in a multi-microgrid system based on Stackelberg game theory [J].
Wu, Qiong ;
Xie, Zhun ;
Li, Qifen ;
Ren, Hongbo ;
Yang, Yongwen .
ENERGY REPORTS, 2022, 8 :345-351
[10]   A Potential Game Approach to Distributed Operational Optimization for Microgrid Energy Management With Renewable Energy and Demand Response [J].
Zeng, Jun ;
Wang, Qiaoqiao ;
Liu, Junfeng ;
Chen, Jianlong ;
Chen, Haoyong .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2019, 66 (06) :4479-4489