Energy Storage Management for Microgrids Using n -Step Bootstrapping Gestion du stockage de l'energie pour les micro-reseaux a l'aide d'un Bootstrapping en $n$ etapes

被引:5
作者
Aksoy, Necati [1 ]
Genc, Istemihan [1 ]
机构
[1] Istanbul Tech Univ, Dept Elect Engn, TR-34467 Istanbul, Turkiye
来源
IEEE CANADIAN JOURNAL OF ELECTRICAL AND COMPUTER ENGINEERING | 2023年 / 46卷 / 02期
关键词
Artificial intelligence (AI); energy management; energy storage; microgrid; n-step bootstrapping; reinforcement learning (RL);
D O I
10.1109/ICJECE.2022.3232213
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Microgrids offer superiorities such as reducing energy costs and increasing the quality of energy, with the use of renewable energy sources and the effective use of energy storage unit created with innovative batteries. Furthermore, this structure, which helps to reduce the carbon footprint, will become undeniably critical to use in near future with the nanogrid and smart grid. As another development, an artificial intelligence (AI)-based control infrastructure brought to us by machine learning stands out as more beneficial than classical control methods. With this framework, which is called reinforcement learning (RL), it is promised that the system to be controlled can be more efficient. At this point, the thrifty use of energy storage unit, which is the most important tool that will increase the profitability of microgrids and enhance the proficiency of energy use, is associated with an RL-based energy control system. While this study focuses on an AI-based control infrastructure, it proposes a method utilizing an RL agent trained with a novel environmental model proposed specifically for the energy storage unit of microgrids. The advantages of this method demonstrated with the results are obtained, are shown and examined.
引用
收藏
页码:107 / 116
页数:10
相关论文
共 24 条
[1]   A microgrid energy management system based on chance-constrained stochastic optimization and big data analytics [J].
Antonio Marino, Carlos ;
Marufuzzaman, Mohammad .
COMPUTERS & INDUSTRIAL ENGINEERING, 2020, 143
[2]  
Brunton S. L., 2019, Data Driven Science Engineering. Machine Learning, Dynamical Systems, DOI [DOI 10.1017/9781108380690, 10.1017/9781108380690]
[3]   Microgrids: Overview and guidelines for practical implementations and operation [J].
Cagnano, A. ;
De Tuglie, E. ;
Mancarella, P. .
APPLIED ENERGY, 2020, 258
[4]   Reinforcement Learning and Its Applications in Modern Power and Energy Systems: A Review [J].
Cao, Di ;
Hu, Weihao ;
Zhao, Junbo ;
Zhang, Guozhou ;
Zhang, Bin ;
Liu, Zhou ;
Chen, Zhe ;
Blaabjerg, Frede .
JOURNAL OF MODERN POWER SYSTEMS AND CLEAN ENERGY, 2020, 8 (06) :1029-1042
[5]   Control of battery charging based on reinforcement learning and long short-term memory networks [J].
Chang, Fangyuan ;
Chen, Tao ;
Su, Wencong ;
Alsafasfeh, Qais .
COMPUTERS & ELECTRICAL ENGINEERING, 2020, 85
[6]   Reinforcement Learning-Based Plug-in Electric Vehicle Charging With Forecasted Price [J].
Chis, Adriana ;
Lunden, Jarmo ;
Koivunen, Visa .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2017, 66 (05) :3674-3684
[7]   Review of energy storage system technologies integration to microgrid: Types, control strategies, issues, and future prospects [J].
Choudhury, Subhashree .
JOURNAL OF ENERGY STORAGE, 2022, 48
[8]   Community energy storage operation via reinforcement learning with eligibility traces [J].
Duque, Edgar Mauricio Salazar ;
Giraldo, Juan S. ;
Vergara, Pedro P. ;
Nguyen, Phuong ;
van der Molen, Anne ;
Slootweg, Han .
ELECTRIC POWER SYSTEMS RESEARCH, 2022, 212
[9]   Machine learning toward advanced energy storage devices and systems [J].
Gao, Tianhan ;
Lu, Wei .
ISCIENCE, 2021, 24 (01)
[10]   Energy Management in Microgrids with Renewable Energy Sources: A Literature Review [J].
Garcia Vera, Yimy E. ;
Dufo-Lopez, Rodolfo ;
Bernal-Agustin, Jose L. .
APPLIED SCIENCES-BASEL, 2019, 9 (18)