Optimal Scheduling Method for Integrated Energy Systems with Hydrogen Based on Deep Reinforcement Learning

被引:0
作者
Zhang, Lei [1 ]
Wu, Hongbin [1 ]
He, Ye [1 ]
Xu, Bin [2 ]
Zhang, Mingxing [3 ]
Ding, Ming [1 ]
机构
[1] Anhui Province Key Laboratory of Renewable Energy Utilization and Energy Saving, Hefei University of Technology, Hefei
[2] Electric Power Research Institute of State Grid Anhui Electric Power Co., Ltd., Hefei
[3] Lu’an Power Supply Company of State Grid Anhui Electric Power Co., Ltd., Lu’an
来源
Dianli Xitong Zidonghua/Automation of Electric Power Systems | 2024年 / 48卷 / 16期
基金
中国国家自然科学基金;
关键词
deep reinforcement learning; hydrogen energy; integrated energy system; multi-objective optimization; optimal scheduling; renewable energy;
D O I
10.7500/AEPS20240102002
中图分类号
学科分类号
摘要
In order to achieve carbon reduction targets, the combination of hydrogen energy and integrated energy systems has become one of the most potential development directions. Aiming at the problems such as the insufficient flexibility of scheduling strategy of hydrogen integrated energy system and difficulty in solving multi-objective optimization of complex systems, an optimal scheduling method for hydrogen integrated energy systems based on deep reinforcement learning is proposed. First, the variable operation condition model of coupled equipment is used to construct a wind-solar-hydrogen-cooling-heat-electricity integrated energy system, and expand the joint energy supply space of equipment. Secondly, considering the system operation cost, carbon emissions, system self-supply balance and renewable energy utilization rate, a multi-objective optimization model is built based on the optimal solution distance to stimulate the exploration of the agent. Then, the deep reinforcement learning algorithm is optimized by time segment characterization to enhance the estimation accuracy of the system state change. Finally, a simulation case is designed based on the measured data of the source and load. The results show that the proposed method can effectively improve the scheduling flexibility of the hydrogen integrated energy system, fully tap the carbon emission reduction potential of hydrogen energy, and realize the dual optimization of scheduling economy and environmental protection. © 2024 Automation of Electric Power Systems Press. All rights reserved.
引用
收藏
页码:132 / 141
页数:9
相关论文
共 31 条
  • [1] CHEN Sheng, ZHANG Jingchun, WEI Zhinong, Et al., Energy transition oriented planning and operation of electricity-gas-hydrogen integrated energy system, Automation of Electric Power Systems, 47, 19, pp. 16-30, (2023)
  • [2] ZENG Ming, LIU Yingxin, ZHOU Pengcheng, Et al., Review and prospects of integrated energy system modeling and benefit evaluation, Power System Technology, 42, 6, pp. 1697-1708, (2018)
  • [3] BERJAWI A E H, WALKER S L, PATSIOS C, Et al., An evaluation framework for future integrated energy systems:a whole energy systems approach, Renewable and Sustainable Energy Reviews, 145, (2021)
  • [4] GAO Jie, SONG Jie, WANG Jianxiao, Et al., Form and key technologies of integrated electricity-hydrogen system supporting energy security in China, Automation of Electric Power Systems, 47, 19, pp. 1-15, (2023)
  • [5] CHEN Jinpeng, HU Zhijian, CHEN Yingguang, Et al., Thermoelectric optimization of integrated energy system considering ladder-type carbon trading mechanism and electric hydrogen production, Electric Power Automation Equipment, 41, 9, pp. 48-55, (2021)
  • [6] GAO Yu, WANG Qi, CHEN Yan, Et al., Optimal dispatch of integrated energy system with hydrogen considering demand response and cascade energy utilization [J], Automation of Electric Power Systems, 47, 4, pp. 51-59, (2023)
  • [7] HAGGI H, SUN W, FENTON J M, Et al., Proactive rolling-horizon-based scheduling of hydrogen systems for resilient power grids[J], IEEE Transactions on Industry Applications, 58, 2, pp. 1737-1746, (2022)
  • [8] SHI Zhe, LIANG Yi, LI Hua, Et al., Interval optimal operation of a multi-objective electric-thermal-transportation integrated energy system considering flexibility [J], Power System Protection and Control, 50, 21, pp. 33-42, (2022)
  • [9] MA Yanfeng, XIE Jiarong, ZHAO Shuqiang, Et al., Multi-objective optimal dispatching for active distribution network considering park-level integrated energy system, Automation of Electric Power Systems, 46, 13, pp. 53-61, (2022)
  • [10] ZENG Bo, XU Fuqiang, LIU Yu, Et al., Multi-objective interval optimization approach for energy hub planning with consideration of renewable energy and demand response synergies, Proceedings of the CSEE, 41, 21, pp. 7212-7225, (2021)