Hybrid data-driven method for low-carbon economic energy management strategy in electricity-gas coupled energy systems based on transformer network and deep reinforcement learning

被引:19
作者
Zhang, Bin [1 ]
Hu, Weihao [2 ]
Xu, Xiao [3 ]
Zhang, Zhenyuan [2 ]
Chen, Zhe [1 ]
机构
[1] Aalborg Univ, Dept Energy Technol, Pontoppidanstr 111, Aalborg, Denmark
[2] Univ Elect Sci & Technol China, Sch Mech & Elect Engn, Chengdu, Peoples R China
[3] Sichuan Univ, Coll Elect Engn, Chengdu, Peoples R China
关键词
Deep reinforcement learning; Neural network; Energy management system; Integrated energy system; Low-carbon; NATURAL-GAS; NEURAL-NETWORKS; MIXED-INTEGER; LEVEL CONTROL; WIND; COORDINATION; STATE;
D O I
10.1016/j.energy.2023.127183
中图分类号
O414.1 [热力学];
学科分类号
摘要
Because of their attractive economic and environmental benefits, integrated energy systems (IESs), especially electricity-gas coupled energy systems (EGCESs), have received great interest. In this study, to minimize carbon trading and generation costs, a model-free deep-reinforcement-learning (DRL) method is integrated into the low -carbon economic autonomous energy management system of an EGCES. Unlike previous works, this work proposes an innovative transformer-deep deterministic policy gradient (TDDPG) that combines the superior feature extraction ability of the transformer network with the strong decision-making ability of a state-of-the-art TDDPG. The proposed method is tailored to the specific energy management problem to meet the requirements of multi-dimensional and continuous control. To validate the advantages of the TDDPG, the proposed method is compared with benchmark optimization methods. The simulation results illustrate that TDDPG performs more effectively than the examined DRL approaches in terms of optimizing low-carbon and economy targets, computation efficiency, and optimization of the results. Besides, the TDDPG method achieves lower average comprehensive costs than DDPG and requires less training time for real-time energy scheduling.
引用
收藏
页数:15
相关论文
共 54 条
[1]  
Abadi M, 2016, PROCEEDINGS OF OSDI'16: 12TH USENIX SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION, P265
[2]   Renewable energy consumption, carbon emissions and human development: Empirical comparison of the trajectories of world regions [J].
Adekoya, Oluwasegun B. ;
Olabode, Joshua K. ;
Rafi, Syed K. .
RENEWABLE ENERGY, 2021, 179 :1836-1848
[3]   Coordination of Interdependent Natural Gas and Electricity Infrastructures for Firming the Variability of Wind Energy in Stochastic Day-Ahead Scheduling [J].
Alabdulwahab, Ahmed ;
Abusorrah, Abdullah ;
Zhang, Xiaping ;
Shahidehpour, Mohammad .
IEEE TRANSACTIONS ON SUSTAINABLE ENERGY, 2015, 6 (02) :606-615
[4]   Intelligent Decision-Making for Smart Home Energy Management [J].
Berlink, Heider ;
Kagan, Nelson ;
Reali Costa, Anna Helena .
JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2015, 80 :S331-S354
[5]   Deep Reinforcement Learning Enabled Physical-Model-Free Two-Timescale Voltage Control Method for Active Distribution Systems [J].
Cao, Di ;
Zhao, Junbo ;
Hu, Weihao ;
Yu, Nanpeng ;
Ding, Fei ;
Huang, Qi ;
Chen, Zhe .
IEEE TRANSACTIONS ON SMART GRID, 2022, 13 (01) :149-165
[6]   Reinforcement Learning and Its Applications in Modern Power and Energy Systems: A Review [J].
Cao, Di ;
Hu, Weihao ;
Zhao, Junbo ;
Zhang, Guozhou ;
Zhang, Bin ;
Liu, Zhou ;
Chen, Zhe ;
Blaabjerg, Frede .
JOURNAL OF MODERN POWER SYSTEMS AND CLEAN ENERGY, 2020, 8 (06) :1029-1042
[7]   Analysis on the carbon trading approach in promoting sustainable buildings in China [J].
Chen, Yihui ;
Jiang, Ping ;
Dong, Wenbo ;
Huang, Beijia .
RENEWABLE ENERGY, 2015, 84 :130-137
[8]   National growth dynamics of wind and solar power compared to the growth required for global climate targets [J].
Cherp, Aleh ;
Vinichenko, Vadim ;
Tosun, Jale ;
Gordon, Joel A. ;
Jewell, Jessica .
NATURE ENERGY, 2021, 6 (07) :742-+
[9]  
Coello CAC, 2004, IEEE T EVOLUT COMPUT, V8, P256, DOI [10.1109/TEVC.2004.826067, 10.1109/tevc.2004.826067]
[10]   A Novel Model-Free Deep Reinforcement Learning Framework for Energy Management of a PV Integrated Energy Hub [J].
Dolatabadi, Amirhossein ;
Abdeltawab, Hussein ;
Mohamed, Yasser Abdel-Rady I. .
IEEE TRANSACTIONS ON POWER SYSTEMS, 2023, 38 (05) :4840-4852