Deep reinforcement learning optimization framework for a power generation plant considering performance and environmental issues

被引:24
作者
Adams, Derrick [1 ]
Oh, Dong-Hoon [2 ]
Kim, Dong-Won [3 ]
Lee, Chang-Ha [2 ]
Oh, Min [1 ]
机构
[1] Hanbat Natl Univ, Dept Chem & Biol Engn, Dongseo Daero 125, Daejeon, South Korea
[2] Yonsei Univ, Dept Chem & Biomol Engn, Yonsei 50, Seoul 03722, South Korea
[3] KEPCO Res Inst, 105 Munji Ro, Daejeon 34056, South Korea
关键词
Circulating fluidized bed; Coal power generation; NOx emission; Multi-objective optimization; Deep reinforcement learning; COAL-FIRED BOILER; RENEWABLE ENERGY-SOURCES; COMBUSTION OPTIMIZATION; MULTIOBJECTIVE OPTIMIZATION; NOX EMISSIONS; PREDICTION; REDUCTION; OPERATION; SYSTEM; MODEL;
D O I
10.1016/j.jclepro.2021.125915
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
In the electric power generation sector, striking a balance between maximum power production and acceptable emission limits is a challenging task that requires sophisticated techniques. With traditional methods, this is an extremely complex issue due to the large number of process variables that are involved. In this paper, a deep reinforcement learning optimization framework (DRLOF) is proposed to determine the optimal operating conditions for a commercial circulating fluidized bed (CFB) power plant that strikes a good balance between performance and environmental issues. The DRLOF included the CFB as an environment created from over 1.5 years of plant data with a 1 min sampling time which interacted with an advantage actor-critic (A2C) agent of two architectures named 'separate-A2CN' and 'sharedA2CN'. The framework was optimized by maximizing electric power generation within the constraints of the plant's capacity and environmental emission standards, taking into consideration the cost of operations. After training, the framework of the separate-A2CN architecture achieved a 1.97% increase in electricity generation and 1.59% emission reduction for NOx at 14.3 times lower computational cost. Furthermore, we demonstrated the framework's flexibility, adaptability and lower computational burden by carrying out different test scenarios which demonstrated the effectiveness of the DRLOF. The findings of this study are not limited to the CFB power plant but can be extended to other chemical processes and industries. This approach minimizes the need for costly experiments, online optimization challenges and associated customizations. (c) 2021 Elsevier Ltd. All rights reserved.
引用
收藏
页数:21
相关论文
共 53 条
[1]   Prediction of SOx-NOx emission from a coal-fired CFB power plant with machine learning: Plant data learned by deep neural network and least square support vector machine [J].
Adams, Derrick ;
Oh, Dong-Hoon ;
Kim, Dong-Won ;
Lee, Chang-Ha ;
Oh, Min .
JOURNAL OF CLEANER PRODUCTION, 2020, 270
[2]  
[Anonymous], KEPCO SET CHARGE MOR
[3]  
[Anonymous], COAL 2008 2020 DATA
[4]  
[Anonymous], 2010, P ICML 2010 P 27 INT
[5]  
Caterini AL, 2018, SPRINGERBRIEF COMPUT, DOI 10.1007/978-3-319-75304-1
[6]   ThermalNet: A deep reinforcement learning-based combustion optimization system for coal-fired boiler [J].
Cheng, Yin ;
Huang, Yuexin ;
Pang, Bo ;
Zhang, Weidong .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2018, 74 :303-311
[7]   Replacing coal-fired power plants by photovoltaics in the Portuguese electricity system [J].
Figueiredo, Raquel ;
Nunes, Pedro ;
Meireles, Monica ;
Madaleno, Mara ;
Brito, Miguel C. .
JOURNAL OF CLEANER PRODUCTION, 2019, 222 :129-142
[8]   Review of the operational flexibility and emissions of gas- and coal-fired power plants in a future with growing renewables [J].
Gonzalez-Salazar, Miguel Angel ;
Kirsten, Trevor ;
Prchlik, Lubos .
RENEWABLE & SUSTAINABLE ENERGY REVIEWS, 2018, 82 :1497-1513
[9]  
Goodfellow I., 2016, Deep Feedforward Networks
[10]   Study on oxy-fuel combustion behaviors in a S-CO2 CFB by 3D CFD simulation [J].
Gu, Jinrao ;
Shao, Yingjuan ;
Zhong, Wenqi .
CHEMICAL ENGINEERING SCIENCE, 2020, 211