Combustion optimization study of pulverized coal boiler based on proximal policy optimization algorithm

被引:9
作者
Wu, Xuecheng [1 ,2 ]
Zhang, Hongnan [1 ,2 ]
Chen, Huafeng [1 ]
Wang, Shifeng [3 ]
Gong, Lingling [4 ]
机构
[1] Zhejiang Univ, Ningbo Innovat Ctr, Ningbo 315100, Peoples R China
[2] Zhejiang Univ, State Key Lab Clean Energy Utilizat, Hangzhou 310027, Peoples R China
[3] Hangzhou Vocat & Tech Coll, Hangzhou 310019, Peoples R China
[4] Zhejiang Tech Inst Econ, Hangzhou 310018, Peoples R China
基金
中国国家自然科学基金;
关键词
Pulverized coal boiler; Energy saving and emission reduction; Reinforcement learning; Proximal policy optimization algorithm; Online combustion optimization; NOX EMISSIONS; FIRED BOILER; MACHINE; SYSTEM;
D O I
10.1016/j.applthermaleng.2024.123857
中图分类号
O414.1 [热力学];
学科分类号
摘要
In most industrial sectors, large coal-fired boilers are a source of carbon and pollutant emissions, so it is important to carry out combustion adjustment and optimize energy-saving operation of coal-fired boilers. Traditional combustion adjustment relies on human intervention, but manual adjustment is difficult to achieve synergistic optimization of NOx and thermal efficiency at the same time, so there is a large adjustment space for boiler combustion optimization. Artificial intelligence technology can explore the potential of combustion optimization from boiler operation data. Currently, the boiler combustion optimization method based on supervised learning modeling and optimization algorithms has good optimization effect and high application value. At present, there are problems such as the combination of dynamic model and optimization algorithm is difficult and the optimization time is long, etc. This paper adopts feature classification and multi-model coupling to build a static-dynamic composite prediction model of boiler performance indicators, dynamic prediction model of boiler thermal efficiency and nitrogen oxides (NOx) is established by using long short-term memory (LSTM) and one-dimensional convolutional neural network (1D_CNN). The model is categorized into static and dynamic models based on the input features, and the dynamic model is coupled with BP neural network to establish a static-dynamic composite prediction model and further couples the proximal policy optimization (PPO) reinforcement learning algorithm to establish a boiler in-place optimization strategy. Through the experimental validation of 5619 test cases, the strategy successfully achieves 63.5 % co-optimization of NOx and thermal efficiency, with thermal efficiency increase ranging from 0-0.61 % and NOx reduction ranging from 0-65 mg/m3. Meanwhile, comparing the optimization effect of the PPO algorithm with that of the genetic algorithm (GA) shows that the PPO strategy has a more significant effect on NOx reduction while keeping the thermal efficiency optimized. Moreover, the online decision-making speed of the PPO strategy is much higher than that of the GA, with an average time consumption of only 0.015 s, while the GA requires about 3 min for a single optimization, which indicates that the combustion optimization strategy of the PPO algorithm coupled with the composite prediction model has a significant advantage in realizing high-efficiency and accurate optimization.
引用
收藏
页数:16
相关论文
共 35 条
[1]   Deep reinforcement learning optimization framework for a power generation plant considering performance and environmental issues [J].
Adams, Derrick ;
Oh, Dong-Hoon ;
Kim, Dong-Won ;
Lee, Chang-Ha ;
Oh, Min .
JOURNAL OF CLEANER PRODUCTION, 2021, 291
[2]   Prediction of SOx-NOx emission from a coal-fired CFB power plant with machine learning: Plant data learned by deep neural network and least square support vector machine [J].
Adams, Derrick ;
Oh, Dong-Hoon ;
Kim, Dong-Won ;
Lee, Chang-Ha ;
Oh, Min .
JOURNAL OF CLEANER PRODUCTION, 2020, 270
[3]  
Bao XQ, 2021, CHIN CONTR CONF, P6255, DOI 10.23919/CCC52363.2021.9549318
[4]   Reinforcement Learning and Its Applications in Modern Power and Energy Systems: A Review [J].
Cao, Di ;
Hu, Weihao ;
Zhao, Junbo ;
Zhang, Guozhou ;
Zhang, Bin ;
Liu, Zhou ;
Chen, Zhe ;
Blaabjerg, Frede .
JOURNAL OF MODERN POWER SYSTEMS AND CLEAN ENERGY, 2020, 8 (06) :1029-1042
[5]   ThermalNet: A deep reinforcement learning-based combustion optimization system for coal-fired boiler [J].
Cheng, Yin ;
Huang, Yuexin ;
Pang, Bo ;
Zhang, Weidong .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2018, 74 :303-311
[6]  
Cheong Jin Hyun, 2020, OSF
[7]  
Guotian Yang Y.W., 2020, Energy, P192
[8]   Review of Deep Reinforcement Learning for Robot Manipulation [J].
Hai Nguyen ;
Hung Manh La .
2019 THIRD IEEE INTERNATIONAL CONFERENCE ON ROBOTIC COMPUTING (IRC 2019), 2019, :590-595
[9]  
Hochreiter S, 1997, NEURAL COMPUT, V9, P1735, DOI [10.1162/neco.1997.9.8.1735, 10.1162/neco.1997.9.1.1, 10.1007/978-3-642-24797-2]
[10]   ANN-GA approach for predictive modeling and optimization of NOx emission in a tangentially fired boiler [J].
Ilamathi, P. ;
Selladurai, V. ;
Balamurugan, K. ;
Sathyanathan, V. T. .
CLEAN TECHNOLOGIES AND ENVIRONMENTAL POLICY, 2013, 15 (01) :125-131