Supplementary heuristic dynamic programming for wastewater treatment process control

被引:1
作者
Wang, Ding [1 ]
Li, Xin
Xin, Peng
Liu, Ao
Qiao, Junfei
机构
[1] Beijing Univ Technol, Fac Informat Technol, Beijing 100124, Peoples R China
基金
中国国家自然科学基金;
关键词
Neural networks; Reinforcement learning; Supplementary heuristic dynamic; programming; Tracking control; Wastewater treatment process control; UNKNOWN DYNAMICS; DESIGN;
D O I
10.1016/j.eswa.2024.123280
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the rapid development of industry, the amount of wastewater discharge is increasing. In order to improve the efficiency of the wastewater treatment process (WWTP), we often desire that the dissolved oxygen (DO) concentration and the nitrate nitrogen (NO) concentration can be controlled to track set values. However, the wastewater treatment system is a type of unknown nonlinear plant with time -varying dynamics and strong disturbances. Some traditional control methods are difficult to achieve this goal. To overcome these challenges, a supplementary heuristic dynamic programming (SUP-HDP) control scheme is established by combining the traditional control method and heuristic dynamic programming (HDP). A parallel control structure is constructed in the SUP-HDP control scheme, which not only complements the shortcomings of traditional control schemes in learning and adaptive abilities but also improves the convergence speed and the stability of the learning process of HDP. Besides, the convergence proof of the designed control scheme is provided. The SUP-HDP control scheme is implemented utilizing neural networks. Finally, we validate the effectiveness of the SUP-HDP control method through a benchmark simulation platform for the WWTP. Compared with other control methods, SUP-HDP has better control performance.
引用
收藏
页数:10
相关论文
共 44 条
[1]   Online Model-Free n-Step HDP With Stability Analysis [J].
Al Dabooni, Seaar ;
Wunsch, Donald C., II .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2020, 31 (04) :1255-1269
[2]   Optimal design activated sludge process by means of multi-objective optimization: case study in Benchmark Simulation Model 1 (BSM1) [J].
Chen, Wenliang ;
Yao, Chonghua ;
Lu, Xiwu .
WATER SCIENCE AND TECHNOLOGY, 2014, 69 (10) :2052-2058
[3]   Combined L2-Stable Feedback and Feedforward Aeration Control in a Wastewater Treatment Plant [J].
Chistiakova, Tatiana ;
Wigren, Torbjorn ;
Carlsson, Bengt .
IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY, 2020, 28 (03) :1017-1024
[4]   An Optimal Primary Frequency Control Based on Adaptive Dynamic Programming for Islanded Modernized Microgrids [J].
Davari, Masoud ;
Gao, Weinan ;
Jiang, Zhong-Ping ;
Lewis, Frank L. .
IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2021, 18 (03) :1109-1121
[5]   Event-triggered model predictive control of wastewater treatment plants [J].
Du, Shengli ;
Zhang, Qingda ;
Han, Honggui ;
Sun, Haoyuan ;
Qiao, Junfei .
JOURNAL OF WATER PROCESS ENGINEERING, 2022, 47
[6]   Event-triggered PID control for wastewater treatment plants [J].
Du, Shengli ;
Yan, Qiushuo ;
Qiao, Junfei .
JOURNAL OF WATER PROCESS ENGINEERING, 2020, 38
[7]   Simple and Fast Calculation of the Second-Order Gradients for Globalized Dual Heuristic Dynamic Programming in Neural Networks [J].
Fairbank, Michael ;
Alonso, Eduardo ;
Prokhorov, Danil .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2012, 23 (10) :1671-1676
[8]  
Firdausiyah N., 2020, Transportation Research Procedia, V46, P125
[9]   Resilient reinforcement learning and robust output regulation under denial-of-service attacks [J].
Gao, Weinan ;
Deng, Chao ;
Jiang, Yi ;
Jiang, Zhong-Ping .
AUTOMATICA, 2022, 142
[10]  
Gernaey KV, 2014, SCI TECH REP SER, P1