Supplementary heuristic dynamic programming for wastewater treatment process control

被引:2
作者
Wang, Ding [1 ]
Li, Xin
Xin, Peng
Liu, Ao
Qiao, Junfei
机构
[1] Beijing Univ Technol, Fac Informat Technol, Beijing 100124, Peoples R China
基金
中国国家自然科学基金;
关键词
Neural networks; Reinforcement learning; Supplementary heuristic dynamic; programming; Tracking control; Wastewater treatment process control; UNKNOWN DYNAMICS; DESIGN;
D O I
10.1016/j.eswa.2024.123280
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the rapid development of industry, the amount of wastewater discharge is increasing. In order to improve the efficiency of the wastewater treatment process (WWTP), we often desire that the dissolved oxygen (DO) concentration and the nitrate nitrogen (NO) concentration can be controlled to track set values. However, the wastewater treatment system is a type of unknown nonlinear plant with time -varying dynamics and strong disturbances. Some traditional control methods are difficult to achieve this goal. To overcome these challenges, a supplementary heuristic dynamic programming (SUP-HDP) control scheme is established by combining the traditional control method and heuristic dynamic programming (HDP). A parallel control structure is constructed in the SUP-HDP control scheme, which not only complements the shortcomings of traditional control schemes in learning and adaptive abilities but also improves the convergence speed and the stability of the learning process of HDP. Besides, the convergence proof of the designed control scheme is provided. The SUP-HDP control scheme is implemented utilizing neural networks. Finally, we validate the effectiveness of the SUP-HDP control method through a benchmark simulation platform for the WWTP. Compared with other control methods, SUP-HDP has better control performance.
引用
收藏
页数:10
相关论文
共 44 条
[31]   Relaxed dynamic programming in switching systems [J].
Rantzer, A. .
IEE PROCEEDINGS-CONTROL THEORY AND APPLICATIONS, 2006, 153 (05) :567-574
[32]   Human-Guided Multirobot Cooperative Manipulation [J].
Sieber, Dominik ;
Hirche, Sandra .
IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY, 2019, 27 (04) :1492-1509
[33]   An Adaptive Dynamic Programming Scheme for Nonlinear Optimal Control With Unknown Dynamics and Its Application to Turbofan Engines [J].
Sun, Tao ;
Sun, Xi-Ming .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (01) :367-376
[34]   Recent Progress in Reinforcement Learning and Adaptive Dynamic Programming for Advanced Control Applications [J].
Wang, Ding ;
Gao, Ning ;
Liu, Derong ;
Li, Jinna ;
Lewis, Frank L. .
IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2024, 11 (01) :18-36
[35]   Adaptive Multi-Step Evaluation Design With Stability Guarantee for Discrete-Time Optimal Learning Control [J].
Wang, Ding ;
Wang, Jiangyu ;
Zhao, Mingming ;
Xin, Peng ;
Qiao, Junfei .
IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2023, 10 (09) :1797-1809
[36]   The intelligent critic framework for advanced optimal control [J].
Wang, Ding ;
Ha, Mingming ;
Zhao, Mingming .
ARTIFICIAL INTELLIGENCE REVIEW, 2022, 55 (01) :1-22
[37]   Adaptive Critic for Event-Triggered Unknown Nonlinear Optimal Tracking Design With Wastewater Treatment Applications [J].
Wang, Ding ;
Hu, Lingzhi ;
Zhao, Mingming ;
Qiao, Junfei .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (09) :6276-6288
[38]   Data-Driven Iterative Adaptive Critic Control Toward an Urban Wastewater Treatment Plant [J].
Wang, Ding ;
Ha, Mingming ;
Qiao, Junfei .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2021, 68 (08) :7362-7369
[39]   Event-Driven Model Predictive Control With Deep Learning for Wastewater Treatment Process [J].
Wang, Gongming ;
Bi, Jing ;
Jia, Qing-Shan ;
Qiao, Junfei ;
Wang, Lei .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2023, 19 (05) :6398-6407
[40]   Neural-Network-Based Adaptive Control of Uncertain MIMO Singularly Perturbed Systems With Full-State Constraints [J].
Wang, Hao ;
Yang, Chunyu ;
Liu, Xiaomin ;
Zhou, Linna .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (07) :3764-3774