Supplementary heuristic dynamic programming for wastewater treatment process control

被引:2
作者
Wang, Ding [1 ]
Li, Xin
Xin, Peng
Liu, Ao
Qiao, Junfei
机构
[1] Beijing Univ Technol, Fac Informat Technol, Beijing 100124, Peoples R China
基金
中国国家自然科学基金;
关键词
Neural networks; Reinforcement learning; Supplementary heuristic dynamic; programming; Tracking control; Wastewater treatment process control; UNKNOWN DYNAMICS; DESIGN;
D O I
10.1016/j.eswa.2024.123280
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the rapid development of industry, the amount of wastewater discharge is increasing. In order to improve the efficiency of the wastewater treatment process (WWTP), we often desire that the dissolved oxygen (DO) concentration and the nitrate nitrogen (NO) concentration can be controlled to track set values. However, the wastewater treatment system is a type of unknown nonlinear plant with time -varying dynamics and strong disturbances. Some traditional control methods are difficult to achieve this goal. To overcome these challenges, a supplementary heuristic dynamic programming (SUP-HDP) control scheme is established by combining the traditional control method and heuristic dynamic programming (HDP). A parallel control structure is constructed in the SUP-HDP control scheme, which not only complements the shortcomings of traditional control schemes in learning and adaptive abilities but also improves the convergence speed and the stability of the learning process of HDP. Besides, the convergence proof of the designed control scheme is provided. The SUP-HDP control scheme is implemented utilizing neural networks. Finally, we validate the effectiveness of the SUP-HDP control method through a benchmark simulation platform for the WWTP. Compared with other control methods, SUP-HDP has better control performance.
引用
收藏
页数:10
相关论文
共 44 条
[41]   Multibattery Optimal Coordination Control for Home Energy Management Systems via Distributed Iterative Adaptive Dynamic Programming [J].
Wei, Qinglai ;
Liu, Derong ;
Shi, Guang ;
Liu, Yu .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2015, 62 (07) :4203-4214
[42]   Reinforcement-Learning-Based Tracking Control of Waste Water Treatment Process Under Realistic System Conditions and Control Performance Requirements [J].
Yang, Qinmin ;
Cao, Weiwei ;
Meng, Wenchao ;
Si, Jennie .
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2022, 52 (08) :5284-5294
[43]   Policy Gradient Adaptive Critic Design With Dynamic Prioritized Experience Replay for Wastewater Treatment Process Control [J].
Yang, Ruyue ;
Wang, Ding ;
Qiao, Junfei .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2022, 18 (05) :3150-3158
[44]   Advanced value iteration for discrete-time intelligent critic control: A survey [J].
Zhao, Mingming ;
Wang, Ding ;
Qiao, Junfei ;
Ha, Mingming ;
Ren, Jin .
ARTIFICIAL INTELLIGENCE REVIEW, 2023, 56 (10) :12315-12346