Reinforcement learning-based integrated active fault diagnosis and tracking control

被引:7
作者
Yan, Zichen [1 ]
Xu, Feng [1 ]
Tan, Junbo [1 ]
Liu, Houde [1 ]
Liang, Bin [2 ]
机构
[1] Tsinghua Univ, Tsinghua Shenzhen Int Grad Sch, Ctr Intelligent Control & Telesci, Shenzhen 518055, Peoples R China
[2] Tsinghua Univ, Nav & Control Res Ctr, Dept Automat, Beijing 100084, Peoples R China
基金
中国博士后科学基金;
关键词
Active fault diagnosis; Fault-tolerant control; Constrained reinforcement learning; Maximum mean discrepancy; INPUT-DESIGN;
D O I
10.1016/j.isatra.2022.06.020
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Reliable and real-time active diagnosis of system faults with uncertainties is strongly dependent on the input design. This paper establishes a data-driven framework for integrated design of active fault diagnosis and control while ensuring the tracking performance. To be specific, the input design is formulated as a constrained optimization problem that can be solved with the aid of constrained reinforcement learning algorithms. Moreover, based on the maximum mean discrepancy metric, a novel active fault isolation scheme is proposed to implement model discrimination using system outputs. At the end, the effectiveness of the proposed approach is evaluated in two case studies in the presence of probabilistic disturbances and uncertainties. (c) 2022 ISA. Published by Elsevier Ltd. All rights reserved.
引用
收藏
页码:364 / 376
页数:13
相关论文
共 34 条
[1]  
Achiam J, 2017, PR MACH LEARN RES, V70
[2]  
Altman E., 1999, Constrained Markov Decision Processes, V7
[3]  
Chow Y, 2018, J MACH LEARN RES, V18
[4]  
García J, 2015, J MACH LEARN RES, V16, P1437
[5]  
Gretton A., 2006, Advances in Neural Information Processing Systems, V19
[6]   Constrained Active Fault Tolerant Control Based on Active Fault Diagnosis and Interpolation Optimization [J].
Han, Kezhen ;
Chen, Changzhi ;
Chen, Mengdi ;
Wang, Zipeng .
ENTROPY, 2021, 23 (08)
[7]  
He JB, 2019, IEEE SYS MAN CYBERN, P1049, DOI [10.1109/SMC.2019.8914185, 10.1109/smc.2019.8914185]
[8]   Input design for active fault diagnosis [J].
Heirung, Tor Aksel N. ;
Mesbah, Ali .
ANNUAL REVIEWS IN CONTROL, 2019, 47 :35-50
[9]   Stochastic Nonlinear Model Predictive Control with Active Model Discrimination: A Closed-Loop Fault Diagnosis Application [J].
Heirung, Tor Aksel N. ;
Mesbah, Ali .
IFAC PAPERSONLINE, 2017, 50 (01) :15934-15939
[10]   Reference Governor-based fault-tolerant constrained control? [J].
Hosseinzadeh, Mehdi ;
Kolmanovsky, Ilya ;
Baruah, Sanjoy ;
Sinopoli, Bruno .
AUTOMATICA, 2022, 136