A new feature boosting based continual learning method for bearing fault diagnosis with incremental fault types

被引:25
作者
He, Zhenzhong [1 ]
Shen, Changqing [1 ,2 ]
Chen, Bojian [3 ]
Shi, Juanjuan [1 ,2 ]
Huang, Weiguo [1 ]
Zhu, Zhongkui [1 ]
Wang, Dong [4 ]
机构
[1] Soochow Univ, Sch Rail Transportat, Suzhou 215131, Peoples R China
[2] Chongqing Technol & Business Univ, Sch Mech Engn, Chongqing 400067, Peoples R China
[3] Zhejiang Univ, Coll Control Sci & Engn, State Key Lab Ind Control Technol, Hangzhou 310027, Peoples R China
[4] Shanghai Jiao Tong Univ, State Key Lab Mech Syst & Vibrat, Shanghai 200240, Peoples R China
基金
中国国家自然科学基金;
关键词
Rotating machinery; Continual learning; Feature boosting; Incremental fault types; Catastrophic forgetting;
D O I
10.1016/j.aei.2024.102469
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Rotating machinery can unexpectedly generate many new fault types under changing operating conditions. The capability of fault diagnostic models to adapt and acquire knowledge regarding new fault types is increasingly vital. However, traditional deep learning-based fault diagnosis models often encounter the challenge of catastrophic forgetting when facing new fault types. Numerous attempts were trapped with the stability-plasticity dilemma when tackling this phenomenon. In this study, we draw inspiration from the gradient boosting algorithm and propose a feature boosting based continual learning method. This method allows the diagnostic model to continuously and adaptively acquire knowledge of new fault types. Initially, the concept of gradient boosting is employed to construct an initial fault diagnostic model. Then, new modules are continuously extended dynamically for the initial diagnostic model to fit the residuals between the actual label and the output of the initial diagnostic model. Finally, to maintain the backbone of the fault diagnostic model as a single one, redundant parameters and feature dimensions are removed using an effective distillation strategy. Experimental results demonstrate that the feature boosting based continual learning method effectively mitigates catastrophic forgetting and enhances the plasticity of the fault diagnosis model, outperforming other existing methods.
引用
收藏
页数:12
相关论文
共 30 条
[1]   Method to enhance deep learning fault diagnosis by generating adversarial samples [J].
Cao, Jie ;
Ma, Jialin ;
Huang, Dailin ;
Yu, Ping ;
Wang, Jinhua ;
Zheng, Kangjie .
APPLIED SOFT COMPUTING, 2022, 116
[2]   Continual learning fault diagnosis: A dual-branch adaptive aggregation residual network for fault diagnosis with machine increments [J].
Chen, Bojian ;
Shen, Changqing ;
Shi, Juanjuan ;
Kong, Lin ;
Tan, Luyang ;
Wang, Dong ;
Zhu, Zhongkui .
CHINESE JOURNAL OF AERONAUTICS, 2023, 36 (06) :361-377
[3]   A Lifelong Learning Method for Gearbox Diagnosis With Incremental Fault Types [J].
Chen, Bojian ;
Shen, Changqing ;
Wang, Dong ;
Kong, Lin ;
Chen, Liang ;
Zhu, Zhongkui .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
[4]   DyTox: Transformers for Continual Learning with DYnamic TOken eXpansion [J].
Douillard, Arthur ;
Rame, Alexandre ;
Couairon, Guillaume ;
Cord, Matthieu .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, :9275-9285
[5]   Catastrophic forgetting in connectionist networks [J].
French, RM .
TRENDS IN COGNITIVE SCIENCES, 1999, 3 (04) :128-135
[6]   Additive logistic regression: A statistical view of boosting - Rejoinder [J].
Friedman, J ;
Hastie, T ;
Tibshirani, R .
ANNALS OF STATISTICS, 2000, 28 (02) :400-407
[7]   Greedy function approximation: A gradient boosting machine [J].
Friedman, JH .
ANNALS OF STATISTICS, 2001, 29 (05) :1189-1232
[8]   Semi-supervised adversarial discriminative learning approach for intelligent fault diagnosis of wind turbine [J].
Han, Te ;
Xie, Wenzhen ;
Pei, Zhongyi .
INFORMATION SCIENCES, 2023, 648
[9]  
Hinton G, 2015, Arxiv, DOI arXiv:1503.02531
[10]   Adaptive incremental diagnosis model for intelligent fault diagnosis with dynamic weight correction [J].
Hu, Kui ;
He, Qingbo ;
Cheng, Changming ;
Peng, Zhike .
RELIABILITY ENGINEERING & SYSTEM SAFETY, 2024, 241