Global and local information integrated network for remaining useful life prediction

被引:12
作者
Chen, Zian [1 ]
Jin, Xiaohang [3 ,4 ,5 ]
Kong, Ziqian [1 ]
Wang, Feng [1 ]
Xu, Zhengguo [1 ,2 ]
机构
[1] Zhejiang Univ, Coll Control Sci & Engn, State Key Lab Ind Control Technol, Hangzhou 310027, Peoples R China
[2] Zhejiang Univ, Huzhou Inst, Huzhou 313000, Peoples R China
[3] Zhejiang Univ Technol, Coll Mech Engn, Hangzhou 310023, Peoples R China
[4] Zhejiang Univ Technol, Key Lab Special Purpose Equipment & Adv Proc Techn, Minist Educ & Zhejiang Prov, Hangzhou 310023, Peoples R China
[5] Ninghai ZJUT Acad Sci & Technol, Ninghai 315600, Peoples R China
基金
中国国家自然科学基金;
关键词
Global and local information; Interpretability; Remaining useful life prediction; Transformer;
D O I
10.1016/j.engappai.2023.106956
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Data-driven methods routinely achieve promising results on remaining useful life prediction, but under a window-manner end-to-end paradigm, they suffer from unsatisfying generalization ability and low inter-pretability, as the consequence of neglecting diverse modes among the entire degradation processes of different entities. This article proposes a novel Transformer-based network, to tackle the problem by integration of global and local information. During offline training, the paired inputs containing full life and piece data are constructed, and then using cross-attention between the encoder and the decoder, the consistent position of the piece data in the full life is derived, which is directly associated with the degradation state. The designed paired inputs and model architecture ensures the strong generalization because the prediction result considering global information is adaptive to diverse degradation modes. Further, the designed cross-attention discrepancy utilizes prior knowledge of the consistent position such that similar degradation states are aligned more properly. Such a consistent position, visualized by the cross-attention distribution, is supposed to represent the intuitive relationship between degradation level and monitoring data, thus provides inherent interpretability about the prediction process. Finally, predictions of the online monitoring piece data with respect to all historical full lives with different degradation modes are aggregated to the final prediction. Extensive experiments on two datasets of turbofan and bearing show that our model provides competitive performance, especially under complicated working conditions and fault modes, achieving averagely 5.9% score reduction compared with the state-of-the-art method.
引用
收藏
页数:12
相关论文
共 49 条
[1]   Autoencoder for Design of Mitigation Model for DDOS Attacks via M-DBNN [J].
Agrawal, Ankit ;
Singh, Rajiv ;
Khari, Manju ;
Vimal, S. ;
Lim, Sangsoon .
WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2022, 2022
[2]  
Akhtar N., 2023, PREPRINT
[3]   TinyML-enabled edge implementation of transfer learning framework for domain generalization in machine fault diagnosis [J].
Asutkar, Supriya ;
Chalke, Chaitravi ;
Shivgan, Kajal ;
Tallur, Siddharth .
EXPERT SYSTEMS WITH APPLICATIONS, 2023, 213
[4]   Interpretable Anomaly Detection with DIFFI: Depth-based feature importance of Isolation Forest [J].
Carletti, Mattia ;
Terzi, Matteo ;
Susto, Gian Antonio .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 119
[5]   A novel deep learning method based on attention mechanism for bearing remaining useful life prediction [J].
Chen, Yuanhang ;
Peng, Gaoliang ;
Zhu, Zhiyu ;
Li, Sijue .
APPLIED SOFT COMPUTING, 2020, 86
[6]   Machine Remaining Useful Life Prediction via an Attention-Based Deep Learning Approach [J].
Chen, Zhenghua ;
Wu, Min ;
Zhao, Rui ;
Guretno, Feri ;
Yan, Ruqiang ;
Li, Xiaoli .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2021, 68 (03) :2521-2531
[7]   Variational encoding approach for interpretable assessment of remaining useful life estimation [J].
Costa, Nahuel ;
Sanchez, Luciano .
RELIABILITY ENGINEERING & SYSTEM SAFETY, 2022, 222
[8]   Image- and health indicator-based transfer learning hybridization for battery RUL prediction [J].
Couture, Jonathan ;
Lin, Xianke .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2022, 114
[9]   Remaining Useful Life Prediction of Hybrid Ceramic Bearings Using an Integrated Deep Learning and Particle Filter Approach [J].
Deutsch, Jason ;
He, Miao ;
He, David .
APPLIED SCIENCES-BASEL, 2017, 7 (07)
[10]   Convolutional Transformer: An Enhanced Attention Mechanism Architecture for Remaining Useful Life Estimation of Bearings [J].
Ding, Yifei ;
Jia, Minping .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71