A Continuous Remaining Useful Life Prediction Method With Multistage Attention Convolutional Neural Network and Knowledge Weight Constraint

被引:1
|
作者
Zhou, Jianghong [1 ]
Qin, Yi [1 ]
机构
[1] Chongqing Univ, State Key Lab Mech Transmiss Adv Equipment, Chongqing 400044, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Degradation; Predictive models; Computational modeling; Convolutional neural networks; Accuracy; Monitoring; Data models; Vectors; Maintenance; Attention mechanism; continuous learning (CL); deep learning; remaining useful life (RUL); rotating machinery; UNIT;
D O I
10.1109/TNNLS.2024.3462723
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The rotating machinery is continuously monitored in practical application. However, the historical life-cycle data cannot be always preserved due to the limited storage resource; meanwhile, the on-site computing platform cannot process a large number of monitoring samples. It brings a great challenge for the remaining useful life (RUL) prediction. Thus, continuous learning (CL) is introduced into RUL prediction model for achieving its knowledge accumulation and dynamic update. To improve the performance of continuous RUL prediction, this article presents a new RUL prediction methodology with a multistage attention convolutional neural network (MSACNN) and knowledge weight constraint (KWC). First, an improved multihead full-channel sight self-attention (MFCSSA) mechanism is proposed to capture the global degradation information across all channels. MSACNN is then constructed by embedding MFCSSA, squeeze-and-excitation (SE) mechanism, and convolutional block attention module (CBAM) into different stages of feature extraction, which enables it to capture the global degradation information and refine the feature representations progressively. The KWC mechanism based on the importance of weight parameters and gradient information is proposed and integrated into MSACNN to achieve the continuous RUL prediction task. The proposed KWC can effectively alleviate catastrophic forgetting in CL. Finally, the experimental results on the life-cycle bearing and gear datasets demonstrate that MSACNN has a higher accuracy than the existing prediction methods. Moreover, the KWC mechanism performs better than typical CL methods in retaining the previously learned knowledge while acquiring the new task knowledge. Therefore, the proposed methodology can be better applied to the continuous RUL prediction tasks than the advanced methods of the same kind.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] Remaining Useful Life Prediction Under Multiple Operating Conditions Based on a Novel Dual-Layer Temporal Convolutional Network
    Yang, Xu
    Chen, Dandan
    Huang, Jian
    Wu, Xia
    Chen, Zhiwen
    Li, Qing
    IEEE SENSORS JOURNAL, 2025, 25 (01) : 1900 - 1911
  • [22] Spatio-Temporal Fusion Attention: A Novel Approach for Remaining Useful Life Prediction Based on Graph Neural Network
    Kong, Ziqian
    Jin, Xiaohang
    Xu, Zhengguo
    Zhang, Bin
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [23] Convolutional neural network based on attention mechanism and Bi-LSTM for bearing remaining life prediction
    Luo, Jiahang
    Zhang, Xu
    APPLIED INTELLIGENCE, 2022, 52 (01) : 1076 - 1091
  • [24] Temporal Convolution-Based Long-Short Term Memory Network With Attention Mechanism for Remaining Useful Life Prediction
    Hsu, Chia-Yu
    Lu, Yi-Wei
    Yan, Jia-Hong
    IEEE TRANSACTIONS ON SEMICONDUCTOR MANUFACTURING, 2022, 35 (02) : 220 - 228
  • [25] Temporal Knowledge Graph Informer Network for Remaining Useful Life Prediction
    Zhang, Yuanming
    Zhou, Weiyue
    Huang, Jiacheng
    Jin, Xiaohang
    Xiao, Gang
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [26] Structural-Guided Interaction and Attention-Enhancing Compensation Network for Machine Remaining Useful Life Prediction
    Liu, Yongkang
    Pan, Donghui
    Liu, Yongbin
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73 : 1 - 11
  • [27] Remaining useful life prediction of rolling bearings based on convolutional recurrent attention network
    Zhang, Qiang
    Ye, Zijian
    Shao, Siyu
    Niu, Tianlin
    Zhao, Yuwei
    ASSEMBLY AUTOMATION, 2022, 42 (03) : 372 - 387
  • [28] Remaining Useful Life Prediction Combining Advanced Anomaly Detection and Graph Isomorphic Network
    Qi, Junyu
    Chen, Zhuyun
    Song, Yuchen
    Xia, Jingyan
    Li, Weihua
    IEEE SENSORS JOURNAL, 2024, 24 (22) : 38365 - 38376
  • [29] Remaining Useful Life Prediction of Bearings Based on Convolution Attention Mechanism and Temporal Convolution Network
    Wang, Haitao
    Yang, Jie
    Wang, Ruihua
    Shi, Lichen
    IEEE ACCESS, 2023, 11 : 24407 - 24419
  • [30] Multiscale Spatiotemporal Attention Network for Remaining Useful Life Prediction of Mechanical Systems
    Gao, Zhan
    Jiang, Weixiong
    Wu, Jun
    Dai, Tianjiao
    IEEE SENSORS JOURNAL, 2025, 25 (04) : 6825 - 6835