A Continuous Remaining Useful Life Prediction Method With Multistage Attention Convolutional Neural Network and Knowledge Weight Constraint

被引:1
|
作者
Zhou, Jianghong [1 ]
Qin, Yi [1 ]
机构
[1] Chongqing Univ, State Key Lab Mech Transmiss Adv Equipment, Chongqing 400044, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Degradation; Predictive models; Computational modeling; Convolutional neural networks; Accuracy; Monitoring; Data models; Vectors; Maintenance; Attention mechanism; continuous learning (CL); deep learning; remaining useful life (RUL); rotating machinery; UNIT;
D O I
10.1109/TNNLS.2024.3462723
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The rotating machinery is continuously monitored in practical application. However, the historical life-cycle data cannot be always preserved due to the limited storage resource; meanwhile, the on-site computing platform cannot process a large number of monitoring samples. It brings a great challenge for the remaining useful life (RUL) prediction. Thus, continuous learning (CL) is introduced into RUL prediction model for achieving its knowledge accumulation and dynamic update. To improve the performance of continuous RUL prediction, this article presents a new RUL prediction methodology with a multistage attention convolutional neural network (MSACNN) and knowledge weight constraint (KWC). First, an improved multihead full-channel sight self-attention (MFCSSA) mechanism is proposed to capture the global degradation information across all channels. MSACNN is then constructed by embedding MFCSSA, squeeze-and-excitation (SE) mechanism, and convolutional block attention module (CBAM) into different stages of feature extraction, which enables it to capture the global degradation information and refine the feature representations progressively. The KWC mechanism based on the importance of weight parameters and gradient information is proposed and integrated into MSACNN to achieve the continuous RUL prediction task. The proposed KWC can effectively alleviate catastrophic forgetting in CL. Finally, the experimental results on the life-cycle bearing and gear datasets demonstrate that MSACNN has a higher accuracy than the existing prediction methods. Moreover, the KWC mechanism performs better than typical CL methods in retaining the previously learned knowledge while acquiring the new task knowledge. Therefore, the proposed methodology can be better applied to the continuous RUL prediction tasks than the advanced methods of the same kind.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Multibranch Horizontal Augmentation Network for Continuous Remaining Useful Life Prediction
    Zhou, Jianghong
    Luo, Jun
    Pu, Huayan
    Qin, Yi
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2025, 55 (03): : 2237 - 2249
  • [2] Distributed Attention-Based Temporal Convolutional Network for Remaining Useful Life Prediction
    Song, Yan
    Gao, Shengyao
    Li, Yibin
    Jia, Lei
    Li, Qiqiang
    Pang, Fuzhen
    IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (12): : 9594 - 9602
  • [3] Continuous Remaining Useful Life Prediction by Self-Guided Attention Convolutional Neural Network and Memory Consciousness Adjustment
    Zhou, Jianghong
    Qi, Junyu
    Chen, Dingliang
    Qin, Yi
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (19): : 31947 - 31958
  • [4] Attention-Based LSTM Network for Rotatory Machine Remaining Useful Life Prediction
    Zhang, Hao
    Zhang, Qiang
    Shao, Siyu
    Niu, Tianlin
    Yang, Xinyu
    IEEE ACCESS, 2020, 8 (08): : 132188 - 132199
  • [5] Multiscale Convolutional Attention Network for Predicting Remaining Useful Life of Machinery
    Wang, Biao
    Lei, Yaguo
    Li, Naipeng
    Wang, Wenting
    IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2021, 68 (08) : 7496 - 7504
  • [6] Dual-Attention-Based Multiscale Convolutional Neural Network With Stage Division for Remaining Useful Life Prediction of Rolling Bearings
    Jiang, Fei
    Ding, Kang
    He, Guolin
    Lin, Huibin
    Chen, Zhuyun
    Li, Weihua
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [7] Local Enhancing Transformer With Temporal Convolutional Attention Mechanism for Bearings Remaining Useful Life Prediction
    Peng, Huachao
    Jiang, Bin
    Mao, Zehui
    Liu, Shangkun
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [8] Remaining Useful Life Prediction of Machinery: A New Multiscale Temporal Convolutional Network Framework
    Deng, Feiyue
    Bi, Yan
    Liu, Yongqiang
    Yang, Shaopu
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [9] Prediction of State-of-Health and Remaining-Useful-Life of Battery Based on Hybrid Neural Network Model
    Thi Minh Lien, Le
    Quoc Anh, Vu
    Duc Tuyen, Nguyen
    Fujita, Goro
    IEEE ACCESS, 2024, 12 : 129022 - 129039
  • [10] Frequency Hoyer attention based convolutional neural network for remaining useful life prediction of machinery
    Huang, Xin
    Zhang, Ping
    Shi, Wenjie
    Dong, Shuzhi
    Wen, Guangrui
    Lin, Hailong
    Chen, Xuefeng
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2021, 32 (12)