A Novel Dual-Branch Transformer With Gated Cross Attention for Remaining Useful Life Prediction of Bearings

被引:0
|
作者
Cui, Jin [1 ]
Ji, J. C. [2 ]
Zhang, Tianxiao [1 ]
Cao, Licai [1 ]
Chen, Zixu [3 ]
Ni, Qing [2 ]
机构
[1] Beihang Univ, Sch Mech Engn & Automat, Beijing 100191, Peoples R China
[2] Univ Technol Sydney, Sch Mech & Mech tron Engn, Ultimo, NSW 2007, Australia
[3] Chongqing Univ, State Key Lab Mech Transmiss Adv Equipment, Chongqing 400044, Peoples R China
基金
中国国家自然科学基金;
关键词
Convolutional gated recurrent units (ConvGRUs); cross-attention; feature fusion; remaining useful life (RUL) prediction;
D O I
10.1109/JSEN.2024.3485918
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Features from different domains in vibration signals offer valuable insights for remaining useful life (RUL) prediction of bearings. While fusing these features can improve the prediction performance, traditional fusion methods lack effective information exchange across domains, limiting adaptive feature fusion. This limitation can lead to the information redundancy and hinder the accurate identification of bearing degradation states. To address these challenges, this study introduces a dual-branch Transformer with gated cross attention (DTGCA), designed to handle and integrate features from different domains for precise RUL prediction. Specifically, one branch processes 1-D time-series feature from the time and frequency domains, while the other branch uses a residual convolutional gated recurrent unit (res-ConvGRU) to handle 2-D time-frequency image features. The proposed gated cross-attention (GCA) mechanism enables adaptive information exchange between the branches, effectively fusing their information to provide a clearer representation of bearing degradation states. The proposed method is validated on the two real run-to-failure datasets. Comprehensive ablation experiments confirm the method's underlying rationality, while the detailed comparative experiments with other approaches clearly demonstrate its superiority.
引用
收藏
页码:41410 / 41423
页数:14
相关论文
共 26 条
  • [1] Dual-Aspect Self-Attention Based on Transformer for Remaining Useful Life Prediction
    Zhang, Zhizheng
    Song, Wen
    Li, Qiqiang
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [2] DTCA: Dual-Branch Transformer with Cross-Attention for EEG and Eye Movement Data Fusion
    Zhang, Xiaoshan
    Shi, Enze
    Yu, Sigang
    Zhang, Shu
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2024, PT II, 2024, 15002 : 141 - 151
  • [3] Dual-Branch Cross-Attention Network for Micro-Expression Recognition with Transformer Variants
    Xie, Zhihua
    Zhao, Chuwei
    ELECTRONICS, 2024, 13 (02)
  • [4] A dual-stream temporal convolutional network for remaining useful life prediction of rolling bearings
    Zhang, Yazhou
    Zhao, Xiaoqiang
    Xu, Rongrong
    Peng, Zhenrui
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2025, 36 (01)
  • [5] Remaining useful life prediction of motor bearings based on slow feature analysis-assisted attention mechanism and dual-LSTM networks
    Zhang, Wan
    Zhang, Xiaogang
    Yan, Xiaoan
    Xu, Yadong
    Cai, Jun
    STRUCTURAL HEALTH MONITORING-AN INTERNATIONAL JOURNAL, 2025,
  • [6] PSTFormer: A novel parallel spatial-temporal transformer for remaining useful life prediction of aeroengine
    Fu, Song
    Jia, Yiming
    Lin, Lin
    Suo, Shiwei
    Guo, Feng
    Zhang, Sihao
    Liu, Yikun
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 265
  • [7] A hybrid prognostic approach combined with deep Bayesian transformer and enhanced particle filter for remaining useful life prediction of bearings
    Chen, Xiaodan
    Li, Ke
    Wang, Shaofan
    Liu, Haobo
    MEASUREMENT, 2025, 252
  • [8] A Feature Fusion-Based Method for Remaining Useful Life Prediction of Rolling Bearings
    Liu, Jie
    Yang, Zian
    Xie, Jingsong
    Wang, Ruijie
    Liu, Shanhui
    Xi, Darun
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [9] SPECTRAL-SPATIAL DUAL-BRANCH CROSS-ENHANCED TRANSFORMER FOR HYPERSPECTRAL IMAGE CLASSIFICATION
    Zhang, Hang
    Zhan, Tianming
    Sun, Le
    2024 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2024), 2024, : 8975 - 8978
  • [10] Machine Remaining Useful Life Prediction via an Attention-Based Deep Learning Approach
    Chen, Zhenghua
    Wu, Min
    Zhao, Rui
    Guretno, Feri
    Yan, Ruqiang
    Li, Xiaoli
    IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2021, 68 (03) : 2521 - 2531