A Novel Combination Neural Network Based on ConvLSTM-Transformer for Bearing Remaining Useful Life Prediction

被引:14
作者
Deng, Feiyue [1 ]
Chen, Zhe [1 ]
Liu, Yongqiang [1 ]
Yang, Shaopu [2 ]
Hao, Rujiang [1 ]
Lyu, Litong [1 ]
机构
[1] Shijiazhuang Tiedao Univ, Sch Mech Engn, Shijiazhuang 050043, Peoples R China
[2] Shijiazhuang Tiedao Univ, State Key Lab Mech Behav & Syst Safety Traff Engn, Shijiazhuang 050043, Peoples R China
关键词
remaining useful life; deep learning; convolution-based LSTM; transformer network; SHORT-TERM-MEMORY; MODEL; PROGNOSTICS;
D O I
10.3390/machines10121226
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
A sensible maintenance strategy must take into account the remaining usable life (RUL) estimation to maximize equipment utilization and avoid costly unexpected breakdowns. In view of some inherent drawbacks of traditional CNN and LSTM-based RUL prognostics models, a novel combination model of the ConvLSTM and the Transformer, which is based on the idea of "Extracting spatiotemporal features and applying them to RUL prediction", is proposed for RUL prediction. The ConvLSTM network can directly extract low-dimensional spatiotemporal features from long-time degradation signals. The Transformer, based entirely on attention mechanisms, can deeply explore the mapping law between deep-level nonlinear spatiotemporal feature information and equipment service performance degradation. The proposed approach is validated with the whole-life degradation dataset of bearings from the PHM 2012 Challenge dataset and the XJTU-SY public dataset. The detailed comparative analysis shows that the proposed method has higher RUL prediction accuracy and outstanding comprehensive prediction performance.
引用
收藏
页数:20
相关论文
共 37 条
[1]   CNN-LSTM: An efficient hybrid deep learning architecture for predicting short-term photovoltaic power production [J].
Agga, Ali ;
Abbou, Ahmed ;
Labbadi, Moussa ;
El Houm, Yassine ;
Ali, Imane Hammou Ou .
ELECTRIC POWER SYSTEMS RESEARCH, 2022, 208
[2]  
Ahmed K., 2017, ARXIV
[3]  
[Anonymous], 2012, PROC IEEE INT C PROG, DOI DOI 10.1109/PHM.2012.6227845
[4]   Remaining useful life estimation based on nonlinear feature reduction and support vector regression [J].
Benkedjouh, T. ;
Medjaher, K. ;
Zerhouni, N. ;
Rechak, S. .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2013, 26 (07) :1751-1760
[5]   An integrated approach to planetary gearbox fault diagnosis using deep belief networks [J].
Chen, Haizhou ;
Wang, Jiaxu ;
Tang, Baoping ;
Xiao, Ke ;
Li, Junyang .
MEASUREMENT SCIENCE AND TECHNOLOGY, 2017, 28 (02)
[6]   Developing Deep Survival Model for Remaining Useful Life Estimation Based on Convolutional and Long Short-Term Memory Neural Networks [J].
Chu, Chia-Hua ;
Lee, Chia-Jung ;
Yeh, Hsiang-Yuan .
WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2020, 2020
[7]   Spatio-Temporal Graph Transformer Networks for Pedestrian Trajectory Prediction [J].
Yu, Cunjun ;
Ma, Xiao ;
Ren, Jiawei ;
Zhao, Haiyu ;
Yi, Shuai .
COMPUTER VISION - ECCV 2020, PT XII, 2020, 12357 :507-523
[8]  
Dai ZH, 2019, 57TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2019), P2978
[9]   Deep-Learning-Based Remaining Useful Life Prediction Based on a Multi-Scale Dilated Convolution Network [J].
Deng, Feiyue ;
Bi, Yan ;
Liu, Yongqiang ;
Yang, Shaopu .
MATHEMATICS, 2021, 9 (23)
[10]   A segmental hidden semi-Markov model (HSMM)-based diagnostics and prognostics framework and methodology [J].
Dong, Ming ;
He, David .
MECHANICAL SYSTEMS AND SIGNAL PROCESSING, 2007, 21 (05) :2248-2266