An attention-based temporal convolutional network method for predicting remaining useful life of aero-engine

被引:66
作者
Zhang, Qiang [1 ]
Liu, Qiong [1 ]
Ye, Qin [1 ]
机构
[1] Huazhong Univ Sci & Technol, Sch Mech Sci & Engn, State Key Lab Digital Mfg Equipment & Technol, Wuhan 430074, Peoples R China
关键词
Remaining useful life prediction; Temporal convolutional network; Attention mechanism; NEURAL-NETWORK;
D O I
10.1016/j.engappai.2023.107241
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Researches on Remaining Useful Life (RUL) prediction of aero-engine could help to make maintenance plans, improve operation reliabilities and reduce maintenance costs. While deep learning methods have been widely used in RUL prediction research, most deep learning-based RUL prediction methods tend to treat input features as equally important. Contributions of different channels and time steps from input features are not considered simultaneously, which will inevitably affect efficiencies and accuracies of RUL prediction. Therefore, a novel deep learning-based RUL prediction method named attention-based temporal convolutional network (ATCN) is proposed in this article. First, an improved self-attention mechanism is used to weight contributions of different time steps from input features. Input features of time steps closely related to RUL are enhanced by the improved self-attention mechanism, which could improve efficiencies of feature extraction in a network. Then, a temporal convolutional network is constructed to capture long-term dependent information and extract feature representations from weighted features of the improved self-attention mechanism. Next, a squeeze-and-excitation mechanism is adopted to weight contributions of different channels from feature representations, which could help to improve prediction accuracies of the network. Finally, a fully connected layer is constructed to fuse weighted features to output RUL values. A commercial modular aero-propulsion system simulation (C-MAPSS) dataset from NASA is applied to verify effects of the proposed method. Performances of the proposed method are compared with those based on different neural network architectures, such as CNN, RNN, LSTM, DCNN, TCN, BiGRU-TSAM, AGCNN and channel attention plus Transformer. Results show that the proposed method could yield results with higher accuracy for RUL prediction of aero-engine than other methods.
引用
收藏
页数:13
相关论文
共 39 条
[21]  
Saxena A, 2008, 2008 INTERNATIONAL CONFERENCE ON PROGNOSTICS AND HEALTH MANAGEMENT (PHM), P1
[22]   SUNET: Speaker-utterance interaction Graph Neural Network for Emotion Recognition in Conversations [J].
Song, Rui ;
Giunchiglia, Fausto ;
Shi, Lida ;
Shen, Qiang ;
Xu, Hao .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 123
[23]   Multiclass classification for predicting Remaining Useful Life (RUL) of the turbofan engine [J].
Soni, Piyush ;
Khan, Mohd Anas ;
Zubair, Mohammad ;
Garg, Suresh Kumar .
2021 11TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING, DATA SCIENCE & ENGINEERING (CONFLUENCE 2021), 2021, :1023-1028
[24]  
Srivastava N, 2014, J MACH LEARN RES, V15, P1929
[25]   Lightweight bidirectional long short-term memory based on automated model pruning with application to bearing remaining useful life prediction [J].
Sun, Jiankai ;
Zhang, Xin ;
Wang, Jiaxu .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 118
[26]   Sustainable manufacturing, maintenance policies, prognostics and health management: A literature review [J].
Vrignat, Pascal ;
Kratz, Frederic ;
Avila, Manuel .
RELIABILITY ENGINEERING & SYSTEM SAFETY, 2022, 218
[27]   Multiscale Convolutional Attention Network for Predicting Remaining Useful Life of Machinery [J].
Wang, Biao ;
Lei, Yaguo ;
Li, Naipeng ;
Wang, Wenting .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2021, 68 (08) :7496-7504
[28]   Deep neural network-based multiagent synergism method of probabilistic HCF evaluation for aircraft compressor rotor [J].
Wang, Bo-Wei ;
Tang, Wen-Zhong ;
Song, Lu-Kai ;
Bai, Guang-Chen .
INTERNATIONAL JOURNAL OF FATIGUE, 2023, 170
[29]   A New Intelligent Bearing Fault Diagnosis Method Using SDP Representation and SE-CNN [J].
Wang, Hui ;
Xu, Jiawen ;
Yan, Ruqiang ;
Gao, Robert X. .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2020, 69 (05) :2377-2389
[30]   CLformer: Locally grouped auto-correlation and convolutional transformer for long-term multivariate time series forecasting [J].
Wang, Xingyu ;
Liu, Hui ;
Du, Junzhao ;
Yang, Zhihan ;
Dong, Xiyao .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 121