Global attention mechanism based deep learning for remaining useful life prediction of aero-engine

被引:40
作者
Xu, Zhiqiang [1 ]
Zhang, Yujie [1 ,3 ]
Miao, Jianguo [2 ]
Miao, Qiang [1 ]
机构
[1] Sichuan Univ, Coll Elect Engn, Chengdu 610065, Peoples R China
[2] Chongqing Univ Posts & Telecommun, Coll Automat, Chongqing 400065, Peoples R China
[3] Sichuan Univ, 24 South Sect 1,Yihuan Rd, Chengdu 610065, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Aero-engine; Attention mechanism; Temporal convolutional network; Remaining useful life; RUL; PROGNOSTICS; MANAGEMENT; MODEL;
D O I
10.1016/j.measurement.2023.113098
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Aero-engine is one of the core components of aircraft. The accurate prediction of areo-engine Remaining Useful Life (RUL) is of great significance for ensuring the operation safety of aircraft. The emergence of attention mechanisms allows the deep learning model to effectively focus on important data features for RUL prediction tasks, which can improve the accuracy of RUL prediction for aero-engine. However, most mainstream dual attention mechanisms currently calculate attention weights for different dimensions separately, making it difficult to obtain global information. A novel global attention (GA) mechanism has been proposed in this paper that overcomes existing challenges and effectively identifies relevant data features for accurate RUL predictions. The structure design of GA adopts a very novel idea, requiring no internal recurrent neural network (RNN) or convolutional neural network (CNN) modules. Instead, it utilizes two pooling operations to extract features from different sensors and time steps, which are then calculated in parallel to obtain global attention coefficients. This enables the deep learning based model to adaptively learn the most important information of the input. Moreover, the parallel computation design avoids wastage of computational resources. On this basis, we combine GA with self-attention (SA) mechanism and temporal convolutional network (TCN) to propose an end-to-end deep learning RUL prediction method. To validate the effectiveness of the proposed method, the C-MAPSS aero-engine dataset is used. Experimental results demonstrate the superiority of our method compared to state-of-the-art RUL prediction methods.
引用
收藏
页数:10
相关论文
共 35 条
[1]   Aero engines remaining useful life prediction based on enhanced adaptive guided differential evolution [J].
Abdelghafar, Sara ;
Khater, Ali ;
Wagdy, Ali ;
Darwish, Ashraf ;
Hassanien, Aboul Ella .
EVOLUTIONARY INTELLIGENCE, 2024, 17 (02) :1209-1220
[2]  
Bai SJ, 2018, Arxiv, DOI [arXiv:1803.01271, DOI 10.48550/ARXIV.1803.01271]
[3]   An adaptive ARX model to estimate the RUL of aluminum plates based on its crack growth [J].
Barraza-Barraza, Diana ;
Tercero-Gomez, Victor G. ;
Beruvides, Mario G. ;
Limon-Robles, Jorge .
MECHANICAL SYSTEMS AND SIGNAL PROCESSING, 2017, 82 :519-536
[4]   Remaining Useful Life Prognosis Based on Ensemble Long Short-Term Memory Neural Network [J].
Cheng, Yiwei ;
Wu, Jun ;
Zhu, Haiping ;
Or, Siu Wing ;
Shao, Xinyu .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
[5]   A systematic method for the optimization of gas supply reliability in natural gas pipeline network based on Bayesian networks and deep reinforcement learning [J].
Fan, Lin ;
Su, Huai ;
Wang, Wei ;
Zio, Enrico ;
Zhang, Li ;
Yang, Zhaoming ;
Peng, Shiliang ;
Yu, Weichao ;
Zuo, Lili ;
Zhang, Jinjun .
RELIABILITY ENGINEERING & SYSTEM SAFETY, 2022, 225
[6]   A novel deep learning framework for state of health estimation of lithium-ion battery [J].
Fan, Yaxiang ;
Xiao, Fei ;
Li, Chaoran ;
Yang, Guorun ;
Tang, Xin .
JOURNAL OF ENERGY STORAGE, 2020, 32
[7]   Dual Attention Network for Scene Segmentation [J].
Fu, Jun ;
Liu, Jing ;
Tian, Haijie ;
Li, Yong ;
Bao, Yongjun ;
Fang, Zhiwei ;
Lu, Hanqing .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :3141-3149
[8]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[9]   Remaining Useful Life Estimation Using Deep Convolutional Generative Adversarial Networks Based on an Autoencoder Scheme [J].
Hou, Guisheng ;
Xu, Shuo ;
Zhou, Nan ;
Yang, Lei ;
Fu, Quanhao .
COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2020, 2020
[10]  
Hu J, 2018, PROC CVPR IEEE, P7132, DOI [10.1109/TPAMI.2019.2913372, 10.1109/CVPR.2018.00745]