A Bidirectional Long Short-Term Memory Autoencoder Transformer for Remaining Useful Life Estimation

被引:8
作者
Fan, Zhengyang [1 ]
Li, Wanru [1 ]
Chang, Kuo-Chu [1 ]
机构
[1] George Mason Univ, Dept Syst Engn & Operat Res, Fairfax, VA 22030 USA
关键词
Transformer; self-supervised learning; autoencoder; remaining useful life prediction; bidirectional LSTM; turbofan engine; PREDICTION;
D O I
10.3390/math11244972
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
Estimating the remaining useful life (RUL) of aircraft engines holds a pivotal role in enhancing safety, optimizing operations, and promoting sustainability, thus being a crucial component of modern aviation management. Precise RUL predictions offer valuable insights into an engine's condition, enabling informed decisions regarding maintenance and crew scheduling. In this context, we propose a novel RUL prediction approach in this paper, harnessing the power of bi-directional LSTM and Transformer architectures, known for their success in sequence modeling, such as natural languages. We adopt the encoder part of the full Transformer as the backbone of our framework, integrating it with a self-supervised denoising autoencoder that utilizes bidirectional LSTM for improved feature extraction. Within our framework, a sequence of multivariate time-series sensor measurements serves as the input, initially processed by the bidirectional LSTM autoencoder to extract essential features. Subsequently, these feature values are fed into our Transformer encoder backbone for RUL prediction. Notably, our approach simultaneously trains the autoencoder and Transformer encoder, different from the naive sequential training method. Through a series of numerical experiments carried out on the C-MAPSS datasets, we demonstrate that the efficacy of our proposed models either surpasses or stands on par with that of other existing methods.
引用
收藏
页数:17
相关论文
共 50 条
  • [41] Remaining useful life prediction based on spatiotemporal autoencoder
    Xu, Tao
    Pi, Dechang
    Zeng, Shi
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (28) : 71407 - 71433
  • [42] A hybrid approach for remaining useful life prediction of lithium-ion battery with Adaptive Levy Flight optimized Particle Filter and Long Short-Term Memory network
    Zhang, Yong
    Chen, Liaogehao
    Li, Yi
    Zheng, Xiujuan
    Chen, Jianliang
    Jin, Junyang
    JOURNAL OF ENERGY STORAGE, 2021, 44
  • [43] Improved anti-noise adaptive long short-term memory neural network modeling for the robust remaining useful life prediction of lithium-ion batteries
    Wang, Shunli
    Fan, Yongcun
    Jin, Siyu
    Takyi-Aninakwa, Paul
    Fernandez, Carlos
    RELIABILITY ENGINEERING & SYSTEM SAFETY, 2023, 230
  • [44] An embedding layer-based quantum long short-term memory model with transfer learning for proton exchange membrane fuel stack remaining useful life prediction
    Wang, Fu-Kwun
    Kebede, Getnet Awoke
    Lo, Shih-Che
    Woldegiorgis, Bereket Haile
    ENERGY, 2024, 308
  • [45] Bidirectional Long Short-Term Memory with Temporal Dense Sampling for human action recognition
    Tan, Kok Seang
    Lim, Kian Ming
    Lee, Chin Poo
    Kwek, Lee Chung
    EXPERT SYSTEMS WITH APPLICATIONS, 2022, 210
  • [46] Epileptic Seizure Detection Based on Stockwell Transform and Bidirectional Long Short-Term Memory
    Geng, Minxing
    Zhou, Weidong
    Liu, Guoyang
    Li, Chaosong
    Zhang, Yanli
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2020, 28 (03) : 573 - 580
  • [47] Bidirectional long short-term memory for surgical skill classification of temporally segmented tasks
    Kelly, Jason D.
    Petersen, Ashley
    Lendvay, Thomas S.
    Kowalewski, Timothy M.
    INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2020, 15 (12) : 2079 - 2088
  • [48] Bidirectional long short-term memory for surgical skill classification of temporally segmented tasks
    Jason D. Kelly
    Ashley Petersen
    Thomas S. Lendvay
    Timothy M. Kowalewski
    International Journal of Computer Assisted Radiology and Surgery, 2020, 15 : 2079 - 2088
  • [49] Stock Market Prediction-by-Prediction Based on Autoencoder Long Short-Term Memory Networks
    Faraz, Mehrnaz
    Khaloozadeh, Hamid
    Abbasi, Milad
    2020 28TH IRANIAN CONFERENCE ON ELECTRICAL ENGINEERING (ICEE), 2020, : 1483 - 1487
  • [50] Long short-term temporal fusion transformer for short-term forecasting of limit order book in China markets
    Wu, Yucheng
    Wang, Shuxin
    Fu, Xianghua
    APPLIED INTELLIGENCE, 2024, 54 (24) : 12979 - 13000