A Bidirectional Long Short-Term Memory Autoencoder Transformer for Remaining Useful Life Estimation

被引:8
作者
Fan, Zhengyang [1 ]
Li, Wanru [1 ]
Chang, Kuo-Chu [1 ]
机构
[1] George Mason Univ, Dept Syst Engn & Operat Res, Fairfax, VA 22030 USA
关键词
Transformer; self-supervised learning; autoencoder; remaining useful life prediction; bidirectional LSTM; turbofan engine; PREDICTION;
D O I
10.3390/math11244972
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
Estimating the remaining useful life (RUL) of aircraft engines holds a pivotal role in enhancing safety, optimizing operations, and promoting sustainability, thus being a crucial component of modern aviation management. Precise RUL predictions offer valuable insights into an engine's condition, enabling informed decisions regarding maintenance and crew scheduling. In this context, we propose a novel RUL prediction approach in this paper, harnessing the power of bi-directional LSTM and Transformer architectures, known for their success in sequence modeling, such as natural languages. We adopt the encoder part of the full Transformer as the backbone of our framework, integrating it with a self-supervised denoising autoencoder that utilizes bidirectional LSTM for improved feature extraction. Within our framework, a sequence of multivariate time-series sensor measurements serves as the input, initially processed by the bidirectional LSTM autoencoder to extract essential features. Subsequently, these feature values are fed into our Transformer encoder backbone for RUL prediction. Notably, our approach simultaneously trains the autoencoder and Transformer encoder, different from the naive sequential training method. Through a series of numerical experiments carried out on the C-MAPSS datasets, we demonstrate that the efficacy of our proposed models either surpasses or stands on par with that of other existing methods.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] Remaining Useful Life Prediction of Turbofan Engine Using Hybrid Model Based on Autoencoder and Bidirectional Long Short-Term Memory
    Song Y.
    Shi G.
    Chen L.
    Huang X.
    Xia T.
    Journal of Shanghai Jiaotong University (Science), 2018, 23 (Suppl 1): : 85 - 94
  • [2] Remaining Useful Life Prediction of Turbofan Engine Using Hybrid Model Based on Autoencoder and Bidirectional Long Short-Term Memory
    宋亚
    石郭
    陈乐懿
    黄鑫沛
    夏唐斌
    Journal of Shanghai Jiaotong University(Science), 2018, (S1) : 85 - 94
  • [3] A Joint Long Short-Term Memory and AdaBoost regression approach with application to remaining useful life estimation
    Zhu, Xiaoyan
    Zhang, Ping
    Xie, Min
    MEASUREMENT, 2021, 170
  • [4] Remaining Useful Life Estimation Using Long Short-Term Memory Neural Networks and Deep Fusion
    Zhang, Yang
    Hutchinson, Paul
    Lieven, Nicholas A. J.
    Nunez-Yanez, Jose
    IEEE ACCESS, 2020, 8 : 19033 - 19045
  • [5] Remaining useful life prediction method for bearing based on parallel bidirectional temporal convolutional network and bidirectional long and short-term memory network
    Liang H.-P.
    Cao J.
    Zhao X.-Q.
    Kongzhi yu Juece/Control and Decision, 2024, 39 (04): : 1288 - 1296
  • [6] Bearing remaining useful life prediction with convolutional long short-term memory fusion networks
    Wan, Shaoke
    Li, Xiaohu
    Zhang, Yanfei
    Liu, Shijie
    Hong, Jun
    Wang, Dongfeng
    RELIABILITY ENGINEERING & SYSTEM SAFETY, 2022, 224
  • [7] Remaining Useful Life Prognosis Based on Ensemble Long Short-Term Memory Neural Network
    Cheng, Yiwei
    Wu, Jun
    Zhu, Haiping
    Or, Siu Wing
    Shao, Xinyu
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
  • [8] Remaining useful life estimation using a bidirectional recurrent neural network based autoencoder scheme
    Yu, Wennian
    Kim, Il Yong
    Mechefske, Chris
    MECHANICAL SYSTEMS AND SIGNAL PROCESSING, 2019, 129 : 764 - 780
  • [9] Long Short-Term Memory Approach to Estimate Battery Remaining Useful Life Using Partial Data
    Chinomona, Benvolence
    Chung, Chunhui
    Chang, Lien-Kai
    Su, Wei-Chih
    Tsai, Mi-Ching
    IEEE ACCESS, 2020, 8 : 165419 - 165431
  • [10] Prediction of the Remaining Useful Life of Supercapacitors at Different Temperatures Based on Improved Long Short-Term Memory
    Ma, Ning
    Yin, Huaixian
    Wang, Kai
    ENERGIES, 2023, 16 (14)