A Bidirectional Long Short-Term Memory Autoencoder Transformer for Remaining Useful Life Estimation

被引:8
作者
Fan, Zhengyang [1 ]
Li, Wanru [1 ]
Chang, Kuo-Chu [1 ]
机构
[1] George Mason Univ, Dept Syst Engn & Operat Res, Fairfax, VA 22030 USA
关键词
Transformer; self-supervised learning; autoencoder; remaining useful life prediction; bidirectional LSTM; turbofan engine; PREDICTION;
D O I
10.3390/math11244972
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
Estimating the remaining useful life (RUL) of aircraft engines holds a pivotal role in enhancing safety, optimizing operations, and promoting sustainability, thus being a crucial component of modern aviation management. Precise RUL predictions offer valuable insights into an engine's condition, enabling informed decisions regarding maintenance and crew scheduling. In this context, we propose a novel RUL prediction approach in this paper, harnessing the power of bi-directional LSTM and Transformer architectures, known for their success in sequence modeling, such as natural languages. We adopt the encoder part of the full Transformer as the backbone of our framework, integrating it with a self-supervised denoising autoencoder that utilizes bidirectional LSTM for improved feature extraction. Within our framework, a sequence of multivariate time-series sensor measurements serves as the input, initially processed by the bidirectional LSTM autoencoder to extract essential features. Subsequently, these feature values are fed into our Transformer encoder backbone for RUL prediction. Notably, our approach simultaneously trains the autoencoder and Transformer encoder, different from the naive sequential training method. Through a series of numerical experiments carried out on the C-MAPSS datasets, we demonstrate that the efficacy of our proposed models either surpasses or stands on par with that of other existing methods.
引用
收藏
页数:17
相关论文
共 50 条
  • [21] Learning Hierarchical Weather Data Representation for Short-Term Weather Forecasting Using Autoencoder and Long Short-Term Memory Models
    Heryadi, Yaya
    INTELLIGENT INFORMATION AND DATABASE SYSTEMS, ACIIDS 2019, PT I, 2019, 11431 : 373 - 384
  • [22] Enhancing Forex market trend analysis with bidirectional long short-term memory and transformer attention network
    Dash, Swaty
    Sahu, Pradip Kumar
    Mishra, Debahuti
    JOURNAL OF THE KOREAN STATISTICAL SOCIETY, 2025,
  • [23] Photovoltaic power forecasting with a long short-term memory autoencoder networks
    Mohammed Sabri
    Mohammed El Hassouni
    Soft Computing, 2023, 27 : 10533 - 10553
  • [24] Fault Prediction for Solar Array Based on Long Short-Term Memory and Autoencoder
    Xue, Qi
    Cheng, Yuehua
    Jiang, Bin
    Han, Xiaodong
    2021 PROCEEDINGS OF THE 40TH CHINESE CONTROL CONFERENCE (CCC), 2021, : 4567 - 4572
  • [25] Accurate estimation of tidal level using bidirectional long short-term memory recurrent neural network
    Bai, Long-Hu
    Xu, Hang
    OCEAN ENGINEERING, 2021, 235
  • [26] A Bayesian adversarial probsparse Transformer model for long-term remaining useful life prediction
    Cheng, Yongbo
    Qv, Junheng
    Feng, Ke
    Han, Te
    RELIABILITY ENGINEERING & SYSTEM SAFETY, 2024, 248
  • [27] Remaining useful life prediction techniques for electric valves based on convolution auto encoder and long short term memory
    Wang, Hang
    Peng, Min-jun
    Miao, Zhuang
    Liu, Yong-kuo
    Ayodeji, Abiodun
    Hao, Chengming
    ISA TRANSACTIONS, 2021, 108 : 333 - 342
  • [28] Remaining useful life estimation of bearing using spatio-temporal convolutional transformer
    Zhu, De
    Lyu, Junwen
    Gao, Qingwei
    Lu, Yixiang
    Zhao, Dawei
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2024, 35 (04)
  • [29] Convolutional Transformer: An Enhanced Attention Mechanism Architecture for Remaining Useful Life Estimation of Bearings
    Ding, Yifei
    Jia, Minping
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [30] Long-Term Prediction of Remaining Useful Life for Industrial IoT
    Awaisi, Kamran Sattar
    Ye, Qiang
    Sampalli, Srinivas
    IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 4170 - 4175