A Bidirectional Long Short-Term Memory Autoencoder Transformer for Remaining Useful Life Estimation

被引:8
作者
Fan, Zhengyang [1 ]
Li, Wanru [1 ]
Chang, Kuo-Chu [1 ]
机构
[1] George Mason Univ, Dept Syst Engn & Operat Res, Fairfax, VA 22030 USA
关键词
Transformer; self-supervised learning; autoencoder; remaining useful life prediction; bidirectional LSTM; turbofan engine; PREDICTION;
D O I
10.3390/math11244972
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
Estimating the remaining useful life (RUL) of aircraft engines holds a pivotal role in enhancing safety, optimizing operations, and promoting sustainability, thus being a crucial component of modern aviation management. Precise RUL predictions offer valuable insights into an engine's condition, enabling informed decisions regarding maintenance and crew scheduling. In this context, we propose a novel RUL prediction approach in this paper, harnessing the power of bi-directional LSTM and Transformer architectures, known for their success in sequence modeling, such as natural languages. We adopt the encoder part of the full Transformer as the backbone of our framework, integrating it with a self-supervised denoising autoencoder that utilizes bidirectional LSTM for improved feature extraction. Within our framework, a sequence of multivariate time-series sensor measurements serves as the input, initially processed by the bidirectional LSTM autoencoder to extract essential features. Subsequently, these feature values are fed into our Transformer encoder backbone for RUL prediction. Notably, our approach simultaneously trains the autoencoder and Transformer encoder, different from the naive sequential training method. Through a series of numerical experiments carried out on the C-MAPSS datasets, we demonstrate that the efficacy of our proposed models either surpasses or stands on par with that of other existing methods.
引用
收藏
页数:17
相关论文
共 50 条
  • [31] Missing well logs reconstruction based on cascaded bidirectional long short-term memory network
    Zhou, Wei
    Zhao, Haihang
    Li, Xiangchengzhen
    Qi, Zhongli
    Lai, Fuqiang
    Yi, Jun
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 259
  • [32] Intrusion Detection Based on Bidirectional Long Short-Term Memory with Attention Mechanism
    Yang, Yongjie
    Tu, Shanshan
    Ali, Raja Hashim
    Alasmary, Hisham
    Waqas, Muhammad
    Amjad, Muhammad Nouman
    CMC-COMPUTERS MATERIALS & CONTINUA, 2023, 74 (01): : 801 - 815
  • [33] Protein remote homology detection based on bidirectional long short-term memory
    Li, Shumin
    Chen, Junjie
    Liu, Bin
    BMC BIOINFORMATICS, 2017, 18
  • [34] Detection of Abnormal Network Traffic Using Bidirectional Long Short-Term Memory
    Thi Thanh N.N.
    Nguyen Q.H.
    Computer Systems Science and Engineering, 2023, 46 (01): : 491 - 504
  • [35] Dynamic Long Short-Term Memory Neural-Network-Based Indirect Remaining-Useful-Life Prognosis for Satellite Lithium-Ion Battery
    Wang, Cunsong
    Lu, Ningyun
    Wang, Senlin
    Cheng, Yuehua
    Jiang, Bin
    APPLIED SCIENCES-BASEL, 2018, 8 (11):
  • [36] Fault detection in automated production systems based on a long short-term memory autoencoder
    Windmann, Stefan
    Westerhold, Tim
    AT-AUTOMATISIERUNGSTECHNIK, 2024, 72 (01) : 47 - 58
  • [37] Attention-based Bidirectional LSTM-CNN Model for Remaining Useful Life Estimation
    Song, Jou Won
    Park, Ye In
    Hong, Jong-Ju
    Kim, Seong-Gyun
    Kang, Suk-Ju
    2021 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2021,
  • [38] Health condition monitoring of machines based on long short-term memory convolutional autoencoder
    Ye, Zhuang
    Yu, Jianbo
    APPLIED SOFT COMPUTING, 2021, 107
  • [39] Fault Detection and Diagnosis Using Combined Autoencoder and Long Short-Term Memory Network
    Park, Pangun
    Di Marco, Piergiuseppe
    Shin, Hyejeon
    Bang, Junseong
    SENSORS, 2019, 19 (21)
  • [40] Sleep staging by bidirectional long short-term memory convolution neural network
    Chen, Xueyan
    He, Jie
    Wu, Xiaoqiang
    Yan, Wei
    Wei, Wei
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2020, 109 : 188 - 196