Self-supervised domain adaptation for machinery remaining useful life prediction

被引:5
作者
Le Xuan, Quy [1 ]
Munderloh, Marco [1 ]
Ostermann, Joern [1 ]
机构
[1] Leibniz Univ Hannover, Inst Informat Proc, L3S Res Ctr, Appelstr 9A, D-30167 Hannover, Germany
关键词
RUL prediction; Predictive maintenance; Prognostics and health management; Domain adaptation; Self-supervised learning; Siamese neural network;
D O I
10.1016/j.ress.2024.110296
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Remaining useful life (RUL) prediction presents one of the most crucial tasks in modern machinery prognostics and health management systems. As a powerful data-driven solution, deep learning has shown its promising potential in accurately predicting the RUL based on historical condition monitoring data. However, deep learning-based methods typically require the training and test data to be drawn from the same distribution or domain, which is usually not the case in real-world application scenarios. Unsupervised domain adaptation (UDA) methods have been proposed to address this domain shift problem, but most of them focus only on learning domain-invariant feature representations while forcing the prediction error to be low on the source labeled data. Empirical observations have shown that this kind of domain adaptation is insufficient to guarantee good generalization in the target domain. To overcome this limitation, we propose a novel self-supervised domain adaptation (SSDA) framework that additionally incorporates the intrinsic information of the target domain data into the domain adaptation process without the need for its RUL labels. We developed a dual Siamese network-based training pipeline that enables the optimization for the self-supervised task in both the source and target domains to be realized jointly in conjunction with the base UDA objectives. Evaluation results from extensive experiments on the benchmark C-MAPSS dataset of aircraft turbofan engines show the superiority of our proposed framework over other state-of-the-art methods. On average, we achieve an improvement of 20.1% and 51.2% on two different performance metrics.
引用
收藏
页数:16
相关论文
共 68 条
[1]   Optuna: A Next-generation Hyperparameter Optimization Framework [J].
Akiba, Takuya ;
Sano, Shotaro ;
Yanase, Toshihiko ;
Ohta, Takeru ;
Koyama, Masanori .
KDD'19: PROCEEDINGS OF THE 25TH ACM SIGKDD INTERNATIONAL CONFERENCCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2019, :2623-2631
[2]   Self-Supervised Learning for data scarcity in a fatigue damage prognostic problem [J].
Akrim, Anass ;
Gogu, Christian ;
Vingerhoeds, Rob ;
Salaun, Michel .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 120
[3]   A theory of learning from different domains [J].
Ben-David, Shai ;
Blitzer, John ;
Crammer, Koby ;
Kulesza, Alex ;
Pereira, Fernando ;
Vaughan, Jennifer Wortman .
MACHINE LEARNING, 2010, 79 (1-2) :151-175
[4]   Unsupervised Pixel-Level Domain Adaptation with Generative Adversarial Networks [J].
Bousmalis, Konstantinos ;
Silberman, Nathan ;
Dohan, David ;
Erhan, Dumitru ;
Krishnan, Dilip .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :95-104
[5]  
Bromley J., 1993, International Journal of Pattern Recognition and Artificial Intelligence, V7, P669, DOI 10.1142/S0218001493000339
[6]   Transfer learning algorithms for bearing remaining useful life prediction: A comprehensive review from an industrial application perspective [J].
Chen, Jiaxian ;
Huang, Ruyi ;
Chen, Zhuyun ;
Mao, Wentao ;
Li, Weihua .
MECHANICAL SYSTEMS AND SIGNAL PROCESSING, 2023, 193
[7]  
Cortes C, 2011, LECT NOTES ARTIF INT, V6925, P308, DOI 10.1007/978-3-642-24412-4_25
[8]   A review of physics-based models in prognostics: Application to gears and bearings of rotating machinery [J].
Cubillo, Adrian ;
Perinpanayagam, Suresh ;
Esperon-Miguez, Manuel .
ADVANCES IN MECHANICAL ENGINEERING, 2016, 8 (08)
[9]   Remaining useful lifetime prediction via deep domain adaptation [J].
da Costa, Paulo Roberto de Oliveira ;
Akcay, Alp ;
Zhang, Yingqian ;
Kaymak, Uzay .
RELIABILITY ENGINEERING & SYSTEM SAFETY, 2020, 195
[10]   Domain generalization via adversarial out-domain augmentation for remaining useful life prediction of bearings under unseen conditions [J].
Ding, Yifei ;
Jia, Minping ;
Cao, Yudong ;
Ding, Peng ;
Zhao, Xiaoli ;
Lee, Chi-Guhn .
KNOWLEDGE-BASED SYSTEMS, 2023, 261