Deep residual LSTM with domain-invariance for remaining useful life prediction across domains

被引:86
作者
Fu, Song [1 ]
Zhang, Yongjian [2 ]
Lin, Lin [1 ]
Zhao, Minghang [2 ]
Zhong, Shi-sheng [1 ]
机构
[1] Harbin Inst Technol, Sch Mechatron Engn, Harbin 150000, Heilongjiang, Peoples R China
[2] Harbin Inst Technol Weihai, Sch Ocean Engn, Weihai 264209, Shandong, Peoples R China
关键词
Unsupervised domain adaptation; RUL prediction; Residual connection; LSTM; Domain confusion; FAULT-DIAGNOSIS; NETWORK;
D O I
10.1016/j.ress.2021.108012
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
performance of cross-domain RUL prediction, but only optimizing one single metric (MMD or adversarial mechanism) to reduce the domain discrepancy has limited further improvement. Moreover, learning a set of good features has been a long-standing issue in RUL prediction. To address these issues, an effective UDA method namely deep residual LSTM with Domain-invariance (DIDRLSTM) is investigated to improve the prognostic performance. First, the DRLSTM is designed as the feature extractor to learn high-level features from both source and target domains. The introduction of residual connections allows DRLSTM to add more nonlinear layers to learn the more representative degradation features. Second, two modules are integrated to further reduce the domain discrepancy. One is domain adaptation, which reduces the domain discrepancy by adding MK-MMD constraints to map the features to RHKS. The other is domain confusion, which reduces the domain discrepancy through minimizing the domain discriminative ability of the domain classifier trained under adversarial optimization strategy. Finally, the outstanding performance of DIDRLSTM is validated on C-MAPSS dataset and FEMTO-ST dataset. The experimental results show that the DIDRLSTM outperforms five state-of-the-art UDA methods.
引用
收藏
页数:16
相关论文
共 45 条
[1]   A theory of learning from different domains [J].
Ben-David, Shai ;
Blitzer, John ;
Crammer, Koby ;
Kulesza, Alex ;
Pereira, Fernando ;
Vaughan, Jennifer Wortman .
MACHINE LEARNING, 2010, 79 (1-2) :151-175
[2]   Cross-Domain State-of-Charge Estimation of Li-Ion Batteries Based on Deep Transfer Neural Network With Multiscale Distribution Adaptation [J].
Bian, Chong ;
Yang, Shunkun ;
Miao, Qiang .
IEEE TRANSACTIONS ON TRANSPORTATION ELECTRIFICATION, 2021, 7 (03) :1260-1270
[3]  
Borah B, 2004, PROCEEDINGS OF INTERNATIONAL CONFERENCE ON INTELLIGENT SENSING AND INFORMATION PROCESSING, P92
[4]   A novel temporal convolutional network with residual self-attention mechanism for remaining useful life prediction of rolling bearings [J].
Cao, Yudong ;
Ding, Yifei ;
Jia, Minping ;
Tian, Rushuai .
RELIABILITY ENGINEERING & SYSTEM SAFETY, 2021, 215
[5]   Transfer learning for remaining useful life prediction of multi-conditions bearings based on bidirectional-GRU network [J].
Cao, Yudong ;
Jia, Minping ;
Ding, Peng ;
Ding, Yifei .
MEASUREMENT, 2021, 178
[6]   Transferable convolutional neural network based remaining useful life prediction of bearing under multiple failure behaviors [J].
Cheng, Han ;
Kong, Xianguang ;
Chen, Gaige ;
Wang, Qibin ;
Wang, Rongbo .
MEASUREMENT, 2021, 168
[7]   Remaining useful lifetime prediction via deep domain adaptation [J].
da Costa, Paulo Roberto de Oliveira ;
Akcay, Alp ;
Zhang, Yingqian ;
Kaymak, Uzay .
RELIABILITY ENGINEERING & SYSTEM SAFETY, 2020, 195
[8]   A BiGRU Autoencoder Remaining Useful Life Prediction Scheme With Attention Mechanism and Skip Connection [J].
Duan, Yuhang ;
Li, Honghui ;
He, Mengqi ;
Zhao, Dongdong .
IEEE SENSORS JOURNAL, 2021, 21 (09) :10905-10914
[9]   Transfer learning for remaining useful life prediction based on consensus self-organizing models [J].
Fan, Yuantao ;
Nowaczyk, Slawomir ;
Rognvaldsson, Thorsteinn .
RELIABILITY ENGINEERING & SYSTEM SAFETY, 2020, 203
[10]   Similarity-based meta-learning network with adversarial domain adaptation for cross-domain fault identification [J].
Feng, Yong ;
Chen, Jinglong ;
Yang, Zhuozheng ;
Song, Xiaogang ;
Chang, Yuanhong ;
He, Shuilong ;
Xu, Enyong ;
Zhou, Zitong .
KNOWLEDGE-BASED SYSTEMS, 2021, 217