Prediction model optimization of gas turbine remaining useful life based on transfer learning and simultaneous distillation pruning algorithm

被引:7
作者
Zheng, Yu [1 ]
Chen, Liang [1 ]
Bao, Xiangyu [1 ]
Zhao, Fei [1 ]
Zhong, Jingshu [1 ]
Wang, Chenhan [1 ]
机构
[1] Shanghai Jiao Tong Univ, Sch Mech Engn, Shanghai 200240, Peoples R China
基金
中国国家自然科学基金;
关键词
Gas turbine; Remaining useful life prediction; Transfer learning; Model pruning; Knowledge distillation; KNOWLEDGE DISTILLATION;
D O I
10.1016/j.ress.2024.110562
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
For the application of deep learning (DL) models in the field of remaining useful life (RUL) prediction and predictive maintenance (PdM) of complex equipment, the insufficient training data and large model are the two major problems. To address these issues, a model training method based on transfer learning and a simultaneous distillation pruning algorithm were proposed. By introducing prior knowledge, three transfer learning modes are devised to reduce the demand of training data. Additionally, the simultaneous distillation pruning algorithm was devised to make the model lightweight, and an iterative pruning method was adopted to trim the large neural network model. By analyzing the performance of different transfer learning modes, the effectiveness of the proposed method can be demonstrated. The number of model parameters and the performance before and after pruning were compared. The results demonstrated that, without significant alterations to the prediction performance, the proposed model exhibited the capability to markedly reduce the number of model parameters. Based on the proposed methods, the challenges of insufficient data and efficiency encountered by DL models could be effectively addressed.
引用
收藏
页数:12
相关论文
共 35 条
[1]   Aero-engine remaining useful life prediction method with self-adaptive multimodal data fusion and cluster-ensemble transfer regression [J].
Chen, Jiaxian ;
Li, Dongpeng ;
Huang, Ruyi ;
Chen, Zhuyun ;
Li, Weihua .
RELIABILITY ENGINEERING & SYSTEM SAFETY, 2023, 234
[2]   Wasserstein distance based deep adversarial transfer learning for intelligent fault diagnosis with unlabeled or insufficient labeled data [J].
Cheng, Cheng ;
Zhou, Beitong ;
Ma, Guijun ;
Wu, Dongrui ;
Yuan, Ye .
NEUROCOMPUTING, 2020, 409 :35-45
[3]   Transferable convolutional neural network based remaining useful life prediction of bearing under multiple failure behaviors [J].
Cheng, Han ;
Kong, Xianguang ;
Chen, Gaige ;
Wang, Qibin ;
Wang, Rongbo .
MEASUREMENT, 2021, 168
[4]   Development of Lightweight RBF-DRNN and Automated Framework for CNC Tool-Wear Prediction [J].
Chiu, Sheng-Min ;
Chen, Yi-Chung ;
Kuo, Cheng-Ju ;
Hung, Li-Chun ;
Hung, Min-Hsiung ;
Chen, Chao-Chun ;
Lee, Chiang .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
[5]   Remaining useful lifetime prediction via deep domain adaptation [J].
da Costa, Paulo Roberto de Oliveira ;
Akcay, Alp ;
Zhang, Yingqian ;
Kaymak, Uzay .
RELIABILITY ENGINEERING & SYSTEM SAFETY, 2020, 195
[6]   Deep imbalanced domain adaptation for transfer learning fault diagnosis of bearings under multiple working conditions [J].
Ding, Yifei ;
Jia, Minping ;
Zhuang, Jichao ;
Cao, Yudong ;
Zhao, Xiaoli ;
Lee, Chi-Guhn .
RELIABILITY ENGINEERING & SYSTEM SAFETY, 2023, 230
[7]   Residual error based knowledge distillation [J].
Gao, Mengya ;
Wang, Yujun ;
Wan, Liang .
NEUROCOMPUTING, 2021, 433 :154-161
[8]   Remaining useful life estimation for aero-engine with multiple working conditions via an improved generative adversarial network [J].
Ge, Yang ;
Zhang, Fusheng .
JOURNAL OF THE BRAZILIAN SOCIETY OF MECHANICAL SCIENCES AND ENGINEERING, 2022, 44 (05)
[9]   A Deep Transfer Learning Fault Diagnosis Method Based on WGAN and Minimum Singular Value for Non-Homologous Bearing [J].
He, Jun ;
Ouyang, Ming ;
Chen, Zhiwen ;
Chen, Danfeng ;
Liu, Shiya .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
[10]   Learning Filter Pruning Criteria for Deep Convolutional Neural Networks Acceleration [J].
He, Yang ;
Ding, Yuhang ;
Liu, Ping ;
Zhu, Linchao ;
Zhang, Hanwang ;
Yang, Yi .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :2006-2015