Transformer-based meta learning method for bearing fault identification under multiple small sample conditions

被引:41
作者
Li, Xianze [1 ]
Su, Hao [1 ]
Xiang, Ling [1 ]
Yao, Qingtao [1 ]
Hu, Aijun [1 ]
机构
[1] North China Elect Power Univ, Hebei Key Lab Elect Machinery Hlth Maintenance & F, Baoding 071003, Peoples R China
基金
中国国家自然科学基金;
关键词
Fault identification; Bearing; Vision transformer (ViT); Meta-learning (ML); Ensemble learning; AUTOENCODER;
D O I
10.1016/j.ymssp.2023.110967
中图分类号
TH [机械、仪表工业];
学科分类号
0802 ;
摘要
Most fault identification methods based on deep learning rely on a large amount of data, and their effects are limited in the actual production environment. In the case of multiple classification, limited data and complex working conditions, the bearing fault identification is very difficult. In this paper, a novel method called ensemble transformer meta-learning (ETML) is proposed for bearing fault identification with few samples. Based on the base-learner of vision transformer (ViT) and the meta-learner of model-agnostic meta-learning (MAML), a novel transformer metalearning model is constructed to enhance the extracting feature ability. Finally, the weighted voting of multiple models determines the final result. By meta-training of limited data, the model can obtain excellent initial parameters and identify bearing faults quickly and accurately with fewer samples under varying working conditions. The effectiveness of ETML is verified by two cases of bearing fault identification with a few labeled fault samples.
引用
收藏
页数:19
相关论文
共 41 条
[1]   Self-learning transferable neural network for intelligent fault diagnosis of rotating machinery with unlabeled and imbalanced data [J].
An, Zenghui ;
Jiang, Xingxing ;
Cao, Jing ;
Yang, Rui ;
Li, Xuegang .
KNOWLEDGE-BASED SYSTEMS, 2021, 230
[2]   Fractional Fourier and time domain recurrence plot fusion combining convolutional neural network for bearing fault diagnosis under variable working conditions [J].
Bai, Ruxue ;
Meng, Zong ;
Xu, Quansheng ;
Fan, Fengjie .
RELIABILITY ENGINEERING & SYSTEM SAFETY, 2023, 232
[3]   Semantics-driven attentive few-shot learning over clean and noisy samples [J].
Baran, Orhun Bugra ;
Cinbis, Ramazan Gokberk .
NEUROCOMPUTING, 2022, 513 :59-69
[4]   Unsupervised domain-share CNN for machine fault transfer diagnosis from steady speeds to time-varying speeds [J].
Cao, Hongru ;
Shao, Haidong ;
Zhong, Xiang ;
Deng, Qianwang ;
Yang, Xingkai ;
Xuan, Jianping .
JOURNAL OF MANUFACTURING SYSTEMS, 2022, 62 :186-198
[5]   A review on data-driven fault severity assessment in rolling bearings [J].
Cerrada, Mariela ;
Sanchez, Rene-Vinicio ;
Li, Chuan ;
Pacheco, Fannia ;
Cabrera, Diego ;
de Oliveira, Jose Valente ;
Vasquez, Rafael E. .
MECHANICAL SYSTEMS AND SIGNAL PROCESSING, 2018, 99 :169-196
[6]   Deep transfer learning for rolling bearing fault diagnosis under variable operating conditions [J].
Che, Changchang ;
Wang, Huawei ;
Fu, Qiang ;
Ni, Xiaomei .
ADVANCES IN MECHANICAL ENGINEERING, 2019, 11 (12)
[7]  
Dosovitskiy A., 2021, INT C LEARNING REPRE
[8]   Meta-learning as a promising approach for few-shot cross-domain fault diagnosis: Algorithms, applications, and prospects [J].
Feng, Yong ;
Chen, Jinglong ;
Xie, Jingsong ;
Zhang, Tianci ;
Lv, Haixin ;
Pan, Tongyang .
KNOWLEDGE-BASED SYSTEMS, 2022, 235
[9]   Semi-supervised meta-learning networks with squeeze-and-excitation attention for few-shot fault diagnosis [J].
Feng, Yong ;
Chen, Jinglong ;
Zhang, Tianci ;
He, Shuilong ;
Xu, Enyong ;
Zhou, Zitong .
ISA TRANSACTIONS, 2022, 120 :383-401
[10]   Ensemble deep learning: A review [J].
Ganaie, M. A. ;
Hu, Minghui ;
Malik, A. K. ;
Tanveer, M. ;
Suganthan, P. N. .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2022, 115