Meta-Learning With Adaptive Learning Rates for Few-Shot Fault Diagnosis

被引:38
作者
Chang, Liang [1 ]
Lin, Yan-Hui [1 ]
机构
[1] Beihang Univ, Sch Reliabil & Syst Engn, Beijing 100191, Peoples R China
基金
中国国家自然科学基金;
关键词
Adaptive learning rate; fault diagnosis; few-shot learning; meta-learning; overfitting and underfitting problems; NEURAL-NETWORK;
D O I
10.1109/TMECH.2022.3192122
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Deep learning-based methods have been developed and widely used for fault diagnosis, which rely on the sufficient data. However, fault data are extremely limited in some real-case scenarios. In this article, a meta-learning with adaptive learning rates (MLALR) method is proposed for few-shot fault diagnosis. MLALR learns from auxiliary tasks to find initialization parameters of the model that can adapt to target tasks with a few data. The keys of MLALR are the proposed adaptive learning rates for meta-training and fine-tuning, whose values are adjusted according to the distributions of extracted features to tackle the two common problems of few-shot learning, i.e., overfitting and underfitting. The loss functions are further improved to promote the model generalization capability and training stability. The effectiveness of the proposed method is validated using two bearing datasets. MLALR obtains higher accuracies and stabilities than the baseline methods and three other state-of-the-art methods.
引用
收藏
页码:5948 / 5958
页数:11
相关论文
共 35 条
[1]  
Antoniou A., 2019, P 9 BALK C INF SOF B, DOI DOI 10.1145/3351556.3351574
[2]  
Bishop C. M., 1995, ICANN '95. International Conference on Artificial Neural Networks. Neuronimes '95 Scientific Conference, P141
[3]   Robust Deep Learning-Based Diagnosis of Mixed Faults in Rotating Machinery [J].
Chen, Siyuan ;
Meng, Yuquan ;
Tang, Haichuan ;
Tian, Yin ;
He, Niao ;
Shao, Chenhui .
IEEE-ASME TRANSACTIONS ON MECHATRONICS, 2020, 25 (05) :2167-2176
[4]  
Finn C, 2017, PR MACH LEARN RES, V70
[5]   Data augmentation in fault diagnosis based on the Wasserstein generative adversarial network with gradient penalty [J].
Gao, Xin ;
Deng, Fang ;
Yue, Xianghu .
NEUROCOMPUTING, 2020, 396 :487-494
[6]  
Gretton A., 2012, PROC 25 INT C NEURAL, V25, P1205
[7]   Task-Sequencing Meta Learning for Intelligent Few-Shot Fault Diagnosis With Limited Data [J].
Hu, Yidan ;
Liu, Ruonan ;
Li, Xianling ;
Chen, Dongyue ;
Hu, Qinghua .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2022, 18 (06) :3894-3904
[8]   An Imbalance Modified Deep Neural Network With Dynamical Incremental Learning for Chemical Fault Diagnosis [J].
Hu, Zhixin ;
Jiang, Peng .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2019, 66 (01) :540-550
[9]  
Kingma DP, 2014, ADV NEUR IN, V27
[10]  
Lessmeier C., 2016, P EUR C PROGN MAN SO