Meta-Learning With Adaptive Learning Rates for Few-Shot Fault Diagnosis

被引:38
作者
Chang, Liang [1 ]
Lin, Yan-Hui [1 ]
机构
[1] Beihang Univ, Sch Reliabil & Syst Engn, Beijing 100191, Peoples R China
基金
中国国家自然科学基金;
关键词
Adaptive learning rate; fault diagnosis; few-shot learning; meta-learning; overfitting and underfitting problems; NEURAL-NETWORK;
D O I
10.1109/TMECH.2022.3192122
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Deep learning-based methods have been developed and widely used for fault diagnosis, which rely on the sufficient data. However, fault data are extremely limited in some real-case scenarios. In this article, a meta-learning with adaptive learning rates (MLALR) method is proposed for few-shot fault diagnosis. MLALR learns from auxiliary tasks to find initialization parameters of the model that can adapt to target tasks with a few data. The keys of MLALR are the proposed adaptive learning rates for meta-training and fine-tuning, whose values are adjusted according to the distributions of extracted features to tackle the two common problems of few-shot learning, i.e., overfitting and underfitting. The loss functions are further improved to promote the model generalization capability and training stability. The effectiveness of the proposed method is validated using two bearing datasets. MLALR obtains higher accuracies and stabilities than the baseline methods and three other state-of-the-art methods.
引用
收藏
页码:5948 / 5958
页数:11
相关论文
共 35 条
[21]  
Sun R., ARXIV191208957, V2019
[22]  
van der Maaten L, 2008, J MACH LEARN RES, V9, P2579
[23]  
Vinyals Oriol, MATCHING NETWORKS ON
[24]   Metric-based meta-learning model for few-shot fault diagnosis under multiple limited data conditions [J].
Wang, Duo ;
Zhang, Ming ;
Xu, Yuchun ;
Lu, Weining ;
Yang, Jun ;
Zhang, Tao .
MECHANICAL SYSTEMS AND SIGNAL PROCESSING, 2021, 155
[25]   Convolutional Neural Network With Automatic Learning Rate Scheduler for Fault Classification [J].
Wen, Long ;
Gao, Liang ;
Li, Xinyu ;
Zeng, Bing .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
[26]   A New Reinforcement Learning Based Learning Rate Scheduler for Convolutional Neural Network in Fault Classification [J].
Wen, Long ;
Li, Xinyu ;
Gao, Liang .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2021, 68 (12) :12890-12900
[27]   A new ensemble convolutional neural network with diversity regularization for fault diagnosis [J].
Wen, Long ;
Xie, Xiaotong ;
Li, Xinyu ;
Gao, Liang .
JOURNAL OF MANUFACTURING SYSTEMS, 2022, 62 :964-971
[28]   Few-shot transfer learning for intelligent fault diagnosis of machine [J].
Wu, Jingyao ;
Zhao, Zhibin ;
Sun, Chuang ;
Yan, Ruqiang ;
Chen, Xuefeng .
MEASUREMENT, 2020, 166 (166)
[29]   Adaptive Knowledge Transfer by Continual Weighted Updating of Filter Kernels for Few-Shot Fault Diagnosis of Machines [J].
Xing, Saibo ;
Lei, Yaguo ;
Yang, Bin ;
Lu, Na .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2022, 69 (02) :1968-1976
[30]   An intelligent fault diagnosis approach based on transfer learning from laboratory bearings to locomotive bearings [J].
Yang, Bin ;
Lei, Yaguo ;
Jia, Feng ;
Xing, Saibo .
MECHANICAL SYSTEMS AND SIGNAL PROCESSING, 2019, 122 :692-706