Interinstance and Intratemporal Self-Supervised Learning With Few Labeled Data for Fault Diagnosis

被引:39
作者
Hu, Chenye [1 ]
Wu, Jingyao [1 ]
Sun, Chuang [1 ]
Yan, Ruqiang [1 ]
Chen, Xuefeng [1 ]
机构
[1] Xi An Jiao Tong Univ, Sch Mech Engn, Xian 710049, Peoples R China
关键词
Task analysis; Feature extraction; Time series analysis; Data models; Vibrations; Fault diagnosis; Multitasking; few labeled data; multitask; self-supervised learning; semisupervised learning;
D O I
10.1109/TII.2022.3183601
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recent researches on intelligent fault diagnosis algorithms can achieve great progress. However, considering the practical scenarios, the amount of labeled data is insufficient in face of the difficulty of data annotation, which would raise the risk of overfitting and hinder the model from its industrial applications. To address this problem, in this article, we propose an interinstance and intratemporal self-supervised learning framework, where self-supervised learning on massive unlabeled data is integrated with supervised learning on few labeled data to enrich the capacity of learnable data. Specifically, we design a time-amplitude signal augmentation technique and conduct interinstance transform-consistency learning to obtain domain-invariant features. Meanwhile, an intratemporal relation matching task is promoted to improve the temporal discriminability of the model. Moreover, to overcome the single task domination problem in this multitask framework, an uncertainty-based dynamic weighting mechanism is utilized to automatically distribute weight for each task according to its uncertainty, which ensures the stability of multitask optimization. Experiments on open-source and self-designed datasets demonstrate the superiority of the proposed framework over other supervised and semisupervised methods.
引用
收藏
页码:6502 / 6512
页数:11
相关论文
共 51 条
[21]   Dynamic Task Prioritization for Multitask Learning [J].
Guo, Michelle ;
Haque, Albert ;
Huang, De-An ;
Yeung, Serena ;
Li Fei-Fei .
COMPUTER VISION - ECCV 2018, PT XVI, 2018, 11220 :282-299
[22]   Self-supervised Learning for Semi-supervised Time Series Classification [J].
Jawed, Shayan ;
Grabocka, Josif ;
Schmidt-Thieme, Lars .
ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2020, PT I, 2020, 12084 :499-511
[23]   Motor Bearing Fault Diagnosis Using Trace Ratio Linear Discriminant Analysis [J].
Jin, Xiaohang ;
Zhao, Mingbo ;
Chow, Tommy W. S. ;
Pecht, Michael .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2014, 61 (05) :2441-2451
[24]   Momentum Contrast for Unsupervised Visual Representation Learning [J].
He, Kaiming ;
Fan, Haoqi ;
Wu, Yuxin ;
Xie, Saining ;
Girshick, Ross .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :9726-9735
[25]   Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semantics [J].
Kendall, Alex ;
Gal, Yarin ;
Cipolla, Roberto .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :7482-7491
[26]  
Koch G, 2015, Siamese neural networks for one-shot image recognition, V2
[27]  
Laine S, 2017, Arxiv, DOI arXiv:1610.02242
[28]  
Lee D., 2013, PROC WORKSHOP CHALLE, P1
[29]  
Lee D., 2022, arXiv
[30]  
Lee Timothy, 2019, 2019 Conference on Lasers and Electro-Optics Europe & European Quantum Electronics Conference (CLEO/Europe-EQEC), DOI 10.1109/CLEOE-EQEC.2019.8872786