Interinstance and Intratemporal Self-Supervised Learning With Few Labeled Data for Fault Diagnosis

被引:39
作者
Hu, Chenye [1 ]
Wu, Jingyao [1 ]
Sun, Chuang [1 ]
Yan, Ruqiang [1 ]
Chen, Xuefeng [1 ]
机构
[1] Xi An Jiao Tong Univ, Sch Mech Engn, Xian 710049, Peoples R China
关键词
Task analysis; Feature extraction; Time series analysis; Data models; Vibrations; Fault diagnosis; Multitasking; few labeled data; multitask; self-supervised learning; semisupervised learning;
D O I
10.1109/TII.2022.3183601
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recent researches on intelligent fault diagnosis algorithms can achieve great progress. However, considering the practical scenarios, the amount of labeled data is insufficient in face of the difficulty of data annotation, which would raise the risk of overfitting and hinder the model from its industrial applications. To address this problem, in this article, we propose an interinstance and intratemporal self-supervised learning framework, where self-supervised learning on massive unlabeled data is integrated with supervised learning on few labeled data to enrich the capacity of learnable data. Specifically, we design a time-amplitude signal augmentation technique and conduct interinstance transform-consistency learning to obtain domain-invariant features. Meanwhile, an intratemporal relation matching task is promoted to improve the temporal discriminability of the model. Moreover, to overcome the single task domination problem in this multitask framework, an uncertainty-based dynamic weighting mechanism is utilized to automatically distribute weight for each task according to its uncertainty, which ensures the stability of multitask optimization. Experiments on open-source and self-designed datasets demonstrate the superiority of the proposed framework over other supervised and semisupervised methods.
引用
收藏
页码:6502 / 6512
页数:11
相关论文
共 51 条
[1]   Uncovering the structure of clinical EEG signals with self-supervised learning [J].
Banville, Hubert ;
Chehab, Omar ;
Hyvarinen, Aapo ;
Engemann, Denis-Alexander ;
Gramfort, Alexandre .
JOURNAL OF NEURAL ENGINEERING, 2021, 18 (04)
[2]   Deep Clustering for Unsupervised Learning of Visual Features [J].
Caron, Mathilde ;
Bojanowski, Piotr ;
Joulin, Armand ;
Douze, Matthijs .
COMPUTER VISION - ECCV 2018, PT XIV, 2018, 11218 :139-156
[3]   A Semisupervised Recurrent Convolutional Attention Model for Human Activity Recognition [J].
Chen, Kaixuan ;
Yao, Lina ;
Zhang, Dalin ;
Wang, Xianzhi ;
Chang, Xiaojun ;
Nie, Feiping .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2020, 31 (05) :1747-1756
[4]  
Chen T, 2020, PR MACH LEARN RES, V119
[5]  
Chen Z, 2018, PR MACH LEARN RES, V80
[6]   Implementation of a Fault-Diagnosis Algorithm for Induction Machines Based on Advanced Digital-Signal-Processing Techniques [J].
Choi, Seungdeog ;
Akin, Bilal ;
Rahimian, Mina M. ;
Toliyat, Hamid A. .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2011, 58 (03) :937-948
[7]  
Cui ZC, 2016, Arxiv, DOI arXiv:1603.06995
[8]   Using Deep Learning-Based Approach to Predict Remaining Useful Life of Rotating Components [J].
Deutsch, Jason ;
He, David .
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2018, 48 (01) :11-20
[9]  
Devlin J, 2019, Arxiv, DOI [arXiv:1810.04805, 10.48550/arxiv.1810.04805]
[10]   Unsupervised Visual Representation Learning by Context Prediction [J].
Doersch, Carl ;
Gupta, Abhinav ;
Efros, Alexei A. .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :1422-1430