A Semi-supervised Gaussian Mixture Variational Autoencoder method for few-shot fine-grained fault diagnosis

被引:11
作者
Zhao, Zhiqian [1 ]
Xu, Yeyin [1 ,2 ]
Zhang, Jiabin
Zhao, Runchao [1 ]
Chen, Zhaobo [1 ]
Jiao, Yinghou [1 ]
机构
[1] Harbin Inst Technol, Sch Mechatron Engn, Harbin 150000, Heilongjiang, Peoples R China
[2] Xi An Jiao Tong Univ, Sch Sci, Xian 710049, Shaanxi, Peoples R China
关键词
Fault diagnosis; Semi-supervised; Gaussian Mixture; Variational Autoencoder; Fine-grained; Few-shot;
D O I
10.1016/j.neunet.2024.106482
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In practical engineering, obtaining labeled high-quality fault samples poses challenges. Conventional fault diagnosis methods based on deep learning struggle to discern the underlying causes of mechanical faults from a fine-grained perspective, due to the scarcity of annotated data. To tackle those issue, we propose a novel semi-supervised Gaussian Mixed Variational Autoencoder method, SeGMVAE, aimed at acquiring unsupervised representations that can be transferred across fine-grained fault diagnostic tasks, enabling the identification of previously unseen faults using only the small number of labeled samples. Initially, Gaussian mixtures are introduced as a multimodal prior distribution for the Variational Autoencoder. This distribution is dynamically optimized for each task through an expectation-maximization (EM) algorithm, constructing a latent representation of the bridging task and unlabeled samples. Subsequently, a set variational posterior approach is presented to encode each task sample into the latent space, facilitating meta-learning. Finally, semi-supervised EM integrates the posterior of labeled data by acquiring task-specific parameters for diagnosing unseen faults. Results from two experiments demonstrate that SeGMVAE excels in identifying new fine-grained faults and exhibits outstanding performance in cross-domain fault diagnosis across different machines. Our code is available at https://github.com/zhiqan/SeGMVAE.
引用
收藏
页数:13
相关论文
共 53 条
[1]   From Artificial Intelligence to Explainable Artificial Intelligence in Industry 4.0: A Survey on What, How, and Where [J].
Ahmed, Imran ;
Jeon, Gwanggil ;
Piccialli, Francesco .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2022, 18 (08) :5031-5042
[2]   Generative Adversarial Network Applications in Industry 4.0: A Review [J].
Akar, Chafic Abou ;
Massih, Rachelle Abdel ;
Yaghi, Anthony ;
Khalil, Joe ;
Kamradt, Marc ;
Makhoul, Abdallah .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2024, 132 (06) :2195-2254
[3]   Conceptual and empirical comparison of dimensionality reduction algorithms (PCA, KPCA, LDA, MDS, SVD, LLE, ISOMAP, LE, ICA, t-SNE) [J].
Anowar, Farzana ;
Sadaoui, Samira ;
Selim, Bassant .
COMPUTER SCIENCE REVIEW, 2021, 40
[4]   A Fine-Grained Adversarial Network Method for Cross-Domain Industrial Fault Diagnosis [J].
Chai, Zheng ;
Zhao, Chunhui .
IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2020, 17 (03) :1432-1442
[5]   Deep meta-learning and variational autoencoder for coupling fault diagnosis of rolling bearing under variable working conditions [J].
Che, Changchang ;
Wang, Huawei ;
Lin, Ruiguan ;
Ni, Xiaomei .
PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART C-JOURNAL OF MECHANICAL ENGINEERING SCIENCE, 2022, 236 (17) :9900-9913
[6]  
Chen H, 2023, IEEE T INSTRUM MEAS, V72, DOI [10.1109/TIM.2023.3314821, 10.1109/TIM.2023.3238698]
[7]   Discriminative Mixture Variational Autoencoder for Semisupervised Classification [J].
Chen, Jian ;
Du, Lan ;
Liao, Leiyao .
IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (05) :3032-3046
[8]   Regularizing transformers with deep probabilistic layers [J].
Cobo Aguilera, Aurora ;
Olmos, Pablo M. ;
Artes-Rodriguez, Antonio ;
Perez-Cruz, Fernando .
NEURAL NETWORKS, 2023, 161 :565-574
[9]   Uncertainty-Aware Distillation for Semi-Supervised Few-Shot Class-Incremental Learning [J].
Cui, Yawen ;
Deng, Wanxia ;
Chen, Haoyu ;
Liu, Li .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (10) :14259-14272
[10]   Fault Diagnosis of Machines Using Deep Convolutional Beta-Variational Autoencoder [J].
Dewangan G. ;
Maurya S. .
IEEE Transactions on Artificial Intelligence, 2022, 3 (02) :287-296