A Semi-supervised Gaussian Mixture Variational Autoencoder method for few-shot fine-grained fault diagnosis

被引:7
|
作者
Zhao, Zhiqian [1 ]
Xu, Yeyin [1 ,2 ]
Zhang, Jiabin
Zhao, Runchao [1 ]
Chen, Zhaobo [1 ]
Jiao, Yinghou [1 ]
机构
[1] Harbin Inst Technol, Sch Mechatron Engn, Harbin 150000, Heilongjiang, Peoples R China
[2] Xi An Jiao Tong Univ, Sch Sci, Xian 710049, Shaanxi, Peoples R China
关键词
Fault diagnosis; Semi-supervised; Gaussian Mixture; Variational Autoencoder; Fine-grained; Few-shot;
D O I
10.1016/j.neunet.2024.106482
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In practical engineering, obtaining labeled high-quality fault samples poses challenges. Conventional fault diagnosis methods based on deep learning struggle to discern the underlying causes of mechanical faults from a fine-grained perspective, due to the scarcity of annotated data. To tackle those issue, we propose a novel semi-supervised Gaussian Mixed Variational Autoencoder method, SeGMVAE, aimed at acquiring unsupervised representations that can be transferred across fine-grained fault diagnostic tasks, enabling the identification of previously unseen faults using only the small number of labeled samples. Initially, Gaussian mixtures are introduced as a multimodal prior distribution for the Variational Autoencoder. This distribution is dynamically optimized for each task through an expectation-maximization (EM) algorithm, constructing a latent representation of the bridging task and unlabeled samples. Subsequently, a set variational posterior approach is presented to encode each task sample into the latent space, facilitating meta-learning. Finally, semi-supervised EM integrates the posterior of labeled data by acquiring task-specific parameters for diagnosing unseen faults. Results from two experiments demonstrate that SeGMVAE excels in identifying new fine-grained faults and exhibits outstanding performance in cross-domain fault diagnosis across different machines. Our code is available at https://github.com/zhiqan/SeGMVAE.
引用
收藏
页数:13
相关论文
共 50 条
  • [21] Few-Shot Fine-Grained Image Classification: A Comprehensive Review
    Ren, Jie
    Li, Changmiao
    An, Yaohui
    Zhang, Weichuan
    Sun, Changming
    AI, 2024, 5 (01) : 405 - 425
  • [22] Structural Subspace Learning for Few-shot Fine-grained Recognition
    Li, Linjia
    Deng, Jin
    Huang, Ying
    Chen, Yanyan
    Luo, Wei
    2024 16TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND COMPUTING, ICMLC 2024, 2024, : 693 - 699
  • [23] Dual Attention Networks for Few-Shot Fine-Grained Recognition
    Xu, Shu-Lin
    Zhang, Faen
    Wei, Xiu-Shen
    Wang, Jianhua
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 2911 - 2919
  • [24] Semi-Identical Twins Variational AutoEncoder for Few-Shot Learning
    Zhang, Yi
    Huang, Sheng
    Peng, Xi
    Yang, Dan
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (07) : 9455 - 9469
  • [25] Few-shot fine-grained classification with Spatial Attentive Comparison
    Ruan, Xiaoqian
    Lin, Guosheng
    Long, Cheng
    Lu, Shengli
    KNOWLEDGE-BASED SYSTEMS, 2021, 218
  • [26] Task Discrepancy Maximization for Fine-grained Few-Shot Classification
    Lee, SuBeen
    Moon, WonJun
    Heo, Jae-Pil
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 5321 - 5330
  • [27] Fine-Grained Prototypes Distillation for Few-Shot Object Detection
    Wang, Zichen
    Yang, Bo
    Yue, Haonan
    Ma, Zhenghao
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 6, 2024, : 5859 - 5866
  • [28] Improving classification with semi-supervised and fine-grained learning
    Lai, Danyu
    Tian, Wei
    Chen, Long
    PATTERN RECOGNITION, 2019, 88 : 547 - 556
  • [29] Few-shot Object Detection as a Semi-supervised Learning Problem
    Bailer, Werner
    Fassold, Hannes
    19TH INTERNATIONAL CONFERENCE ON CONTENT-BASED MULTIMEDIA INDEXING, CBMI 2022, 2022, : 131 - 135
  • [30] An Embarrassingly Simple Approach to Semi-Supervised Few-Shot Learning
    Wei, Xiu-Shen
    Xu, He-Yang
    Zhang, Faen
    Peng, Yuxin
    Zhou, Wei
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,