Class Imbalanced Fault Diagnosis via Combining K-Means Clustering Algorithm with Generative Adversarial Networks

被引:6
作者
Li, Huifang [1 ]
Fan, Rui [1 ]
Shi, Qisong [1 ]
Du, Zijian [1 ]
机构
[1] Beijing Inst Technol, Sch Automat, 5 Zhongguancun South St, Beijing 100081, Peoples R China
基金
中国国家自然科学基金;
关键词
class imbalance; fault diagnosis; machine learning; deep learning; DEEP NEURAL-NETWORKS; INTELLIGENT DIAGNOSIS; CLASSIFICATION;
D O I
10.20965/jaciii.2021.p0346
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recent advancements in machine learning and communication technologies have enabled new approaches to automated fault diagnosis and detection in industrial systems. Given wide variation in occurrence frequencies of different classes of faults, the class distribution of real-world industrial fault data is usually imbalanced. However, most prior machine learning-based classification methods do not take this imbalance into consideration, and thus tend to be biased toward recognizing the majority classes and result in poor accuracy for minority ones. To solve such problems, we propose a k-means clustering generative adversarial network (KM-GAN)-based fault diagnosis approach able to reduce imbalance in fault data and improve diagnostic accuracy for minority classes. First, we design a new k-means clustering algorithm and GAN-based oversampling method to generate diverse minority-class samples obeying the similar distribution to the original minority data. The k-means clustering algorithm is adopted to divide minority-class samples into k clusters, while a GAN is applied to learn the data distribution of the resulting clusters and generate a given number of minority-class samples as a supplement to the original dataset. Then, we construct a deep neural network (DNN) and deep belief network (DBN)-based heterogeneous ensemble model as a fault classifier to improve generalization, in which DNN and DBN models are trained separately on the resulting dataset, and then the outputs from both are averaged as the final diagnostic result. A series of comparative experiments are conducted to verify the effectiveness of our proposedmethod, and the experimental results show that our method can improve diagnostic accuracy for minority- class samples.
引用
收藏
页码:346 / 355
页数:10
相关论文
共 26 条
  • [11] A novel adversarial learning framework in deep convolutional neural network for intelligent diagnosis of mechanical faults
    Han, Te
    Liu, Chao
    Yang, Wenguang
    Jiang, Dongxiang
    [J]. KNOWLEDGE-BASED SYSTEMS, 2019, 165 : 474 - 487
  • [12] Hartigan J. A., 1979, Applied Statistics, V28, P100, DOI 10.2307/2346830
  • [13] A class imbalance-aware Relief algorithm for the classification of tumors using microarray gene expression data
    He, Yuanyu
    Zhou, Junhai
    Lin, Yaping
    Zhu, Tuanfei
    [J]. COMPUTATIONAL BIOLOGY AND CHEMISTRY, 2019, 80 : 121 - 127
  • [14] A fast learning algorithm for deep belief nets
    Hinton, Geoffrey E.
    Osindero, Simon
    Teh, Yee-Whye
    [J]. NEURAL COMPUTATION, 2006, 18 (07) : 1527 - 1554
  • [15] Nguyen HB, 2020, J ADV COMPUT INTELL, V24, P48
  • [16] Deep neural networks: A promising tool for fault characteristic mining and intelligent diagnosis of rotating machinery with massive data
    Jia, Feng
    Lei, Yaguo
    Lin, Jing
    Zhou, Xin
    Lu, Na
    [J]. MECHANICAL SYSTEMS AND SIGNAL PROCESSING, 2016, 72-73 : 303 - 315
  • [17] Applications of machine learning to machine fault diagnosis: A review and roadmap
    Lei, Yaguo
    Yang, Bin
    Jiang, Xinwei
    Jia, Feng
    Li, Naipeng
    Nandi, Asoke K.
    [J]. MECHANICAL SYSTEMS AND SIGNAL PROCESSING, 2020, 138
  • [18] Intelligent Fault Diagnosis for Large-Scale Rotating Machines Using Binarized Deep Neural Networks and Random Forests
    Li, Huifang
    Hu, Guangzheng
    Li, Jianqiang
    Zhou, Mengchu
    [J]. IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2022, 19 (02) : 1109 - 1119
  • [19] Unsupervised fault diagnosis of rolling bearings using a deep neural network based on generative adversarial networks
    Liu, Han
    Zhou, Jianzhong
    Xu, Yanhe
    Zheng, Yang
    Peng, Xuanlin
    Jiang, Wei
    [J]. NEUROCOMPUTING, 2018, 315 : 412 - 424
  • [20] THE PERCEPTRON - A PROBABILISTIC MODEL FOR INFORMATION-STORAGE AND ORGANIZATION IN THE BRAIN
    ROSENBLATT, F
    [J]. PSYCHOLOGICAL REVIEW, 1958, 65 (06) : 386 - 408