Unsupervised deep representation learning for motor fault diagnosis by mutual information maximization

被引:20
|
作者
Xiao, Dengyu [1 ]
Qin, Chengjin [1 ]
Yu, Honggan [1 ]
Huang, Yixiang [1 ]
Liu, Chengliang [1 ]
机构
[1] Shanghai Jiao Tong Univ, State Key Lab Mech Syst & Vibrat, Sch Mech Engn, Shanghai 200240, Peoples R China
基金
中国国家自然科学基金;
关键词
Motor fault diagnosis; Unsupervised deep learning; Deep representations; Mutual information; NEURAL-NETWORK; TRANSMISSION; COEFFICIENTS; DIVERGENCE;
D O I
10.1007/s10845-020-01577-y
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Data-driven deep learning technology has gained many achievements in the field of motor fault diagnosis and prognostics. However, the application objects of those previous studies are commonly limited to the faulty data sharing the similar distribution under unvarying stable working condition. Unfortunately, this limitation is nearly invalid in the real-world scenario, where the working condition is complicated and changes invariably, resulting in the unfavourable situation that the deep representation learning methods of the previous studies always fail in extracting the effective representations for fault diagnosis in real applications. To tackle this issue, inspired by f-divergence estimation, this work takes a different route and proposes an unsupervised deep representation learning approach, named Deep Mutual Information Maximization (DMIM), using variational divergence estimation approach to maximize mutual information (MI) between the input and output of a deep neural network. Meanwhile the representation distribution is automatically tuned by matching to a prior distribution with the same philosophy of Variational Autoencoder. Opposite to previous works which learn representations basically with supervised feedback regulation or unsupervised reconstruction, the proposed unsupervised MI maximization framework aims to make representational characteristics like independence play a bigger role to capture the most unique representations. To verify the effectiveness of our proposal, faulty motor data from the motor tests under European driving cycle for simulating the real working scenario, are collected for validation. It turns out that DMIM outperforms many popular unsupervised and fully-supervised learning methods. It opens new avenues for unsupervised learning of representations for motor fault diagnosis.
引用
收藏
页码:377 / 391
页数:15
相关论文
共 50 条
  • [1] Unsupervised deep representation learning for motor fault diagnosis by mutual information maximization
    Dengyu Xiao
    Chengjin Qin
    Honggan Yu
    Yixiang Huang
    Chengliang Liu
    Journal of Intelligent Manufacturing, 2021, 32 : 377 - 391
  • [2] Fault Diagnosis Algorithm Based on Mutual Information and Deep Learning
    Shen Yang
    Zhu Lin
    Guo Jian
    Zhou Chuan
    Chen Qingwei
    Cheng Yong
    2022 34TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2022, : 546 - 551
  • [3] Online continual learning through unsupervised mutual information maximization
    Hihn, Heinke
    Braun, Daniel A.
    NEUROCOMPUTING, 2024, 578
  • [4] Online continual learning through unsupervised mutual information maximization
    Hihn, Heinke
    Braun, Daniel A.
    Neurocomputing, 2024, 578
  • [5] Graph Representation Learning via Graphical Mutual Information Maximization
    Peng, Zhen
    Huang, Wenbing
    Luo, Minnan
    Zheng, Qinghua
    Rong, Yu
    Xu, Tingyang
    Huang, Junzhou
    WEB CONFERENCE 2020: PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE (WWW 2020), 2020, : 259 - 270
  • [6] Multimodal Representation Learning via Maximization of Local Mutual Information
    Liao, Ruizhi
    Moyer, Daniel
    Cha, Miriam
    Quigley, Keegan
    Berkowitz, Seth
    Horng, Steven
    Golland, Polina
    Wells, William M.
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT II, 2021, 12902 : 273 - 283
  • [7] Mutual Information for Unsupervised Deep Learning Image Registration
    de Vos, Bob D.
    van der Velden, Bas
    Sander, Jorg
    Gilhuijs, Kenneth
    Staring, Marius
    Isgum, Ivana
    MEDICAL IMAGING 2020: IMAGE PROCESSING, 2021, 11313
  • [8] Learning Deep Generative Clustering via Mutual Information Maximization
    Yang, Xiaojiang
    Yan, Junchi
    Cheng, Yu
    Zhang, Yizhe
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (09) : 6263 - 6275
  • [9] BipNRL: Mutual Information Maximization on Bipartite Graphs for Node Representation Learning
    Poduval, Pranav
    Oberoi, Gaurav
    Verma, Sangam
    Agarwal, Ayush
    Singh, Karamjit
    Asthana, Siddhartha
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES: RESEARCH TRACK, ECML PKDD 2023, PT IV, 2023, 14172 : 728 - 743
  • [10] Learning graph representation by aggregating subgraphs via mutual information maximization
    Liu, Ziwen
    Wang, Chenguang
    Han, Congying
    Guo, Tiande
    NEUROCOMPUTING, 2023, 548