Majorities help minorities: Hierarchical structure guided transfer learning for few-shot fault recognition

被引:25
作者
Chen, Hao [1 ,2 ]
Liu, Ruonan [1 ]
Xie, Zongxia [1 ]
Hu, Qinghua [1 ]
Dai, Jianhua [3 ]
Zhai, Junhai [2 ]
机构
[1] Tianjin Univ, Coll Intelligence & Comp, Tianjin, Peoples R China
[2] Hebei Univ, Coll Math & Informat Sci, Hebei Key Lab Machine Learning & Computat Intelli, Baoding 071002, Hebei, Peoples R China
[3] Hunan Normal Univ, Hunan Prov Key Lab Intelligent Comp & Language In, Changsha, Peoples R China
基金
中国国家自然科学基金;
关键词
Transfer learning; Fault recognition; Few-shot problem; Hierarchical category structure; Complex systems; DIAGNOSIS; MACHINERY;
D O I
10.1016/j.patcog.2021.108383
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
To ensure the operational safety and reliability, fault recognition of complex systems is becoming an essential process in industrial systems. However, the existing recognition methods mainly focus on common faults with enough data, which ignore that many faults are lack of samples in engineering practice. Transfer learning can be helpful, but irrelevant knowledge transfer can cause performance degradation, especially in complex systems. To address the above problem, a hierarchy guided transfer learning framework (HGTL) is proposed in this paper for fault recognition with few-shot samples. Firstly, we fuse domain knowledge, label semantics and inter-class distance to calculate the affinity between categories, based on which a category hierarchical tree is constructed by hierarchical clustering. Then, guided by the hierarchical structure, the samples in most similar majority classes are selected from the source domain to pre-train the hierarchical feature learning network (HFN) and extract the transferable fault information. For the fault knowledge extracted from the child nodes of one parent node are similar and can be transferred with each other, so the trained HFN can extract better features of few samples classes with the help of the information from similar faults, and used to address few-shot fault recognition problems. Finally, a dataset of a nuclear power system with 65 categories and the widely used Tennessee Eastman dataset are analyzed respectively via the proposed method, as well as state-of-the-art recognition methods for comparison. The experimental results demonstrate the effectiveness and superiority of the proposed method in fault recognition with few-shot problem. (c) 2021 Elsevier Ltd. All rights reserved.
引用
收藏
页数:15
相关论文
共 26 条
  • [1] On automated source selection for transfer learning in convolutional neural networks
    Afridi, Muhammad Jamal
    Ross, Arun
    Shapiro, Erik M.
    [J]. PATTERN RECOGNITION, 2018, 73 : 65 - 75
  • [2] Representation learning using step-based deep multi-modal autoencoders
    Bhatt, Gaurav
    Jha, Piyush
    Raman, Balasubramanian
    [J]. PATTERN RECOGNITION, 2019, 95 : 12 - 23
  • [3] A real-time fault diagnosis methodology of complex systems using object-oriented Bayesian networks
    Cai, Baoping
    Liu, Hanlin
    Xie, Min
    [J]. MECHANICAL SYSTEMS AND SIGNAL PROCESSING, 2016, 80 : 31 - 44
  • [4] On the use of a full stack hardware/software infrastructure for sensor data fusion and fault prediction in industry 4.0
    De Vita, Fabrizio
    Bruneo, Dario
    Das, Sajal K.
    [J]. PATTERN RECOGNITION LETTERS, 2020, 138 : 30 - 37
  • [5] Borrowing Treasures from the Wealthy: Deep Transfer Learning through Selective Joint Fine-Tuning
    Ge, Weifeng
    Yu, Yizhou
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 10 - 19
  • [6] Rich feature hierarchies for accurate object detection and semantic segmentation
    Girshick, Ross
    Donahue, Jeff
    Darrell, Trevor
    Malik, Jitendra
    [J]. 2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, : 580 - 587
  • [7] An adaptive spatiotemporal feature learning approach for fault diagnosis in complex systems
    Han, Te
    Liu, Chao
    Wu, Linjiang
    Sarkar, Soumik
    Jiang, Dongxiang
    [J]. MECHANICAL SYSTEMS AND SIGNAL PROCESSING, 2019, 117 : 170 - 187
  • [8] Short-Term Residential Load Forecasting Based on LSTM Recurrent Neural Network
    Kong, Weicong
    Dong, Zhao Yang
    Jia, Youwei
    Hill, David J.
    Xu, Yan
    Zhang, Yuan
    [J]. IEEE TRANSACTIONS ON SMART GRID, 2019, 10 (01) : 841 - 851
  • [9] Large-Scale Few-Shot Learning: Knowledge Transfer With Class Hierarchy
    Li, Aoxue
    Luo, Tiange
    Lu, Zhiwu
    Xiang, Tao
    Wang, Liwei
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 7205 - 7213
  • [10] A systematic review of deep transfer learning for machinery fault diagnosis
    Li, Chuan
    Zhang, Shaohui
    Qin, Yi
    Estupinan, Edgar
    [J]. NEUROCOMPUTING, 2020, 407 : 121 - 135