Improving Accuracy and Interpretability of CNN-Based Fault Diagnosis through an Attention Mechanism

被引:9
作者
Huang, Yubiao [1 ,2 ,3 ]
Zhang, Jiaqing [1 ,2 ,3 ]
Liu, Rui [1 ,2 ,3 ]
Zhao, Shuangyao [4 ]
机构
[1] Anhui Prov Key Lab Elect Fire & Safety Protect, Hefei 230601, Peoples R China
[2] State Grid Lab Fire Protect Transmiss & Distribut, Hefei 230601, Peoples R China
[3] State Grid Anhui Elect Power Res Inst, Hefei 230601, Peoples R China
[4] Hefei Univ Technol, Sch Management, Hefei 230009, Peoples R China
关键词
fault diagnosis; deep learning; convolutional neural network; prior knowledge; attention mechanism; LEARNING FRAMEWORK; NEURAL-NETWORKS; SVM;
D O I
10.3390/pr11113233
中图分类号
TQ [化学工业];
学科分类号
0817 ;
摘要
This study aims to enhance the accuracy and interpretability of fault diagnosis. To address this objective, we present a novel attention-based CNN method that leverages image-like data generated from multivariate time series using a sliding window processing technique. By representing time series data in an image-like format, the spatiotemporal dependencies inherent in the raw data are effectively captured, which allows CNNs to extract more comprehensive fault features, consequently enhancing the accuracy of fault diagnosis. Moreover, the proposed method incorporates a form of prior knowledge concerning category-attribute correlations into CNNs through the utilization of an attention mechanism. Under the guidance of thisprior knowledge, the proposed method enables the extraction of accurate and predictive features. Importantly, these extracted features are anticipated to retain the interpretability of the prior knowledge. The effectiveness of the proposed method is verified on the Tennessee Eastman chemical process dataset. The results show that proposed method achieved a fault diagnosis accuracy of 98.46%, which is significantly higher than similar existing methods. Furthermore, the robustness of the proposed method is analyzed by sensitivity analysis on hyperparameters, and the interpretability is revealed by visually analyzing its feature extraction process.
引用
收藏
页数:21
相关论文
共 50 条
  • [31] Power Grid Fault Diagnosis Based on SSAE and CNN
    Zhang, Dahai
    Wu, Congzhou
    Gai, Qin
    Bi, Yanqiu
    Zhang, Xiaowei
    PROCEEDINGS OF THE 2021 IEEE 16TH CONFERENCE ON INDUSTRIAL ELECTRONICS AND APPLICATIONS (ICIEA 2021), 2021, : 56 - 61
  • [32] CNN-based Skip-Gram Method for Improving Classification Accuracy of Chinese Text
    Xu, Wenhua
    Huang, Hao
    Zhang, Jie
    Gu, Hao
    Yang, Jie
    Gui, Guan
    KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2019, 13 (12) : 6080 - 6096
  • [33] Fault Diagnosis for Limited Annotation Signals and Strong Noise Based on Interpretable Attention Mechanism
    Chen, Biao
    Liu, Tingting
    He, Chao
    Liu, Zecheng
    Zhang, Li
    IEEE SENSORS JOURNAL, 2022, 22 (12) : 11865 - 11880
  • [34] Intelligent Motor Bearing Fault Diagnosis Using Channel Attention-Based CNN
    Yin, Jianguo
    Cen, Gang
    WORLD ELECTRIC VEHICLE JOURNAL, 2022, 13 (11)
  • [35] Fault classification of rolling bearing based on attention mechanism-inception-CNN Model
    Zhu H.
    Ning Q.
    Lei Y.
    Chen B.
    Yan H.
    Ning, Qian, 1600, Chinese Vibration Engineering Society (39): : 84 - 93
  • [36] Improving pneumonia diagnosis with high-accuracy CNN-Based chest X-ray image classification and integrated gradient
    Rabbah, Jalal
    Ridouani, Mohammed
    Hassouni, Larbi
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2025, 101
  • [37] Adaptive residual CNN-based fault detection and diagnosis system of small modular reactors
    Yao, Yuantao
    Wang, Jianye
    Xie, Min
    APPLIED SOFT COMPUTING, 2022, 114
  • [38] A CNN model based on innovative expansion operation improving the fault diagnosis accuracy of drilling pump fluid end
    Li, Gang
    Hu, Jiayao
    Shan, Daiwei
    Ao, Jiaxing
    Huang, Bangkui
    Huang, Zhiqiang
    MECHANICAL SYSTEMS AND SIGNAL PROCESSING, 2023, 187
  • [39] Bearing Fault Diagnosis Based on Improved DBN Combining Attention Mechanism
    Zhang, Xuefeng
    Geng, Yushui
    Zhao, Jing
    Jiang, Wenfeng
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [40] CNN-based network with multi-scale context feature and attention mechanism for automatic pavement crack segmentation
    Liang, Jia
    Gu, Xingyu
    Jiang, Dong
    Zhang, Qipeng
    AUTOMATION IN CONSTRUCTION, 2024, 164