Interpreting network knowledge with attention mechanism for bearing fault diagnosis

被引:130
作者
Yang, Zhi-bo [1 ,2 ]
Zhang, Jun-peng [1 ,2 ]
Zhao, Zhi-bin [1 ,2 ]
Zhai, Zhi [1 ,2 ]
Chen, Xue-feng [1 ,2 ]
机构
[1] Xi An Jiao Tong Univ, Sch Mech Engn, Xian 710049, Shaanxi, Peoples R China
[2] Xi An Jiao Tong Univ, State Key Lab Mfg Syst Engn, Xian 710049, Shaanxi, Peoples R China
基金
中国国家自然科学基金;
关键词
Interpretability; Bearing fault diagnosis; Attention mechanism; CONVOLUTIONAL NEURAL-NETWORK; SYSTEM; CNN;
D O I
10.1016/j.asoc.2020.106829
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Condition monitoring and fault diagnosis of bearings play important roles in production safety and limiting the cost of maintenance on a reasonable level. Nowadays, artificial intelligence and machine learning make fault diagnosis gradually become intelligent, and data-driven intelligent algorithms are receiving more and more attention. However, many methods use the existing deep learning models directly for the analysis of mechanical vibration signals, which is still lack of interpretability to researchers. In this paper, a method based on multilayer bidirectional gated recurrent units with attention mechanism is proposed to access the interpretability of neural networks in fault diagnosis, which combines the convolution neural network, gated recurrent unit, and the attention mechanism. Based on the attention mechanism, the attention distribution of input segments is visualized and thus the interpretability of neural networks can be further presented. Experimental validations and comparisons are conducted on bearings. The results present that the proposed model is effective for localizing the discriminative information from the input data, which provides a tool for better understanding the feature extraction process in neural networks, especially for mechanical vibration signals. (C) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页数:15
相关论文
共 50 条
[41]   A Fault Diagnosis Method of Rotor System Based on Parallel Convolutional Neural Network Architecture with Attention Mechanism [J].
Zhao, Zhiqian ;
Jiao, Yinghou ;
Zhang, Xiang .
JOURNAL OF SIGNAL PROCESSING SYSTEMS FOR SIGNAL IMAGE AND VIDEO TECHNOLOGY, 2023, 95 (08) :965-977
[42]   An ensemble deep learning network based on 2D convolutional neural network and 1D LSTM with self-attention for bearing fault diagnosis [J].
Wang, Liying ;
Zhao, Weiguo .
APPLIED SOFT COMPUTING, 2025, 172
[43]   Understanding and improving deep learning-based rolling bearing fault diagnosis with attention mechanism [J].
Li, Xiang ;
Zhang, Wei ;
Ding, Qian .
SIGNAL PROCESSING, 2019, 161 :136-154
[44]   Transfer-learning-based bearing fault diagnosis between different machines: A multi-level adaptation network based on layered decoding and attention mechanism [J].
Wan, Shaoke ;
Liu, Jinyu ;
Li, Xiaohu ;
Zhang, Yanfei ;
Yan, Ke ;
Hong, Jun .
MEASUREMENT, 2022, 203
[45]   A review on convolutional neural network in rolling bearing fault diagnosis [J].
Li, Xin ;
Ma, Zengqiang ;
Yuan, Zonghao ;
Mu, Tianming ;
Du, Guoxin ;
Liang, Yan ;
Liu, Jingwen .
MEASUREMENT SCIENCE AND TECHNOLOGY, 2024, 35 (07)
[46]   Fault Diagnosis for Limited Annotation Signals and Strong Noise Based on Interpretable Attention Mechanism [J].
Chen, Biao ;
Liu, Tingting ;
He, Chao ;
Liu, Zecheng ;
Zhang, Li .
IEEE SENSORS JOURNAL, 2022, 22 (12) :11865-11880
[47]   A bearing fault diagnosis model with enhanced feature extraction based on the Kolmogorov-Arnold representation Theorem and an attention mechanism [J].
Jin, Hao ;
Li, Xueyi ;
Yu, Jun ;
Wang, Tianyang ;
Yun, Qingwen .
APPLIED ACOUSTICS, 2025, 240
[48]   Multiscale convolutional conditional domain adversarial network with channel attention for unsupervised bearing fault diagnosis [J].
Wang, Haomiao ;
Li, Yibin ;
Jiang, Mingshun ;
Zhang, Faye .
PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART I-JOURNAL OF SYSTEMS AND CONTROL ENGINEERING, 2024, 238 (06) :1123-1134
[49]   Bearing fault diagnosis based on double-connected attention residual network and information fusion [J].
Zhang H. ;
Yu Q. ;
Qin C. ;
Wang R. ;
Zhang Y. .
Zhendong yu Chongji/Journal of Vibration and Shock, 2023, 42 (20) :114-123
[50]   Bearing Fault Diagnosis Based on Shallow Multi-Scale Convolutional Neural Network with Attention [J].
Huang, Tengda ;
Fu, Sheng ;
Feng, Haonan ;
Kuang, Jiafeng .
ENERGIES, 2019, 12 (20)