A modular fault diagnosis method for rolling bearing based on mask kernel and multi-head self-attention mechanism

被引:7
|
作者
Li, Sifan [1 ]
Xu, Yanhe [1 ]
Jiang, Wei [2 ,3 ]
Zhao, Kunjie [1 ]
Liu, Wei [1 ]
机构
[1] Huazhong Univ Sci & Technol, Sch Civil & Hydraul Engn, Wuhan, Peoples R China
[2] Huaiyin Inst Technol, Jiangsu Key Lab Adv Mfg Technol, Huaian, Peoples R China
[3] Huaiyin Inst Technol, Jiangsu Key Lab Adv Mfg Technol, Huaian 223003, Peoples R China
关键词
Modular fault diagnosis; convolution kernel; transformer; imbalanced data;
D O I
10.1177/01423312231188777
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Data-driven methods have been applied in fault diagnosis. However, in practical engineering, workers are more concerned with the real-time health status of bearings. And it is difficult to complete the effective training of diagnostic models with insufficient labeled fault data. Therefore, this paper proposes a modular method based on a mask kernel and multi-head self-attention mechanism for rolling bearing fault diagnosis. First, the proposed method divides the diagnosis into two modules of status detection and fault recognition. The approach of sharing one backbone for both modules simplifies the optimization process. The method combines the translation invariance of the convolution kernel and the mask attention mechanism of the transformer by computing the local self-attention and superimposing the partial local attention by the mask to ensure the integrity of the information. Finally, a zero-shot training method is proposed to embed the query into the model to achieve cross-distribution fault diagnosis of bearings. The experiments on the data sets of Case Western Reserve University and machinery fault simulator are implemented to diagnose the bearings. The results show that the proposed method can obtain higher diagnostic accuracy and computational efficiency than the existing methods and can be valid for scenarios with cross-condition diagnosis or imbalanced samples.
引用
收藏
页码:899 / 912
页数:14
相关论文
共 50 条
  • [21] MARNet: Multi-head attention residual network for rolling bearing fault diagnosis under noisy condition
    Deng, Linfeng
    Wang, Guojun
    Zhao, Cheng
    Zhang, Yuanwen
    PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART C-JOURNAL OF MECHANICAL ENGINEERING SCIENCE, 2024, 238 (19) : 9726 - 9747
  • [22] Multi-label Text Classification Based on BiGRU and Multi-Head Self-Attention Mechanism
    Luo, Tongtong
    Shi, Nan
    Jin, Meilin
    Qin, Aolong
    Tang, Jiacheng
    Wang, Xihan
    Gao, Quanli
    Shao, Lianhe
    2024 3RD INTERNATIONAL CONFERENCE ON IMAGE PROCESSING AND MEDIA COMPUTING, ICIPMC 2024, 2024, : 204 - 210
  • [23] Intelligent Bearing Fault Diagnosis Using Multi-Head Attention-Based CNN
    Wang, Hui
    Xu, Jiawen
    Yan, Ruqiang
    Sun, Chuang
    Chen, Xuefeng
    PROCEEDINGS OF THE 8TH INTERNATIONAL CONFERENCE ON THROUGH-LIFE ENGINEERING SERVICES (TESCONF 2019), 2020, 49 : 112 - 118
  • [24] PMMS: Predicting essential miRNAs based on multi-head self-attention mechanism and sequences
    Yan, Cheng
    Ding, Changsong
    Duan, Guihua
    FRONTIERS IN MEDICINE, 2022, 9
  • [25] Fault diagnosis of photovoltaic array based on gated residual network with multi-head self attention mechanism
    Belgacem, Ahmed M. E. S. A., I
    Hadef, Mounir
    Djerdir, Abdesslem
    TURKISH JOURNAL OF ELECTRICAL ENGINEERING AND COMPUTER SCIENCES, 2024, 32 (06) : 806 - 828
  • [26] A Point Cloud Classification Method and Its Applications Based on Multi-Head Self-Attention
    Liu, Xue-Jun
    Wang, Wen-Hui
    Yan, Yong
    Cui, Zhong-Ji
    Sha, Yun
    Jiang, Yi-Nan
    Journal of Computers (Taiwan), 2023, 34 (04) : 163 - 173
  • [27] Fault diagnosis of rolling bearing based on multi-scale and attention mechanism
    Ding, Xue
    Deng, Aidong
    Li, Jing
    Deng, Minqiang
    Xu, Shuo
    Shi, Yaowei
    Dongnan Daxue Xuebao (Ziran Kexue Ban)/Journal of Southeast University (Natural Science Edition), 2022, 52 (01): : 172 - 178
  • [28] A TCN-BiGRU Density Logging Curve Reconstruction Method Based on Multi-Head Self-Attention Mechanism
    Liao, Wenlong
    Gao, Chuqiao
    Fang, Jiadi
    Zhao, Bin
    Zhang, Zhihu
    PROCESSES, 2024, 12 (08)
  • [29] Neural News Recommendation with Multi-Head Self-Attention
    Wu, Chuhan
    Wu, Fangzhao
    Ge, Suyu
    Qi, Tao
    Huang, Yongfeng
    Xie, Xing
    2019 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING AND THE 9TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (EMNLP-IJCNLP 2019): PROCEEDINGS OF THE CONFERENCE, 2019, : 6389 - 6394
  • [30] SQL Injection Detection Based on Lightweight Multi-Head Self-Attention
    Lo, Rui-Teng
    Hwang, Wen-Jyi
    Tai, Tsung-Ming
    APPLIED SCIENCES-BASEL, 2025, 15 (02):