A modular fault diagnosis method for rolling bearing based on mask kernel and multi-head self-attention mechanism

被引:7
|
作者
Li, Sifan [1 ]
Xu, Yanhe [1 ]
Jiang, Wei [2 ,3 ]
Zhao, Kunjie [1 ]
Liu, Wei [1 ]
机构
[1] Huazhong Univ Sci & Technol, Sch Civil & Hydraul Engn, Wuhan, Peoples R China
[2] Huaiyin Inst Technol, Jiangsu Key Lab Adv Mfg Technol, Huaian, Peoples R China
[3] Huaiyin Inst Technol, Jiangsu Key Lab Adv Mfg Technol, Huaian 223003, Peoples R China
关键词
Modular fault diagnosis; convolution kernel; transformer; imbalanced data;
D O I
10.1177/01423312231188777
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Data-driven methods have been applied in fault diagnosis. However, in practical engineering, workers are more concerned with the real-time health status of bearings. And it is difficult to complete the effective training of diagnostic models with insufficient labeled fault data. Therefore, this paper proposes a modular method based on a mask kernel and multi-head self-attention mechanism for rolling bearing fault diagnosis. First, the proposed method divides the diagnosis into two modules of status detection and fault recognition. The approach of sharing one backbone for both modules simplifies the optimization process. The method combines the translation invariance of the convolution kernel and the mask attention mechanism of the transformer by computing the local self-attention and superimposing the partial local attention by the mask to ensure the integrity of the information. Finally, a zero-shot training method is proposed to embed the query into the model to achieve cross-distribution fault diagnosis of bearings. The experiments on the data sets of Case Western Reserve University and machinery fault simulator are implemented to diagnose the bearings. The results show that the proposed method can obtain higher diagnostic accuracy and computational efficiency than the existing methods and can be valid for scenarios with cross-condition diagnosis or imbalanced samples.
引用
收藏
页码:899 / 912
页数:14
相关论文
共 50 条
  • [31] A dual attention mechanism network with self-attention and frequency channel attention for intelligent diagnosis of multiple rolling bearing fault types
    Zhang, Wenxing
    Yang, Jianhong
    Bo, Xinyu
    Yang, Zhenkai
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2024, 35 (03)
  • [32] Bearing Fault Detection Based on Convolutional Self-Attention Mechanism
    Ye, Ruida
    Wang, Weijie
    Ren, Yuan
    Zhang, Keming
    PROCEEDINGS OF 2020 IEEE 2ND INTERNATIONAL CONFERENCE ON CIVIL AVIATION SAFETY AND INFORMATION TECHNOLOGY (ICCASIT), 2020, : 869 - 873
  • [33] Non-Invasive Load Decomposition Method Based on Multi-Scale TCN and Multi-Head Self-Attention Mechanism
    Zhang, Yan
    Li, Fei
    Xiao, Yang
    Li, Kai
    Xia, Lei
    Tan, Huilei
    INTERNATIONAL JOURNAL OF MULTIPHYSICS, 2024, 18 (03) : 547 - 556
  • [34] Automatic segmentation of golden pomfret based on fusion of multi-head self-attention and channel-attention mechanism
    Yu, Guoyan
    Luo, Yingtong
    Deng, Ruoling
    COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2022, 202
  • [35] Fault diagnosis method based on the multi-head attention focusing on data positional information
    Feng, Xiaoliang
    Zhao, Guang
    Wang, Yi
    Gao, Dijun
    Ding, Han
    MEASUREMENT & CONTROL, 2023, 56 (3-4): : 583 - 595
  • [36] A Speech Recognition Model Building Method Combined Dynamic Convolution and Multi-Head Self-Attention Mechanism
    Liu, Wei
    Sun, Jiaming
    Sun, Yiming
    Chen, Chunyi
    ELECTRONICS, 2022, 11 (10)
  • [37] Multi-Scale CNN based on Attention Mechanism for Rolling Bearing Fault Diagnosis
    Hao, Yijia
    Wang, Huan
    Liu, Zhiliang
    Han, Haoran
    2020 ASIA-PACIFIC INTERNATIONAL SYMPOSIUM ON ADVANCED RELIABILITY AND MAINTENANCE MODELING (APARM), 2020,
  • [38] DMOIT: denoised multi-omics integration approach based on transformer multi-head self-attention mechanism
    Liu, Zhe
    Park, Taesung
    FRONTIERS IN GENETICS, 2024, 15
  • [39] Masked multi-head self-attention for causal speech enhancement
    Nicolson, Aaron
    Paliwal, Kuldip K.
    SPEECH COMMUNICATION, 2020, 125 : 80 - 96
  • [40] Multi-modal multi-head self-attention for medical VQA
    Joshi, Vasudha
    Mitra, Pabitra
    Bose, Supratik
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (14) : 42585 - 42608