Industrial data classification using stochastic configuration networks with self-attention learning features

被引:0
作者
Weitao Li
Yali Deng
Meishuang Ding
Dianhui Wang
Wei Sun
Qiyue Li
机构
[1] Hefei University of Technology,Department of Electric Engineering and Automation
[2] Employment and Entrepreneurship Guidance Center,Artificial Intelligence Research Institute
[3] Hefei Gongda Vocational and Technical College,Key Laboratory of Integrated Automation of Process Industry
[4] China University of Mining and Technology,undefined
[5] Northeastern University,undefined
来源
Neural Computing and Applications | 2022年 / 34卷
关键词
Rolling bearing; Self-attention; Stochastic configuration networks; Cognitive computing;
D O I
暂无
中图分类号
学科分类号
摘要
Industrial data contain a lot of noisy information, which cannot be well suppressed in deep learning models. The current industrial data classification models are problematic in terms of feature incompleteness and inadequate self-adaptability, insufficient capacity for approximation of classifier and weak robustness. To this end, this paper proposes an intelligent classification method based on self-attention learning features and stochastic configuration networks (SCNs). This method imitates human cognitive mode to regulate feedback so as to achieve ensemble learning. In particular, firstly, at the feature extraction stage, a fused deep neural network model based on self-attention is constructed. It adopts a self-attention long short-term memory (LSTM) network and self-attention residual network with adaptive hierarchies and extracts the fault global temporal features and local spatial features of the industrial time-series dataset after noise suppression, respectively. Secondly, at the classifier design stage, the fused complete feature vectors are sent to SCNs with universal approximation capability to establish general classification criteria. Then, based on generalized error and entropy theory, the performance indexes for real-time evaluation of credibility of uncertainty classified results are established, and the adaptive adjustment mechanism of self-attention fusion networks for the network hierarchy is built to realize the self-optimization of multi-hierarchy complete features and their classification criteria. Finally, fuzzy integral is used to integrate the classified results of self-attention fusion network models with different hierarchies to improve the robustness of the classification model. Compared with other classification models, the proposed model performs better using rolling bearing fault dataset.
引用
收藏
页码:22047 / 22069
页数:22
相关论文
共 136 条
  • [1] Rai A(2016)A review on signal processing techniques utilized in the fault diagnosis of rolling element bearings Tribol Int 96 289-306
  • [2] Upadhyay SH(2020)Online fault diagnosis method based on transfer convolutional neural networks IEEE Trans Instrum Measure 69 509-520
  • [3] Xu G(2016)A novel intelligent method for mechanical fault diagnosis based on dual-tree complex wavelet packet transform and multiple classifier fusion Neurocomputing 171 837-853
  • [4] Liu M(2021)A fast anomaly diagnosis approach based on modified CNN and multi-sensor data fusion IEEE Trans Ind Electr 35 150-166
  • [5] Jiang Z(2013)Roller element bearing fault diagnosis using singular spectrum analysis Mech Sys Sig Process 47 1060-1069
  • [6] Shen W(2000)Neural-network-based motor rolling bearing fault diagnosis IEEE Trans Ind Electr 20 8316-8327
  • [7] Huang C(2020)Condition monitoring of machines using fused features from EMD-based local energy with DNN IEEE Sens J 109 334-344
  • [8] Qu J(2015)Incipient fault detection and diagnosis based on Kullback-Leibler divergence using principal component analysis: part II Sig Process 764–765 309-313
  • [9] Zhang Z(2015)Incipient faults identification in gearbox by combining kurtogram and independent component analysis Appl Mech Mater 294 269-277
  • [10] Gong T(2006)A roller bearing fault diagnosis method based on EMD energy entropy and ANN J Sound Vibrat 19 243-249