A new hyper-parameter optimization method for machine learning in fault classification

被引：0
作者：
Xingchen Ye
Liang Gao
Xinyu Li
Long Wen
机构：
[1] Huazhong University of Science and Technology,The State Key Laboratory of Digital Manufacturing Equipment & Technology
[2] China University of Geosciences,School of Mechanical Engineering and Electronic Information
来源：
Applied Intelligence | 2023年 / 53卷
关键词：
Hyper-parameter optimization; Fault classification; Dimension reduction; Partial dependencies;
D O I：
暂无
中图分类号：
学科分类号：
摘要：
Accurate bearing fault classification is essential for the safe and stable operation of rotating machinery. The success of Machine Learning (ML) in fault classification is mainly dependent on efficient features and the optimal pre-defined hyper-parameters. Various hyper-parameter optimization (HPO) methods have been proposed to tune the ML algorithms’ hyper-parameters in low dimensions but ignore the hyper-parameters of Feature Engineering (FE). The hyper-parameter dimension is high because both FE and the ML algorithm contain many hyper-parameters. This paper proposed a new HPO method for high dimensions based on dimension reduction and partial dependencies. Firstly, the whole hyper-parameter space is separated into two subspaces of FE and the ML algorithm to reduce time consumption. Secondly, the sensitive intervals of hyperparameters can be recognized by partial dependencies due to the nonlinearity of the relationship between the hyperparameters. Then HPO is conducted in intervals to acquire more satisfactory accuracy. The proposed method is verified on three OpenML datasets and the CWRU bearing dataset. The results show that it can automatically construct efficient domain features and outperforms traditional HPO methods and famous ML algorithms. The proposed method is also very time efficient.
引用
收藏
页码：14182 / 14200
页数：18
相关论文
共 147 条
[1]  
Toma RN(2020)Bearing fault diagnosis of induction motors using a genetic algorithm and machine learning classifiers Sensors 20 1884-3331
[2]  
Prosvirin AE(2018)Nonlinear feature selection using Gaussian kernel SVM-RFE for fault diagnosis Appl Intell 48 3306-180
[3]  
Kim JM(2019)An XGBoost-based physical fitness evaluation model using advanced feature selection and Bayesian hyper-parameter optimization for wearable running monitoring Comput Netw 151 166-2439
[4]  
Xue Y(2020)Fault diagnosis of planetary gearbox using multi-criteria feature selection and heterogeneous ensemble learning classification Measurement 173 108654-1105
[5]  
Zhang L(2018)A two-stage feature selection and intelligent fault diagnosis method for rotating machinery using hybrid filter and wrapper method Neurocomputing 275 2426-569
[6]  
Wang B(2019)Data-driven fault diagnosis of satellite power system using fuzzy Bayes risk and SVM Aerosp Sci Technol 84 1092-2337
[7]  
Zhang Z(2017)Combined fault location and classification for power transmission lines fault diagnosis with integrated feature extraction IEEE Trans Ind Electron 65 561-4830
[8]  
Li F(2020)Single-and multi-fault diagnosis using machine learning for variable frequency drive-fed induction motors IEEE Trans Ind Appl 56 2324-12
[9]  
Guo J(2018)Deep PCA based real-time incipient fault detection and diagnosis methodology for electrical drive in high-speed trains IEEE Trans Veh Technol 6 4819-75
[10]  
Yang L(2021)Convolutional neural network with automatic learning rate scheduler for fault diagnosis IEEE Trans Instrum Meas 70 1-818
12345678910