Ensemble of convolutional neural networks based on an evolutionary algorithm applied to an industrial welding process

被引:30
作者
Cruz, Yarens J. [1 ,2 ]
Rivas, Marcelino [1 ]
Quiza, Ramon [1 ]
Villalonga, Alberto [2 ]
Haber, Rodolfo E. [2 ]
Beruvides, Gerardo [3 ]
机构
[1] Univ Matanzas, Ctr Estudios Fabricac Avanzada & Sostenible, Matanzas 40100, Cuba
[2] CSIC Univ Politecn Madrid, Ctr Automat & Robot, Madrid 28500, Spain
[3] Hitachi Europe Ltd, Social Innovat Business, D-40547 Hitachi, Germany
基金
欧盟地平线“2020”;
关键词
Image classification; Ensemble of models; Convolutional neural networks; Evolutionary parameters; GENETIC ALGORITHM; COMMITTEE; SELECTION; FEATURES; SYSTEM;
D O I
10.1016/j.compind.2021.103530
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
This paper presents an approach for image classification based on an ensemble of convolutional neural networks and the application to a real case study of an industrial welding process. The ensemble consists of five convolutional neural networks, whose outputs are combined through a voting policy. In order to select appropriate network parameters (i.e., the number of convolutional layers and layers hyperparameters) and voting policy, an efficient search process was carried out by using an evolutionary algorithm. The proposed method is applied and validated in a case study focused on detecting misalignment of metal sheets to be joined through submerged arc welding process. After selecting the most convenient setup, the ensemble outperforms other seven strategies considered in a comparison in several metrics, while maintaining an adequate computational cost. (c) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页数:9
相关论文
共 67 条
[1]   A Framework for Designing the Architectures of Deep Convolutional Neural Networks [J].
Albelwi, Saleh ;
Mahmood, Ausif .
ENTROPY, 2017, 19 (06)
[2]   A neural network-based model for the prediction of cutting force in milling process. A progress study on a real case. [J].
Alique, A ;
Haber, RE ;
Haber, RH ;
Ros, S ;
Gonzalez, C .
PROCEEDINGS OF THE 2000 IEEE INTERNATIONAL SYMPOSIUM ON INTELLIGENT CONTROL, 2000, :121-125
[3]   Weighted Random Search for CNN Hyperparameter Optimization [J].
Andonie, R. ;
Florea, A. C. .
INTERNATIONAL JOURNAL OF COMPUTERS COMMUNICATIONS & CONTROL, 2020, 15 (02)
[4]   Hyperparameter optimization in learning systems [J].
Andonie, Razvan .
JOURNAL OF MEMBRANE COMPUTING, 2019, 1 (04) :279-291
[5]   Automated defect classification of SS304 TIG welding process using visible spectrum camera and machine learning [J].
Bacioiu, Daniel ;
Melton, Geoff ;
Papaelias, Mayorkinos ;
Shaw, Rob .
NDT & E INTERNATIONAL, 2019, 107
[6]   Hybridizing Evolutionary Computation and Deep Neural Networks: An Approach to Handwriting Recognition Using Committees and Transfer Learning [J].
Baldominos, Alejandro ;
Saez, Yago ;
Isasi, Pedro .
COMPLEXITY, 2019, 2019
[7]   Evolutionary Design of Convolutional Neural Networks for Human Activity Recognition in Sensor-Rich Environments [J].
Baldominos, Alejandro ;
Saez, Yago ;
Isasi, Pedro .
SENSORS, 2018, 18 (04)
[8]   A supervised hierarchical segmentation of remote-sensing images using a committee of multi-scale convolutional neural networks [J].
Basaeed, Essa ;
Bhaskar, Harish ;
Hill, Paul ;
Al-Mualla, Mohammed ;
Bull, David .
INTERNATIONAL JOURNAL OF REMOTE SENSING, 2016, 37 (07) :1671-1691
[9]  
Bergstra J, 2012, J MACH LEARN RES, V13, P281
[10]   Coping with Complexity When Predicting Surface Roughness in Milling Processes: Hybrid Incremental Model with Optimal Parametrization [J].
Beruvides, Gerardo ;
Castano, Fernando ;
Haber, Rodolfo E. ;
Quiza, Ramon ;
Villalonga, Alberto .
COMPLEXITY, 2017,