A feature fusion enhanced multiscale CNN with attention mechanism for spot-welding surface appearance recognition

被引:44
作者
Xiao, Meng [1 ]
Yang, Bo [1 ]
Wang, Shilong [1 ]
Zhang, Zhengping [2 ]
Tang, Xiaoli [2 ]
Kang, Ling [1 ]
机构
[1] Chongqing Univ, State Key Lab Mech Transmiss, 174 Shazheng St, Chongqing 400044, Peoples R China
[2] Chongqing Sokon Ind Grp Stock Co Ltd, Chongqing 400033, Peoples R China
关键词
Resistance spot welding; Surface appearance recognition; Attention mechanism; Multiscale convolution; Feature fusion; RESISTANCE; CLASSIFICATION;
D O I
10.1016/j.compind.2021.103583
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
As the most important welding method in the welding process of automobile body-in-whites, resistance spot welding still relies on manual inspection of appearance quality to eliminate unqualified products, which leads to a low detection efficiency and a high error rate. In response to this problem, the modular design method is adopted in this paper and a multiscale convolution assemble block is proposed firstly, which can effectively distinguish the differences in similar welding spots. Then a dual-use attention block is designed to calibrate the spatial and channel information of welding spot feature maps, so that the model can pay more attention to the valid welding spot features. Several such multiscale blocks with attention mechanism are stacked to generate the main body of the convolutional neural network (CNN) for welding spot appearance recognition. Finally, the de-pooling and feature fusion strategies are used to further improve the computational efficiency and precision, and the model is named AcmNet. The results of classification experiments demonstrated that the proposed strategies are efficient and the accuracy of AcmNet is 95.2%, which is higher than the existing models and very suitable for the body-in-white production lines.
引用
收藏
页数:11
相关论文
共 38 条
[1]   Determination of residual stress in resistance spot-welded joint by a novel X-ray diffraction [J].
Ao, Sansan ;
Li, Chunjie ;
Huang, Yifei ;
Luo, Zhen .
MEASUREMENT, 2020, 161
[2]   Resistance spot welding particularities of the nickel alloy Nimonic 80 A [J].
Burca, Lucian ;
Mitelea, Ion ;
Utu, Ion Dragos ;
Burca, Mircea .
MATERIALS TODAY-PROCEEDINGS, 2021, 45 :4122-4127
[3]   A robust weakly supervised learning of deep Conv-Nets for surface defect inspection [J].
Chen, Haiyong ;
Hu, Qidi ;
Zhai, Baoshuo ;
Chen, He ;
Liu, Kun .
NEURAL COMPUTING & APPLICATIONS, 2020, 32 (15) :11229-11244
[4]   Prediction of the Weld Qualities Using Surface Appearance Image in Resistance Spot Welding [J].
Choi, Sang-Gyu ;
Hwang, Insung ;
Kim, Young-Min ;
Kang, Bongyong ;
Kang, Munjin .
METALS, 2019, 9 (08)
[5]  
Chollet F., 2016, IEEE C COMP VISION P, V2017, P1800, DOI [DOI 10.1109/CVPR.2017.195, 10.1109/CVPR.2017.195]
[6]   Ensemble of convolutional neural networks based on an evolutionary algorithm applied to an industrial welding process [J].
Cruz, Yarens J. ;
Rivas, Marcelino ;
Quiza, Ramon ;
Villalonga, Alberto ;
Haber, Rodolfo E. ;
Beruvides, Gerardo .
COMPUTERS IN INDUSTRY, 2021, 133
[7]   Deep learning assisted vision inspection of resistance spot welds [J].
Dai, Wei ;
Li, Dayong ;
Tang, Ding ;
Jiang, Qin ;
Wang, Dong ;
Wang, Huamiao ;
Peng, Yinghong .
JOURNAL OF MANUFACTURING PROCESSES, 2021, 62 :262-274
[8]   ACNet: Strengthening the Kernel Skeletons for Powerful CNN via Asymmetric Convolution Blocks [J].
Ding, Xiaohan ;
Guo, Yuchen ;
Ding, Guiguang ;
Han, Jungong .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :1911-1920
[9]   A deep-learning-based approach for fast and robust steel surface defects classification [J].
Fu, Guizhong ;
Sun, Peize ;
Zhu, Wenbin ;
Yang, Jiangxin ;
Cao, Yanlong ;
Yang, Michael Ying ;
Cao, Yanpeng .
OPTICS AND LASERS IN ENGINEERING, 2019, 121 :397-405
[10]   Resistance Welding Spot Defect Detection with Convolutional Neural Networks [J].
Guo, Zhiye ;
Ye, Shaofeng ;
Wang, Yiju ;
Lin, Chun .
COMPUTER VISION SYSTEMS, ICVS 2017, 2017, 10528 :169-174