Real-time defect identification of narrow overlap welds and application based on convolutional neural networks

被引:68
作者
Miao, Rui [1 ,2 ]
Shan, Zhangtuo [3 ]
Zhou, Qingye [4 ]
Wu, Yizhou [3 ]
Ge, Liang [3 ]
Zhang, Jie [5 ]
Hu, Hao [1 ]
机构
[1] Shanghai Jiao Tong Univ, Sch Naval Architecture Ocean & Civil Engn, Shanghai 200240, Peoples R China
[2] Shanghai Jiao Tong Univ, State Key Lab Ocean Engn, Shanghai 200240, Peoples R China
[3] Shanghai Jiao Tong Univ, Sch Mech Engn, Shanghai 200240, Peoples R China
[4] Shanghai Jiao Tong Univ, SJTU Paris Tech Elite Inst Technol, Shanghai 200240, Peoples R China
[5] Donghua Univ, Inst Artificial Intelligence, Shanghai 201620, Peoples R China
基金
中国国家自然科学基金;
关键词
Narrow overlap weld; Defect detection; Convolutional neural network; Eddy current; 3D laser scanning; DAMAGE DETECTION; FAULT-DIAGNOSIS; DEEP;
D O I
10.1016/j.jmsy.2021.01.012
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
To improve the quality of narrow overlap welds and reduce cost during the high-strength production, it is essential to detect weld defects promptly by identification of the type of defects to provide solution accordingly. This paper proposes an integrated weld defect identification approach combing eddy current detection with 3D laser scanning based on Convolutional Neural Networks (CNN). The detection principle and equipment of the two detection methods are introduced. To fit the training process of CNN, two set of detection signals are preprocessed: a two-dimensional time-frequency diagram for eddy current signals using continuous wavelet transform and for laser images, weld edges are extracted and divided by region using image convolution and combining with integral graph. CNN model VGG16 is trained afterwards with data collected from one local manufacturer in Shanghai. It is discovered that performance of eddy current and laser image identification on different types of weld defects is different, and the accuracy can be increased with the two methods combined. Last, to achieve real-time detection of narrow overlap welding, a two-stage defect recognition model is built which greatly improves the efficiency of weld defect identification without affecting the accuracy of weld defect identification.
引用
收藏
页码:800 / 810
页数:11
相关论文
共 30 条
[1]   Automated detection of welding defects in pipelines from radiographic images DWDI [J].
Boaretto, Neury ;
Centeno, Tania Mezzadri .
NDT & E INTERNATIONAL, 2017, 86 :7-13
[2]   Autonomous Structural Visual Inspection Using Region-Based Deep Learning for Detecting Multiple Damage Types [J].
Cha, Young-Jin ;
Choi, Wooram ;
Suh, Gahyun ;
Mahmoudkhani, Sadegh ;
Buyukozturk, Oral .
COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2018, 33 (09) :731-747
[3]   Deep Learning-Based Crack Damage Detection Using Convolutional Neural Networks [J].
Cha, Young-Jin ;
Choi, Wooram ;
Buyukozturk, Oral .
COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2017, 32 (05) :361-378
[4]   Assessing the Efficacy of Restricting Access to Barbecue Charcoal for Suicide Prevention in Taiwan: A Community-Based Intervention Trial [J].
Chen, Ying-Yeh ;
Chen, Feng ;
Chang, Shu-Sen ;
Wong, Jacky ;
Yip, Paul S. F. .
PLOS ONE, 2015, 10 (08)
[5]  
Chen ZQ, 2015, J VIBROENG, V17, P2379
[6]   A vision-based system for post-welding quality measurement and defect detection [J].
Chu, Hui-Hui ;
Wang, Zong-Yi .
INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2016, 86 (9-12) :3007-3014
[7]   Efficient feature selection for neural network based detection of flaws in steel welded joints using ultrasound testing [J].
Cruz, F. C. ;
Simas Filho, E. F. ;
Albuquerque, M. C. S. ;
Silva, I. C. ;
Farias, C. T. T. ;
Gouvea, L. L. .
ULTRASONICS, 2017, 73 :1-8
[8]  
Donahue J, 2015, PROC CVPR IEEE, P2625, DOI 10.1109/CVPR.2015.7298878
[9]   Eddy current detection of subsurface defects for additive/subtractive hybrid manufacturing [J].
Du, Wei ;
Bai, Qian ;
Wang, Yibo ;
Zhang, Bi .
INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2018, 95 (9-12) :3185-3195
[10]   Machining vibration states monitoring based on image representation using convolutional neural networks [J].
Fu, Yang ;
Zhang, Yun ;
Gao, Yuan ;
Gao, Huang ;
Mao, Ting ;
Zhou, Huamin ;
Li, Dequn .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2017, 65 :240-251