Autonomous seam recognition and feature extraction for multi-pass welding based on laser stripe edge guidance network

被引:36
作者
Wu, Kaixuan [1 ,2 ]
Wang, Tianqi [1 ,2 ]
He, Junjie [1 ,2 ]
Liu, Yang [1 ,2 ]
Jia, Zhenwei [1 ,2 ]
机构
[1] Tianjin Key Lab Adv Mechatron Equipment Technol, Tianjin 300387, Peoples R China
[2] Tiangong Univ, Sch Mech Engn, Tianjin 300387, Peoples R China
基金
中国国家自然科学基金;
关键词
Convolutional neutral network; Multi-pass seam recognition; Feature extraction; Curve fitting; Robotic welding; Laser vision; TRACKING;
D O I
10.1007/s00170-020-06246-1
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, an autonomous seam recognition and feature extraction method for multi-pass welding based on laser stripe edge guidance network is proposed to overcome the interference of strong reflection, spatter, and arc noise in actual welding environment. Firstly, the laser stripe edge guidance network consisting of modified VGGnet, progressive laser stripe feature extraction, non-local laser stripe edge feature extraction, one-to-one guidance module, and multi-feature fusion module is introduced to recognize the laser stripe under heavy arc noises. Afterwards, the gray centroid method is adopted to obtain the thinning laser stripe. Aiming at extracting the position of feature points, the least square method and non-uniform rational B-splines with second derivative are utilized. Finally, experiments and analysis show that our proposed method performs favorable in terms of effectiveness, flexible, accuracy, and robustness, which could meet the actual welding requirements. Besides, the maximum error and maximum root mean square error for feature extraction are 4.7 pixel and 1.78 pixel, respectively.
引用
收藏
页码:2719 / 2731
页数:13
相关论文
共 24 条
[1]   Optimization Methods for Large-Scale Machine Learning [J].
Bottou, Leon ;
Curtis, Frank E. ;
Nocedal, Jorge .
SIAM REVIEW, 2018, 60 (02) :223-311
[2]  
[蔡志勇 CAI Zhiyong], 2008, [中国图象图形学报, Journal of Image and Graphics], V13, P2344
[3]   Strong noise image processing for vision-based seam tracking in robotic gas metal arc welding [J].
Du, Rongqiang ;
Xu, Yanling ;
Hou, Zhen ;
Shu, Jun ;
Chen, Shanben .
INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2019, 101 (5-8) :2135-2149
[4]   Seam tracking based on Kalman filtering of micro-gap weld using magneto-optical image [J].
Gao, Xiangdong ;
Mo, Ling ;
Xiao, Zhenlin ;
Chen, Xiaohui ;
Katayama, Seiji .
INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2016, 83 (1-4) :21-32
[5]   Autonomous seam acquisition and tracking system for multi-pass welding based on vision sensor [J].
Gu, W. P. ;
Xiong, Z. Y. ;
Wan, W. .
INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2013, 69 (1-4) :451-460
[6]   Weld seam profile detection and feature point extraction for multi-pass route planning based on visual attention model [J].
He, Yinshui ;
Xu, Yanling ;
Chen, Yuxi ;
Chen, Huabin ;
Chen, Shanben .
ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING, 2016, 37 :251-261
[7]   Real-time spatial intersecting seam tracking based on laser vision stereo sensor [J].
Jia, Zhenwei ;
Wang, Tianqi ;
He, Junjie ;
Li, Liangyu ;
Wu, Kaixuan .
MEASUREMENT, 2020, 149
[8]   A survey of the recent architectures of deep convolutional neural networks [J].
Khan, Asifullah ;
Sohail, Anabia ;
Zahoora, Umme ;
Qureshi, Aqsa Saeed .
ARTIFICIAL INTELLIGENCE REVIEW, 2020, 53 (08) :5455-5516
[9]   Automatic Welding Seam Tracking and Identification [J].
Li, Xinde ;
Li, Xianghui ;
Ge, Shuzhi Sam ;
Khyam, Mohammad Omar ;
Luo, Chaomin .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2017, 64 (09) :7261-7271
[10]  
Liguo Sheng, 2014, Applied Mechanics and Materials, V644-650, P1459, DOI 10.4028/www.scientific.net/AMM.644-650.1459