Weld seam profile detection and feature point extraction for multi-pass route planning based on visual attention model

被引:85
作者
He, Yinshui [1 ,2 ]
Xu, Yanling [1 ]
Chen, Yuxi [1 ]
Chen, Huabin [1 ]
Chen, Shanben [1 ]
机构
[1] Shanghai Jiao Tong Univ, Sch Mat Sci & Engn, Shanghai 200240, Peoples R China
[2] Nanchang Univ, Sch Environm & Chem Engn, Nanchang 330031, Peoples R China
基金
中国国家自然科学基金;
关键词
Visual attention; Robotic welding; Weld seam detection; Multi-pass route planning; Weld seam feature extraction; SALIENT OBJECT DETECTION; TRACKING; VISION; FUSION; GTAW;
D O I
10.1016/j.rcim.2015.04.005
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Automatic multi-pass route planning is one of key technologies for thick plate in robotic metal active gas (MAG) arc welding. In this research, a scheme for the extracting feature points of the weld seam profile to implement automatic multi-pass route planning, and guidance of the initial welding position in each layer during MAG arc welding, is presented. It consists of two steps: first a vision sensor based on structured light is employed to capture laser stripes and molten pools simultaneously within the same frame, and the laser stripe, forming the weld seam profile is detected by a visual attention model based on saliency. Then a methodology of polynomial fitting plus derivatives for feature point extraction of the weld seam profile is suggested. With respect to the effectiveness of highlighting the laser stripe, the proposed model is much better than the classic ones in this field, whereas the feature point extraction methodology in this paper outperforms typical template matching. Finally, the performance of the proposed scheme is demonstrated on different weld seam images captured in different layers and different welding experiments. (C) 2015 Elsevier Ltd. All rights reserved.
引用
收藏
页码:251 / 261
页数:11
相关论文
共 30 条
[1]  
Bingül Z, 2000, IEEE T IND APPL, V36, P1523, DOI 10.1109/28.887202
[2]  
[蔡志勇 CAI Zhiyong], 2008, [中国图象图形学报, Journal of Image and Graphics], V13, P2344
[3]   A study on application of multi-sensor information fusion in pulsed GTAW [J].
Chen, Bo ;
Wang, Jifeng ;
Chen, Shanben .
INDUSTRIAL ROBOT-THE INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH AND APPLICATION, 2010, 37 (02) :168-176
[4]  
Chen S. B., 2009, INTELLIGENTIZED TECH, V29
[5]   Detection of weld pool width using infrared imaging during high-power fiber laser welding of type 304 austenitic stainless steel [J].
Chen, Ziqin ;
Gao, Xiangdong .
INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2014, 74 (9-12) :1247-1254
[6]   Autonomous weld seam identification and localisation using eye-in-hand stereo vision for robotic arc welding [J].
Dinham, Mitchell ;
Fang, Gu .
ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING, 2013, 29 (05) :288-301
[7]  
Drews P., 1994, WELD WORLD, V34, P1
[8]   Visual sensing and penetration control in aluminum alloy pulsed GTA welding [J].
Fan, Chongjian ;
Lv, Fenglin ;
Chen, Shanben .
INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2009, 42 (1-2) :126-137
[9]   A Vision-Based Self-Tuning Fuzzy Controller for Fillet Weld Seam Tracking [J].
Fang, Zaojun ;
Xu, De ;
Tan, Min .
IEEE-ASME TRANSACTIONS ON MECHATRONICS, 2011, 16 (03) :540-550
[10]   Low-Cost System for Weld Tracking Based on Artificial Vision [J].
Fernandez Villan, Alberto ;
Garcia Acevedo, Rodrigo ;
Alvarez Alvarez, Eduardo ;
Campos Lopez, Antonio ;
Garcia, Daniel F. ;
Usamentiaga Fernandez, Ruben ;
Jimenez Meana, Marco ;
Garcia Sanchez, Jose Manuel .
IEEE TRANSACTIONS ON INDUSTRY APPLICATIONS, 2011, 47 (03) :1159-1167