WeldNet: A deep learning based method for weld seam type identification and initial

被引:18
作者
Ma, Yunkai [1 ]
Fan, Junfeng [1 ]
Zhou, Zhen [1 ,2 ]
Zhao, Sihan [1 ,2 ]
Jing, Fengshui [1 ,2 ]
Tan, Min [1 ,2 ]
机构
[1] Chinese Acad Sci, Inst Automat, 95 Zhongguancun East Rd, Beijing 100190, Peoples R China
[2] Univ Chinese Acad Sci, Sch Artificial Intelligence, 19 A Yuquan Rd, Beijing 100049, Peoples R China
基金
北京市自然科学基金; 中国国家自然科学基金;
关键词
Weld seam type identification; Initial point guidance; Deep learning; Robot welding; Vision sensors; TRACKING; RECOGNITION; SYSTEM; POSITION;
D O I
10.1016/j.eswa.2023.121700
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
To address the limitations associated with the low intelligence of welding robots, a weld seam type identification and initial point guidance method based on deep neural network named WeldNet was proposed. By incorporating channel shuffling and an attention module, the size of the WeldNet model is reduced while preserving high detection accuracy. With the help of the proposed Center-Box annotation method, the optimized WeldNet network can not only automatically identify the type of welding workpieces at a frequency of 66 Hz, but also extract the initial point of the weld seam with an error of less than 1.63 pixels. Based on the principle of "monocular vision dual position shooting", automatic guidance of the initial point of the weld seam is achieved, which greatly improves the intelligence level of welding robots. The experimental results show that the method proposed can accurately identify various types of weld joints such as butt joints, lap joints, and fillet joints with a recognition rate of 99.6%, and the method can also guide the welding torch to align with the initial point of the weld seam with an error of just 0.85 mm.
引用
收藏
页数:15
相关论文
共 34 条
[1]   A study on development of inductive sensor for automatic weld seam tracking [J].
Bae, Kang-Yul ;
Park, Jin-Hyun .
JOURNAL OF MATERIALS PROCESSING TECHNOLOGY, 2006, 176 (1-3) :111-116
[2]   DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs [J].
Chen, Liang-Chieh ;
Papandreou, George ;
Kokkinos, Iasonas ;
Murphy, Kevin ;
Yuille, Alan L. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (04) :834-848
[3]   Universal fillet weld joint recognition and positioning for robot welding using structured light [J].
Chen, Shengfeng ;
Liu, Jian ;
Chen, Bing ;
Suo, Xinyu .
ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING, 2022, 74
[4]   The autonomous detection and guiding of start welding position for arc welding robot [J].
Chen, X. Z. ;
Chen, S. B. .
INDUSTRIAL ROBOT-THE INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH AND APPLICATION, 2010, 37 (01) :70-78
[5]   An Initial Point Alignment and Seam-Tracking System for Narrow Weld [J].
Fan, Junfeng ;
Deng, Sai ;
Jing, Fengshui ;
Zhou, Chou ;
Yang, Lei ;
Long, Teng ;
Tan, Min .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2020, 16 (02) :877-886
[6]   Automatic recognition system of welding seam type based on SVM method [J].
Fan, Junfeng ;
Jing, Fengshui ;
Fang, Zaojun ;
Tan, Min .
INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2017, 92 (1-4) :989-999
[7]   Bead geometry modeling on uneven base metal surface by fuzzy systems for multi-pass welding [J].
Horvath, Csongor Mark ;
Botzheim, Janos ;
Thomessen, Trygve ;
Korondi, Peter .
EXPERT SYSTEMS WITH APPLICATIONS, 2021, 186 (186)
[8]   Prediction of electron beam weld quality from weld bead surface using clustering and support vector regression [J].
Jaypuria, Sanjib ;
Bondada, Venkatasainath ;
Gupta, Santosh Kumar ;
Pratihar, Dilip Kumar ;
Chakrabarti, Debalay ;
Jha, M. N. .
EXPERT SYSTEMS WITH APPLICATIONS, 2023, 211
[9]  
Kiddee P, 2014, 2014 IEEE INTERNATIONAL CONFERENCE ON INFORMATION AND AUTOMATION (ICIA), P513, DOI 10.1109/ICInfA.2014.6932709
[10]   Automatic Welding Seam Tracking and Identification [J].
Li, Xinde ;
Li, Xianghui ;
Ge, Shuzhi Sam ;
Khyam, Mohammad Omar ;
Luo, Chaomin .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2017, 64 (09) :7261-7271