Research on a Feature Point Detection Algorithm for Weld Images Based on Deep Learning

被引:1
作者
Kang, Shaopeng [1 ,2 ]
Qiang, Hongbin [1 ,2 ]
Yang, Jing [1 ,2 ]
Liu, Kailei [1 ,2 ]
Qian, Wenbin [1 ,2 ]
Li, Wenpeng [1 ,2 ]
Pan, Yanfei [3 ]
机构
[1] Jiangsu Univ Technol, Sch Mech Engn, Changzhou 213001, Peoples R China
[2] Jiangsu Prov Engn Res Ctr Adv Fluid Power & Equipm, Changzhou 213001, Peoples R China
[3] Jiangsu Yangtze Intelligent Mfg Res Inst Co Ltd, Changzhou 213001, Peoples R China
基金
中国国家自然科学基金;
关键词
seam tracking; visual sensing; deep learning; feature point extraction; SEAM TRACKING; PARTICLE FILTER; VISION;
D O I
10.3390/electronics13204117
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Laser vision seam tracking enhances robotic welding by enabling external information acquisition, thus improving the overall intelligence of the welding process. However, camera images captured during welding often suffer from distortion due to strong noises, including arcs, splashes, and smoke, which adversely affect the accuracy and robustness of feature point detection. To mitigate these issues, we propose a feature point extraction algorithm tailored for weld images, utilizing an improved Deeplabv3+ semantic segmentation network combined with EfficientDet. By replacing Deeplabv3+'s backbone with MobileNetV2, we enhance prediction efficiency. The DenseASPP structure and attention mechanism are implemented to focus on laser stripe edge extraction, resulting in cleaner laser stripe images and minimizing noise interference. Subsequently, EfficientDet extracts feature point positions from these cleaned images. Experimental results demonstrate that, across four typical weld types, the average feature point extraction error is maintained below 1 pixel, with over 99% of errors falling below 3 pixels, indicating both high detection accuracy and reliability.
引用
收藏
页数:20
相关论文
共 28 条
[1]   Robotic welding system for adaptive process control in gas metal arc welding [J].
Biber, A. ;
Sharma, R. ;
Reisgen, U. .
WELDING IN THE WORLD, 2024, 68 (09) :2311-2320
[2]   Multi-model feature aggregation for classification of laser welding images with vision transformer [J].
Din, Nasir Ud ;
Zhang, Li ;
Nawaz, M. Saqib ;
Yang, Yatao .
JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2024, 36 (05)
[3]   Recent developments in computer vision and artificial intelligence aided intelligent robotic welding applications [J].
Eren, Berkay ;
Demir, Mehmet Hakan ;
Mistikoglu, Selcuk .
INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2023, 126 (11-12) :4763-4809
[4]   Seam Feature Point Acquisition Based on Efficient Convolution Operator and Particle Filter in GMAW [J].
Fan, Junfeng ;
Deng, Sai ;
Ma, Yunkai ;
Zhou, Chao ;
Jing, Fengshui ;
Tan, Min .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (02) :1220-1230
[5]   YOLO-Weld: A Modified YOLOv5-Based Weld Feature Detection Network for Extreme Weld Noise [J].
Gao, Ang ;
Fan, Zhuoxuan ;
Li, Anning ;
Le, Qiaoyue ;
Wu, Dongting ;
Du, Fuxin .
SENSORS, 2023, 23 (12)
[6]   Progress, challenges and trends on vision sensing technologies in automatic/intelligent robotic welding: State-of-the-art review [J].
Guo, Qiang ;
Yang, Zi ;
Xu, Jinting ;
Jiang, Yan ;
Wang, Wenbo ;
Liu, Zonglin ;
Zhao, Weisen ;
Sun, Yuwen .
ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING, 2024, 89
[7]   A segmentation network for farmland ridge based on encoder-decoder architecture in combined with strip pooling module and ASPP [J].
Hong, Qingqing ;
Zhu, Yue ;
Liu, Wei ;
Ren, Tianyu ;
Shi, Changrong ;
Lu, Zhixin ;
Yang, Yunqin ;
Deng, Ruiting ;
Qian, Jing ;
Tan, Changwei .
FRONTIERS IN PLANT SCIENCE, 2024, 15
[8]   Weld seam feature point extraction using laser and vision sensor [J].
Johan, Nurul Fatiha ;
Shah, Hairol Nizam Mohd ;
Sulaiman, Marizan ;
Naji, Osamah Abdullah Ahmed Mohammed ;
Arshad, Mohd Ali .
INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2023, 127 (11-12) :5155-5170
[9]  
Ju Jin Byeong, 2016, [Journal of Welding and Joining, 대한용접접합학회지], V34, P59
[10]  
Lee J.P., 2015, Adv. Mater. Res, V1088, P824, DOI [10.4028/www.scientific.net/AMR.1088.824, DOI 10.4028/WWW.SCIENTIFIC.NET/AMR.1088.824]