Plate additive, seam-tracking technology based on feature segmentation

被引:5
作者
Lu, Jun [1 ]
Zhang, Jun [1 ]
Luo, Jun [1 ]
Yang, Aodong [1 ]
Han, Jing [1 ]
Zhao, Zhuang [1 ]
机构
[1] Nanjing Univ Sci & Technol, Jiangsu Key Lab Spectral Imaging & Intelligent Sen, Nanjing 210094, Peoples R China
基金
中国博士后科学基金;
关键词
Additive manufacturing; Seam tracking; Feature segmentation; Structured light vision sensor; Welding robot; WELD SEAM; SYSTEM; LIGHT;
D O I
10.1016/j.optlastec.2023.109848
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
This study aims to investigate the automatic welding process in fusion welding and additive manufacturing, and proposes a plate additive, seam-tracking technology based on active vision. However, noise interference, such as arc light and spatter during welding, poses significant challenges to vision-based feature extraction. This paper uses a self-designed line-structured light vision sensor to capture weld images and applies the concept of deep learning feature segmentation for weld information extraction. The Pixel-wise Spatial Pyramid Network (PSPNet) is used as the fundamental framework for feature extraction, allowing for the simultaneous extraction of the centre line of the laser stripe and weld feature points. To address extreme sample imbalance challenges, online hard example mining (OHEM) and Dice Loss are employed as the loss functions. The results demonstrate that the algorithm's extracted feature points exhibit an error of no more than 0.70 mm compared to manually marked feature points in each dimension of the weld pass. Additionally, the average height error is not more than 0.50 mm, and the frame rates surpass 30FPS, meeting the requirements of high precision, stability and real-time performance in additive manufacturing.
引用
收藏
页数:15
相关论文
共 21 条
  • [1] Chang S., 2013, Chemical Enterprise Management, V21, P21
  • [2] Visual seam tracking system for butt weld of thin plate
    Fang, Zaojun
    Xu, De
    Tan, Min
    [J]. INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2010, 49 (5-8) : 519 - 526
  • [3] Seam Tracking Monitoring Based on Adaptive Kalman Filter Embedded Elman Neural Network During High-Power Fiber Laser Welding
    Gao, Xiangdong
    You, Deyong
    Katayama, Seiji
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2012, 59 (11) : 4315 - 4325
  • [4] Autonomous seam acquisition and tracking system for multi-pass welding based on vision sensor
    Gu, W. P.
    Xiong, Z. Y.
    Wan, W.
    [J]. INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2013, 69 (1-4) : 451 - 460
  • [5] Guo Z., 2015, Machine Tool & Hydraulics, V43, P148
  • [6] Weld seam profile extraction using top-down visual attention and fault detection and diagnosis via EWMA for the stable robotic welding process
    He, Yinshui
    Yu, Zhuohua
    Li, Jian
    Ma, Guohong
    [J]. INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2019, 104 (9-12) : 3883 - 3897
  • [7] An automated weld seam tracking system for thick plate using cross mark structured light
    Kiddee, Prasarn
    Fang, Zaojun
    Tan, Min
    [J]. INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2016, 87 (9-12) : 3589 - 3603
  • [8] Liao W., 2015, Science and Technology Overview, V01, P1
  • [9] Fusing machine algorithm with welder intelligence for adaptive welding robots
    Liu, YuKang
    Zhang, YuMing
    [J]. JOURNAL OF MANUFACTURING PROCESSES, 2017, 27 : 18 - 25
  • [10] Lu X., 2018, IEEE Sens. J., P1