A weld line detection robot based on structure light for automatic NDT

被引:24
作者
Dong, Zhaoxuan [1 ]
Mai, Zhiheng [1 ]
Yin, Shiqi [1 ]
Wang, Jie [1 ]
Yuan, Jie [1 ]
Fei, Yuenong [1 ]
机构
[1] Shenzhen Univ, Shenzhen, Peoples R China
关键词
Structured light sensor; Weld line detection; MobileNet-SSD; VISION SENSOR; TRACKING; SYSTEM;
D O I
10.1007/s00170-020-05964-w
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In automatic non-destructive testing (NDT), weld bead tracking is usually performed outside. However, irregular weld boundaries, unconstrained illumination, and rough metal surfaces can cause noise, which increases the difficulty of seam tracking. In this paper, a method of parallel structured light (PSL) sensing based on deep learning and information fusion is proposed to detect weld lines. First, a camera is used to capture the laser stripe image projected by the PSL on the weld bead. Then, a MobileNet-SSD deep learning model is trained to extract the regions of interest (ROIs) to de-noise the laser stripe image. Finally, the weld line is obtained by fusing information from multiple weld boundaries.
引用
收藏
页码:1831 / 1845
页数:15
相关论文
共 27 条
  • [1] [褚慧慧 Chu Huihui], 2017, [热加工工艺, Hot Working Technology], V46, P206
  • [2] Automated pipe defect detection and categorization using camera/laser-based profiler and artificial neural network
    Duran, O.
    Althoefer, K.
    Senevatne, L. D.
    [J]. IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2007, 4 (01) : 118 - 126
  • [3] Image-Based Visual Seam Tracking System for Fillet Joint
    Fang, Zaojun
    Xu, De
    [J]. 2009 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (ROBIO 2009), VOLS 1-4, 2009, : 1230 - 1235
  • [4] Visual seam tracking system for butt weld of thin plate
    Fang, Zaojun
    Xu, De
    Tan, Min
    [J]. INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2010, 49 (5-8) : 519 - 526
  • [5] Autonomous seam acquisition and tracking system for multi-pass welding based on vision sensor
    Gu, W. P.
    Xiong, Z. Y.
    Wan, W.
    [J]. INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2013, 69 (1-4) : 451 - 460
  • [6] Development of a real-time laser-based machine vision system to monitor and control welding processes
    Huang, Wei
    Kovacevic, Radovan
    [J]. INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2012, 63 (1-4) : 235 - 248
  • [7] A study on a vision sensor system for tracking the I-butt weld joints
    Kim, JW
    Bae, HS
    [J]. JOURNAL OF MECHANICAL SCIENCE AND TECHNOLOGY, 2005, 19 (10) : 1856 - 1863
  • [8] Seam tracking with texture based image processing for laser materials processing
    Kraemer, S.
    Fiedler, W.
    Drenker, A.
    Abels, P.
    [J]. HIGH-POWER LASER MATERIALS PROCESSING: LASERS, BEAM DELIVERY, DIAGNOSTICS, AND APPLICATIONS III, 2014, 8963
  • [9] Li LY, 2007, LECT NOTES CONTR INF, V362, P319
  • [10] Urban mapping using DMSP/OLS stable night-time light: a review
    Li, Xuecao
    Zhou, Yuyu
    [J]. INTERNATIONAL JOURNAL OF REMOTE SENSING, 2017, 38 (21) : 6030 - 6046