Automatic Detection and Location of Weld Beads With Deep Convolutional Neural Networks

被引:2
作者
Yang, Lei [1 ]
Fan, Junfeng [2 ]
Liu, Yanhong [1 ]
Li, En [2 ]
Peng, Jinzhu [1 ]
Liang, Zize [2 ]
机构
[1] Zhengzhou Univ, Sch Elect Engn, Zhengzhou 450001, Peoples R China
[2] Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China
基金
中国国家自然科学基金;
关键词
Data augmentation; deep convolutional network model; object location; samples updating; semantic segmentation; weld bead; DEFECT DETECTION; SEAM TRACKING; AL-ALLOY; LASER; SYSTEM;
D O I
10.1109/TIM.2020.3026514
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Welding quality detection is a critical link in modern manufacturing, and the weld bead location is a prerequisite for the high-precision assessment of welding quality. It is generally necessary for weld bead detection to be accomplished in the context of complex industrial environments. However, conventional detection and location methods based on specific detection conditions or prior knowledge lack accuracy and adaptability. To precisely detect and locate the weld beads in real industrial environments, a novel weld bead detection and location algorithm is proposed based on deep convolutional neural networks. Because there is no open data set of weld beads and the samples in real industrial applications are insufficient for effective model training of the deep convolutional neural network, a novel data augmentation method based on a deep semantic segmentation network is proposed to increase the sample diversity and enlarge the data set. Then, a dynamic sample updating strategy is put forward to cover more welding situations. Finally, faced with the weak-feature and weak-texture characteristics of weld beads, a simplified YOLOV3 model is proposed to realize end-to-end weld bead location. Experiments demonstrate that the proposed method could effectively satisfy the robustness and precision requirements for weld bead detection and location combined with a deep semantic segmentation network and simplified YOLOV3 model.
引用
收藏
页数:12
相关论文
共 43 条
  • [1] Online quality inspection using Bayesian classification in powder-bed additive manufacturing from high-resolution visual camera images
    Aminzadeh, Masoumeh
    Kurfess, Thomas R.
    [J]. JOURNAL OF INTELLIGENT MANUFACTURING, 2019, 30 (06) : 2505 - 2523
  • [2] Automated detection of welding defects in pipelines from radiographic images DWDI
    Boaretto, Neury
    Centeno, Tania Mezzadri
    [J]. NDT & E INTERNATIONAL, 2017, 86 : 7 - 13
  • [3] Investigation on Ti6Al4V laser welding using statistical and Taguchi approaches
    Casalino, G
    Curcio, F
    Minutolo, FMC
    [J]. JOURNAL OF MATERIALS PROCESSING TECHNOLOGY, 2005, 167 (2-3) : 422 - 428
  • [4] A feature-based inspection planning system for coordinate measuring machines
    Cho, MW
    Lee, H
    Yoon, GS
    Choi, J
    [J]. INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2005, 26 (9-10) : 1078 - 1087
  • [5] A vision-based system for post-welding quality measurement and defect detection
    Chu, Hui-Hui
    Wang, Zong-Yi
    [J]. INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2016, 86 (9-12) : 3007 - 3014
  • [6] Inspection of weld shape based on the shape from shading
    Du, QY
    Chen, SB
    Lin, T
    [J]. INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2006, 27 (7-8) : 667 - 671
  • [7] A precise seam tracking method for narrow butt seams based on structured light vision sensor
    Fan, Junfeng
    Jing, Fengshui
    Yang, Lei
    Long, Teng
    Tan, Min
    [J]. OPTICS AND LASER TECHNOLOGY, 2019, 109 : 616 - 626
  • [8] A Vision-Based Self-Tuning Fuzzy Controller for Fillet Weld Seam Tracking
    Fang, Zaojun
    Xu, De
    Tan, Min
    [J]. IEEE-ASME TRANSACTIONS ON MECHATRONICS, 2011, 16 (03) : 540 - 550
  • [9] Intelligent laser welding through representation, prediction, and control learning: An architecture with deep neural networks and reinforcement learning
    Guenther, Johannes
    Pilarski, Patrick M.
    Helfrich, Gerhard
    Shen, Hao
    Diepold, Klaus
    [J]. MECHATRONICS, 2016, 34 : 1 - 11
  • [10] Advanced Deep-Learning Techniques for Salient and Category-Specific Object Detection A survey
    Han, Junwei
    Zhang, Dingwen
    Cheng, Gong
    Liu, Nian
    Xu, Dong
    [J]. IEEE SIGNAL PROCESSING MAGAZINE, 2018, 35 (01) : 84 - 100