Improved YOLO-based laser stripe region extraction method for welding robots

被引:0
作者
Song, Limei [1 ,2 ]
Wang, Shuopeng [1 ,3 ]
Li, Yunpeng [1 ,3 ]
Zhang, Qile [1 ,3 ]
Liu, Mengya [1 ,2 ]
机构
[1] Tiangong Univ, Tianjin Key Lab Intelligent Control Elect Equipmen, Tianjin, Peoples R China
[2] Tiangong Univ, Sch Control Sci & Engn, Tianjin, Peoples R China
[3] Tiangong Univ, Sch Artificial Intelligence, Tianjin, Peoples R China
关键词
object detection; structured light; laser stripe extraction; weld seam detection; YOLOv5; SEAM TRACKING;
D O I
10.1117/1.JEI.33.1.013038
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Real-time image processing and regions of interest extraction are crucial in the non-standard welding process guided by structured light vision. However, due to the impact of detection speed, accuracy, and applicability, existing methods are difficult to apply directly. To address these issues, we have screened various improvement methods through experiments and provided a practical lightweight algorithm, YOLO-DGB, based on YOLOv5s, a current mainstream object detection algorithm. The proposed algorithm introduces depthwise separable convolution and Ghost modules into the backbone network to reduce the number of parameters and floating-point operations per second (FLOPs) in the detection process. To meet the accuracy requirements of the detection network, a bottleneck transformer is introduced after the spatial pyramid pooling fast, which improves the detection effect while ensuring a reasonable number of parameters and computation. To address the issue of insufficient datasets, we propose an improved DCGAN network to enhance the collected images. Compared with the original YOLOv5s network, our proposed algorithm reduces the number of parameters and FLOPs by 35.5% and 44.8%, respectively, while increasing the mAP of the model from 96.5% to 98.1%. Experimental results demonstrate that our algorithm can effectively meet the requirements of actual production processes.
引用
收藏
页数:17
相关论文
共 33 条
  • [1] Laser stripe center extraction method base on Hessian matrix improved by stripe width precise calculation
    Bo, Qile
    Hou, Bo
    Miao, Zijian
    Liu, Haibo
    Lu, Xiaohong
    Wang, Yongqing
    [J]. OPTICS AND LASERS IN ENGINEERING, 2024, 172
  • [2] Bochkovskiy A, 2020, Arxiv, DOI [arXiv:2004.10934, DOI 10.48550/ARXIV.2004.10934]
  • [3] A hybrid multiverse optimisation algorithm based on differential evolution and adaptive mutation
    Chen, Lei
    Li, Lvjie
    Kuang, Wenyue
    [J]. JOURNAL OF EXPERIMENTAL & THEORETICAL ARTIFICIAL INTELLIGENCE, 2021, 33 (02) : 239 - 261
  • [4] Automatic weld type classification, tacked spot recognition and weld ROI determination for robotic welding based on modified YOLOv5
    Chen, Shengfeng
    Yang, Dezhi
    Liu, Jian
    Tian, Qi
    Zhou, Feitao
    [J]. ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING, 2023, 81
  • [5] Universal fillet weld joint recognition and positioning for robot welding using structured light
    Chen, Shengfeng
    Liu, Jian
    Chen, Bing
    Suo, Xinyu
    [J]. ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING, 2022, 74
  • [6] Knowledge-based automatic extraction of multi-structured light stripes
    Ding, Chao
    Tang, Liwei
    Cao, Lijun
    Shao, Xinjie
    Wang, Wei
    Deng, Shijie
    [J]. JOURNAL OF REAL-TIME IMAGE PROCESSING, 2020, 17 (04) : 1015 - 1027
  • [7] A weld line detection robot based on structure light for automatic NDT
    Dong, Zhaoxuan
    Mai, Zhiheng
    Yin, Shiqi
    Wang, Jie
    Yuan, Jie
    Fei, Yuenong
    [J]. INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2020, 111 (7-8) : 1831 - 1845
  • [8] Strong noise image processing for vision-based seam tracking in robotic gas metal arc welding
    Du, Rongqiang
    Xu, Yanling
    Hou, Zhen
    Shu, Jun
    Chen, Shanben
    [J]. INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2019, 101 (5-8) : 2135 - 2149
  • [9] Howard AG, 2017, Arxiv, DOI arXiv:1704.04861
  • [10] Goodfellow I., 2014, ADV NEUR IN, V27, P2672, DOI DOI 10.1145/3422622