3D complex curve seam tracking using industrial robot based on CAD model and computer vision

被引:2
作者
Le Duc Hanh [1 ,3 ]
Le Duc Dao [2 ,3 ]
Nguyen Cong Luan [1 ,3 ]
机构
[1] Ho Chi Minh City Univ Technol HCMUT, Dept Mechatron, Falculty Mech Engn, 268 Ly Thuong Kiet St,Dist 10, Ho Chi Minh City, Vietnam
[2] Ho Chi Minh City Univ Technol HCMUT, Dept Ind Syst Engn, Falculty Mech Engn, 268 Ly Thuong Kiet St,Dist 10, Ho Chi Minh City, Vietnam
[3] Vietnam Natl Univ, Linh Trung Ward, Ho Chi Minh City, Vietnam
来源
INTERNATIONAL JOURNAL OF INTERACTIVE DESIGN AND MANUFACTURING - IJIDEM | 2023年 / 17卷 / 03期
关键词
3D curve tracking; Industrial robot; 3D CAD matching; Point cloud; Computer vision; EXTRACTION;
D O I
10.1007/s12008-022-01043-4
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
(Abstract) 3D complex curve seam tracking using industrial robots applied in fields that affect human health such as welding, gluing, spraying, painting, etc. However, at present, manual performance by workers or teaching manipulators by using teach-pendant to recognize the planning trajectories curves, especially for 3D complex seam curves which often has complex shape, direction, small width are still the two main approaches. Through these two implementation methods, productivity is low and product quality is not uniform. So this study will present a practical method to overcome the above disadvantages by using a low-cost camera combining an image processing algorithm using a 3D CAD model and a pre-defined 3D curve profile that needs to be attached to that model to extract the contour on the object. This data is then transmitted to the industrial manipulator to perform the task of tracing the planned 3D complex curve. By using this method, the small width 3D complex curve is easily tracked and the system is not complicated. Moreover, the profile to be tracked can be modified easily and quickly by non-expert users with basic knowledge about CAD drawing and image processing. Through the result of the experiments, small error system and fast image processing time about 1.8 mm and 0.5 s respectively, the system proved that it meets the requirement of the production line and it can replace the worker. The system is also easy to maintain and setup.
引用
收藏
页码:1039 / 1046
页数:8
相关论文
共 50 条
  • [21] A computer vision based method for 3D posture estimation of symmetrical lifting
    Mehrizi, Rahil
    Peng, Xi
    Xu, Xu
    Zhang, Shaoting
    Metaxas, Dimitris
    Li, Kang
    JOURNAL OF BIOMECHANICS, 2018, 69 : 40 - 46
  • [22] 3D visual monitoring system of industrial robot based on digital twin
    Du Y.
    Luo Y.
    Peng Y.
    Liu X.
    Wu J.
    Jisuanji Jicheng Zhizao Xitong/Computer Integrated Manufacturing Systems, CIMS, 2023, 29 (06): : 2130 - 2138
  • [23] 3D Model-based estimation for UAV tracking
    Santos, Nuno Pessanha
    Lobo, Victor
    Bernardino, Alexandre
    OCEANS 2018 MTS/IEEE CHARLESTON, 2018,
  • [24] Deep learning based computer vision under the prism of 3D point clouds: a systematic review
    Tychola, Kyriaki A.
    Vrochidou, Eleni
    Papakostas, George A.
    VISUAL COMPUTER, 2024, 40 (11) : 8287 - 8329
  • [25] Robust Vision-Based Hand Tracking Using Single Camera for Ubiquitous 3D Gesture Interaction
    Rodriguez, Sergio
    Picon, Artzai
    Villodas, Aritz
    IEEE SYMPOSIUM ON 3D USER INTERFACES (3DUI 2010), 2010, : 135 - 136
  • [26] Computer Vision-Based Real-Time 3D Gesture Recognition Using Depth Image
    Heickal, Hasnain
    Zhang, Tao
    Hasanuzzaman, Md
    INTERNATIONAL JOURNAL OF IMAGE AND GRAPHICS, 2015, 15 (01)
  • [27] Methodology on robot-based complex surface processing using 2D and 3D visual combination
    Wu, Haodong
    Zou, Ting
    Burke, Heather
    King, Stephen
    Burke, Brian
    2024 WRC SYMPOSIUM ON ADVANCED ROBOTICS AND AUTOMATION, WRC SARA, 2024, : 113 - 120
  • [28] 3D computer vision based on machine learning with deep neural networks: A review
    Vodrahalli, Kailas
    Bhowmik, Achintya K.
    JOURNAL OF THE SOCIETY FOR INFORMATION DISPLAY, 2017, 25 (11) : 676 - 694
  • [29] 3D reconstruction algorithm of weld pool surface based on computer vision technology
    Mu, Zhen-Hai
    Open Petroleum Engineering Journal, 2015, 8 (01) : 434 - 439
  • [30] Drilling errors compensation of industrial robot based on 3D passive scale tracker
    Lou, Zhifeng
    Zhou, Jingjie
    Zhang, Jiyun
    Yunliang, E.
    Li, Weifeng
    Fan, Kuang-Chao
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2024, 35 (09)