3D complex curve seam tracking using industrial robot based on CAD model and computer vision

被引:2
作者
Le Duc Hanh [1 ,3 ]
Le Duc Dao [2 ,3 ]
Nguyen Cong Luan [1 ,3 ]
机构
[1] Ho Chi Minh City Univ Technol HCMUT, Dept Mechatron, Falculty Mech Engn, 268 Ly Thuong Kiet St,Dist 10, Ho Chi Minh City, Vietnam
[2] Ho Chi Minh City Univ Technol HCMUT, Dept Ind Syst Engn, Falculty Mech Engn, 268 Ly Thuong Kiet St,Dist 10, Ho Chi Minh City, Vietnam
[3] Vietnam Natl Univ, Linh Trung Ward, Ho Chi Minh City, Vietnam
来源
INTERNATIONAL JOURNAL OF INTERACTIVE DESIGN AND MANUFACTURING - IJIDEM | 2023年 / 17卷 / 03期
关键词
3D curve tracking; Industrial robot; 3D CAD matching; Point cloud; Computer vision; EXTRACTION;
D O I
10.1007/s12008-022-01043-4
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
(Abstract) 3D complex curve seam tracking using industrial robots applied in fields that affect human health such as welding, gluing, spraying, painting, etc. However, at present, manual performance by workers or teaching manipulators by using teach-pendant to recognize the planning trajectories curves, especially for 3D complex seam curves which often has complex shape, direction, small width are still the two main approaches. Through these two implementation methods, productivity is low and product quality is not uniform. So this study will present a practical method to overcome the above disadvantages by using a low-cost camera combining an image processing algorithm using a 3D CAD model and a pre-defined 3D curve profile that needs to be attached to that model to extract the contour on the object. This data is then transmitted to the industrial manipulator to perform the task of tracing the planned 3D complex curve. By using this method, the small width 3D complex curve is easily tracked and the system is not complicated. Moreover, the profile to be tracked can be modified easily and quickly by non-expert users with basic knowledge about CAD drawing and image processing. Through the result of the experiments, small error system and fast image processing time about 1.8 mm and 0.5 s respectively, the system proved that it meets the requirement of the production line and it can replace the worker. The system is also easy to maintain and setup.
引用
收藏
页码:1039 / 1046
页数:8
相关论文
共 50 条
[31]   3D reconstruction algorithm of weld pool surface based on computer vision technology [J].
Mu, Zhen-Hai .
Open Petroleum Engineering Journal, 2015, 8 (01) :434-439
[32]   Drilling errors compensation of industrial robot based on 3D passive scale tracker [J].
Lou, Zhifeng ;
Zhou, Jingjie ;
Zhang, Jiyun ;
Yunliang, E. ;
Li, Weifeng ;
Fan, Kuang-Chao .
MEASUREMENT SCIENCE AND TECHNOLOGY, 2024, 35 (09)
[33]   Optimising computer vision-based ergonomic assessments: sensitivity to camera position and monocular 3D pose model [J].
Murugan, Aditya Subramani ;
Noh, Gijeong ;
Jung, Hayoung ;
Kim, Eunsik ;
Kim, Kyongwon ;
You, Heecheon ;
Boufama, Boubakeur .
ERGONOMICS, 2025, 68 (01) :120-137
[34]   Directional Statistics for 3D Model-Based UAV Tracking [J].
Santos, Nuno Pessanha ;
Lobo, Victor ;
Bernardino, Alexandre .
IEEE ACCESS, 2020, 8 :33884-33897
[35]   Vision based UAV navigation using 3D GIS data [J].
Zhang, J ;
Liu, W .
IMAGE AND VIDEO COMMUNICATIONS AND PROCESSING 2003, PTS 1 AND 2, 2003, 5022 :910-920
[36]   Innovative Computer Vision Approach to 3D Bladder Model Reconstruction from Flexible Cystoscopy [J].
Falcon, Nestor Orlando ;
Ranjbar, Sorush ;
Cisneros, Exal ;
Vu, Bao ;
Schoppe, Austin ;
Sanchez, Pedro ;
Jin, Yufang ;
Ye, JingYong ;
Feng, Yusheng ;
Kaushik, Dharam ;
Hood, R. Lyle .
THERAPEUTICS AND DIAGNOSTICS IN UROLOGY 2019, 2019, 10852
[37]   Computer vision based target-free 3D vibration displacement measurement of structures [J].
Shao, Yanda ;
Li, Ling ;
Li, Jun ;
An, Senjian ;
Hao, Hong .
ENGINEERING STRUCTURES, 2021, 246
[38]   Cargo pallets real-time 3D positioning method based on computer vision [J].
Li, Tianjian ;
Jin, Qiu ;
Huang, Bin ;
Li, Chang ;
Huang, Min .
JOURNAL OF ENGINEERING-JOE, 2019, 2019 (23) :8551-8555
[39]   Features Detection-Based Computer Vision of Transparent 3D Inkjet Printed Parts [J].
Elkaseer, Ahmed ;
Scholz, Amon ;
Scholz, Steffen G. .
PROCEEDINGS OF THE FUTURE TECHNOLOGIES CONFERENCE (FTC) 2021, VOL 2, 2022, 359 :218-231
[40]   Intelligent surveillance of indoor environments based on computer vision and 3D point cloud fusion [J].
Jose Gomez, Maria ;
Garcia, Fernando ;
Martin, David ;
de la Escalera, Arturo ;
Maria Armingol, Jose .
EXPERT SYSTEMS WITH APPLICATIONS, 2015, 42 (21) :8156-8171