3D complex curve seam tracking using industrial robot based on CAD model and computer vision

被引:2
作者
Le Duc Hanh [1 ,3 ]
Le Duc Dao [2 ,3 ]
Nguyen Cong Luan [1 ,3 ]
机构
[1] Ho Chi Minh City Univ Technol HCMUT, Dept Mechatron, Falculty Mech Engn, 268 Ly Thuong Kiet St,Dist 10, Ho Chi Minh City, Vietnam
[2] Ho Chi Minh City Univ Technol HCMUT, Dept Ind Syst Engn, Falculty Mech Engn, 268 Ly Thuong Kiet St,Dist 10, Ho Chi Minh City, Vietnam
[3] Vietnam Natl Univ, Linh Trung Ward, Ho Chi Minh City, Vietnam
来源
INTERNATIONAL JOURNAL OF INTERACTIVE DESIGN AND MANUFACTURING - IJIDEM | 2023年 / 17卷 / 03期
关键词
3D curve tracking; Industrial robot; 3D CAD matching; Point cloud; Computer vision; EXTRACTION;
D O I
10.1007/s12008-022-01043-4
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
(Abstract) 3D complex curve seam tracking using industrial robots applied in fields that affect human health such as welding, gluing, spraying, painting, etc. However, at present, manual performance by workers or teaching manipulators by using teach-pendant to recognize the planning trajectories curves, especially for 3D complex seam curves which often has complex shape, direction, small width are still the two main approaches. Through these two implementation methods, productivity is low and product quality is not uniform. So this study will present a practical method to overcome the above disadvantages by using a low-cost camera combining an image processing algorithm using a 3D CAD model and a pre-defined 3D curve profile that needs to be attached to that model to extract the contour on the object. This data is then transmitted to the industrial manipulator to perform the task of tracing the planned 3D complex curve. By using this method, the small width 3D complex curve is easily tracked and the system is not complicated. Moreover, the profile to be tracked can be modified easily and quickly by non-expert users with basic knowledge about CAD drawing and image processing. Through the result of the experiments, small error system and fast image processing time about 1.8 mm and 0.5 s respectively, the system proved that it meets the requirement of the production line and it can replace the worker. The system is also easy to maintain and setup.
引用
收藏
页码:1039 / 1046
页数:8
相关论文
共 50 条
[21]   Scalable 3D mapping of cities using computer vision and signals of opportunity [J].
Basiri, Anahid ;
Lines, Terence ;
Pereira, Miguel Fidel .
INTERNATIONAL JOURNAL OF GEOGRAPHICAL INFORMATION SCIENCE, 2023, 37 (07) :1470-1495
[22]   3D Social Research: Analysis of Social Interaction Using Computer Vision [J].
Goldstein, Yoav ;
Legewie, Nicolas M. ;
Shiffer-Sebba, Doron .
SOCIOLOGICAL METHODS & RESEARCH, 2023, :1201-1238
[23]   A computer vision based method for 3D posture estimation of symmetrical lifting [J].
Mehrizi, Rahil ;
Peng, Xi ;
Xu, Xu ;
Zhang, Shaoting ;
Metaxas, Dimitris ;
Li, Kang .
JOURNAL OF BIOMECHANICS, 2018, 69 :40-46
[24]   3D visual monitoring system of industrial robot based on digital twin [J].
Du Y. ;
Luo Y. ;
Peng Y. ;
Liu X. ;
Wu J. .
Jisuanji Jicheng Zhizao Xitong/Computer Integrated Manufacturing Systems, CIMS, 2023, 29 (06) :2130-2138
[25]   3D Model-based estimation for UAV tracking [J].
Santos, Nuno Pessanha ;
Lobo, Victor ;
Bernardino, Alexandre .
OCEANS 2018 MTS/IEEE CHARLESTON, 2018,
[26]   Deep learning based computer vision under the prism of 3D point clouds: a systematic review [J].
Tychola, Kyriaki A. ;
Vrochidou, Eleni ;
Papakostas, George A. .
VISUAL COMPUTER, 2024, 40 (11) :8287-8329
[27]   Development and Validation of a Computer Vision-Based Tool for Automated 3D Dental Model Arch Prediction [J].
Tamayo-Quintero, J. D. ;
Gomez-Mendoza, J. B. ;
Guevara-Perez, S. V. .
INGENIERIA, 2025, 30 (01)
[28]   Robust Vision-Based Hand Tracking Using Single Camera for Ubiquitous 3D Gesture Interaction [J].
Rodriguez, Sergio ;
Picon, Artzai ;
Villodas, Aritz .
IEEE SYMPOSIUM ON 3D USER INTERFACES (3DUI 2010), 2010, :135-136
[29]   Computer Vision-Based Real-Time 3D Gesture Recognition Using Depth Image [J].
Heickal, Hasnain ;
Zhang, Tao ;
Hasanuzzaman, Md .
INTERNATIONAL JOURNAL OF IMAGE AND GRAPHICS, 2015, 15 (01)
[30]   Methodology on robot-based complex surface processing using 2D and 3D visual combination [J].
Wu, Haodong ;
Zou, Ting ;
Burke, Heather ;
King, Stephen ;
Burke, Brian .
2024 WRC SYMPOSIUM ON ADVANCED ROBOTICS AND AUTOMATION, WRC SARA, 2024, :113-120