3D complex curve seam tracking using industrial robot based on CAD model and computer vision

被引:2
作者
Le Duc Hanh [1 ,3 ]
Le Duc Dao [2 ,3 ]
Nguyen Cong Luan [1 ,3 ]
机构
[1] Ho Chi Minh City Univ Technol HCMUT, Dept Mechatron, Falculty Mech Engn, 268 Ly Thuong Kiet St,Dist 10, Ho Chi Minh City, Vietnam
[2] Ho Chi Minh City Univ Technol HCMUT, Dept Ind Syst Engn, Falculty Mech Engn, 268 Ly Thuong Kiet St,Dist 10, Ho Chi Minh City, Vietnam
[3] Vietnam Natl Univ, Linh Trung Ward, Ho Chi Minh City, Vietnam
来源
INTERNATIONAL JOURNAL OF INTERACTIVE DESIGN AND MANUFACTURING - IJIDEM | 2023年 / 17卷 / 03期
关键词
3D curve tracking; Industrial robot; 3D CAD matching; Point cloud; Computer vision; EXTRACTION;
D O I
10.1007/s12008-022-01043-4
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
(Abstract) 3D complex curve seam tracking using industrial robots applied in fields that affect human health such as welding, gluing, spraying, painting, etc. However, at present, manual performance by workers or teaching manipulators by using teach-pendant to recognize the planning trajectories curves, especially for 3D complex seam curves which often has complex shape, direction, small width are still the two main approaches. Through these two implementation methods, productivity is low and product quality is not uniform. So this study will present a practical method to overcome the above disadvantages by using a low-cost camera combining an image processing algorithm using a 3D CAD model and a pre-defined 3D curve profile that needs to be attached to that model to extract the contour on the object. This data is then transmitted to the industrial manipulator to perform the task of tracing the planned 3D complex curve. By using this method, the small width 3D complex curve is easily tracked and the system is not complicated. Moreover, the profile to be tracked can be modified easily and quickly by non-expert users with basic knowledge about CAD drawing and image processing. Through the result of the experiments, small error system and fast image processing time about 1.8 mm and 0.5 s respectively, the system proved that it meets the requirement of the production line and it can replace the worker. The system is also easy to maintain and setup.
引用
收藏
页码:1039 / 1046
页数:8
相关论文
共 50 条
[41]   Intelligent surveillance of indoor environments based on computer vision and 3D point cloud fusion [J].
Jose Gomez, Maria ;
Garcia, Fernando ;
Martin, David ;
de la Escalera, Arturo ;
Maria Armingol, Jose .
EXPERT SYSTEMS WITH APPLICATIONS, 2015, 42 (21) :8156-8171
[42]   3D measurement of large steel plates based on the integration of computer vision and laser technology [J].
Bai, Su-Qin ;
Shi, Jin-Long ;
Qian, Qiang ;
Shu, Xin .
Guangdianzi Jiguang/Journal of Optoelectronics Laser, 2015, 26 (03) :581-585
[43]   A 3D Sensing Technique Using Fuzzy Modeling Based on Stereo Vision [J].
Saito, Yuich ;
Watanabe, Toshihiko .
6TH INTERNATIONAL CONFERENCE ON SOFT COMPUTING AND INTELLIGENT SYSTEMS, AND THE 13TH INTERNATIONAL SYMPOSIUM ON ADVANCED INTELLIGENT SYSTEMS, 2012, :2138-2142
[44]   Automatic Robot Hand-Eye Calibration Enabled by Learning-Based 3D Vision [J].
Li, Leihui ;
Yang, Xingyu ;
Wang, Riwei ;
Zhang, Xuping .
JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2024, 110 (03)
[45]   Robo-vision! 3D mesh generation of a scene for a robot for planar and non-planar complex objects [J].
Agarwal S. ;
Maity S. ;
Barua H.B. ;
Bhowmick B. .
Multimedia Tools and Applications, 2023, 82 (27) :42641-42659
[46]   Automated joint 3D reconstruction and visual inspection for buildings using computer vision and transfer learning [J].
Wang, Tao ;
Gan, Vincent J. L. .
AUTOMATION IN CONSTRUCTION, 2023, 149
[47]   Framework for facial recognition and reconstruction for enhanced security and surveillance monitoring using 3D computer vision [J].
Wang, Lifen ;
Zhang, Rui .
JOURNAL OF ELECTRONIC IMAGING, 2023, 32 (04)
[48]   Improving 3D food printing performance using computer vision and feedforward nozzle motion control [J].
Ma, Yizhou ;
Potappel, Jelle ;
Chauhan, Aneesh ;
Schutyser, Maarten A., I ;
Boom, Remko M. ;
Zhang, Lu .
JOURNAL OF FOOD ENGINEERING, 2023, 339
[49]   Geometrical quality inspection in 3D concrete printing using AI-assisted computer vision [J].
Cui, Weijiu ;
Liu, Wenliang ;
Guo, Ruyi ;
Wan, Da ;
Yu, Xiaona ;
Ding, Luchuan ;
Tao, Yaxin .
MATERIALS AND STRUCTURES, 2025, 58 (02)
[50]   Region-based pose tracking with occlusions using 3D models [J].
Christian Schmaltz ;
Bodo Rosenhahn ;
Thomas Brox ;
Joachim Weickert .
Machine Vision and Applications, 2012, 23 :557-577