Enhancing ToF Sensor Precision Using 3D Models and Simulation for Vision Inspection in Industrial Mobile Robots

被引:1
作者
Yang, Changmo [1 ,2 ]
Kang, Jiheon [3 ]
Eom, Doo-Seop [1 ]
机构
[1] Korea Univ, Dept Elect & Comp Engn, 145 Anam Ro, Seoul 02841, South Korea
[2] Hyundai Motor Co, 37 Cheoldobangmulgwan Ro, Uiwang 16088, South Korea
[3] Duksung Womens Univ, Dept Software, 33 Samyang Ro 144 Gil, Seoul 01369, South Korea
来源
APPLIED SCIENCES-BASEL | 2024年 / 14卷 / 11期
关键词
robotics; manipulator; point cloud; ToF camera; 3D model; simulation; deep learning;
D O I
10.3390/app14114595
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
In recent industrial settings, time-of-flight (ToF) cameras have become essential tools in various applications. These cameras provide high-performance 3D measurements without relying on ambient lighting; however, their performance can degrade due to environmental factors such as temperature, humidity, and distance to the target. This study proposes a novel method to enhance the pixel-level sensing accuracy of ToF cameras by obtaining precise depth data labels in real-world environments. By synchronizing 3D simulations with the actual ToF sensor viewpoints, accurate depth values were acquired and utilized to train AI algorithms, thereby improving ToF depth accuracy. This method was validated in industrial environments such as automobile manufacturing, where the introduction of 3D vision systems improved inspection accuracy compared to traditional 2D systems. Additionally, it was confirmed that ToF depth data can be used to correct positional errors in mobile robot manipulators. Experimental results showed that AI-based preprocessing effectively reduced noise and increased the precision of depth data compared to conventional methods. Consequently, ToF camera performance was enhanced, expanding their potential applications in industrial robotics and automated quality inspection. Future research will focus on developing real-time synchronization technology between ToF sensor data and simulation environments, as well as expanding the AI training dataset to achieve even higher accuracy.
引用
收藏
页数:14
相关论文
共 25 条
  • [1] 3D measurement sensor system for rough terrain mobile robots
    Yokota, Sho
    Ohyama, Yasuhiro
    Hashimoto, Hiroshl
    She, Jin-Hua
    Kawabata, Kuniaki
    Kobayashi, Hisato
    Blazevic, Pierre
    SENSOR REVIEW, 2007, 27 (03) : 224 - 232
  • [2] AI-Enabled Condition Monitoring Framework for Outdoor Mobile Robots Using 3D LiDAR Sensor
    Pookkuttath, Sathian
    Palanisamy, Povendhan Arthanaripalayam
    Elara, Mohan Rajesh
    MATHEMATICS, 2023, 11 (16)
  • [3] Practicing the geometric designation of sensor networks using the Crowdsource 3D models of cultural heritage objects
    Alsadik, Bashar
    JOURNAL OF CULTURAL HERITAGE, 2018, 31 : 202 - 207
  • [4] Efficient Use of 3D Environment Models for Mobile Robot Simulation and Localization
    Corominas Murtra, Andreu
    Trulls, Eduard
    Mirats Tur, Josep M.
    Sanfeliu, Alberto
    SIMULATION, MODELING, AND PROGRAMMING FOR AUTONOMOUS ROBOTS, 2010, 6472 : 461 - 472
  • [5] Towards Automated 3D Inspection of Water Leakages in Shield Tunnel Linings Using Mobile Laser Scanning Data
    Huang, Hongwei
    Cheng, Wen
    Zhou, Mingliang
    Chen, Jiayao
    Zhao, Shuai
    SENSORS, 2020, 20 (22) : 1 - 23
  • [6] Simulation of deformation on 3D organ models using haptic device
    Bulut, Nazmiye Ebru
    Dandil, Emre
    JOURNAL OF THE FACULTY OF ENGINEERING AND ARCHITECTURE OF GAZI UNIVERSITY, 2023, 38 (02): : 1263 - 1278
  • [7] Automated joint 3D reconstruction and visual inspection for buildings using computer vision and transfer learning
    Wang, Tao
    Gan, Vincent J. L.
    AUTOMATION IN CONSTRUCTION, 2023, 149
  • [8] Developing 3D Model for Mobile Robot Environment Using Mono-Vision System
    Al-Jarrah, Mohammad A.
    2016 7TH INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND INFORMATION TECHNOLOGY (CSIT), 2016,
  • [9] Autonomous dimensional inspection and issue tracking of rebar using semantically enriched 3D models
    Chang, Chun-Cheng
    Huang, Tsung-Wei
    Chen, Yi-Hsiang
    Lin, Jacob J.
    Chen, Chuin-Shan
    AUTOMATION IN CONSTRUCTION, 2024, 160
  • [10] A Noise-Robust Obstacle Detection Algorithm for Mobile Robots Using Active 3D Sensors
    Claudi, Andrea
    Accattoli, Daniele
    Sernani, Paolo
    Calvaresi, Paolo
    Dragoni, Aldo Franco
    2014 56TH INTERNATIONAL SYMPOSIUM ELMAR (ELMAR), 2014, : 91 - 94