Towards Deep Learning-based 6D Bin Pose Estimation in 3D Scans

被引:1
|
作者
Gajdosech, Lukas [1 ,2 ]
Kocur, Viktor [2 ,4 ]
Stuchlik, Martin [1 ]
Hudec, Lukas [3 ]
Madaras, Martin [1 ,2 ]
机构
[1] Skeletex Res, Karlova Ves, Slovakia
[2] Comenius Univ, Fac Math Phys & Informat, Bratislava, Slovakia
[3] Slovak Tech Univ Bratislava, Fac Informat & Informat Technol, Bratislava, Slovakia
[4] Brno Univ Technol, Fac Informat Technol, Brno, Czech Republic
关键词
Computer Vision; Bin Pose Estimation; 6D Pose Estimation; Deep Learning; Point Clouds;
D O I
10.5220/0010878200003124
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
An automated robotic system needs to be as robust as possible and fail-safe in general while having relatively high precision and repeatability. Although deep learning-based methods are becoming research standard on how to approach 3D scan and image processing tasks, the industry standard for processing this data is still analytically-based. Our paper claims that analytical methods are less robust and harder for testing, updating, and maintaining. This paper focuses on a specific task of 6D pose estimation of a bin in 3D scans. Therefore, we present a high-quality dataset composed of synthetic data and real scans captured by a structured-light scanner with precise annotations. Additionally, we propose two different methods for 6D bin pose estimation, an analytical method as the industrial standard and a baseline data-driven method. Both approaches are cross-evaluated, and our experiments show that augmenting the training on real scans with synthetic data improves our proposed data-driven neural model. This position paper is preliminary, as proposed methods are trained and evaluated on a relatively small initial dataset which we plan to extend in the future.
引用
收藏
页码:545 / 552
页数:8
相关论文
共 50 条
  • [1] A Comprehensive Review on 3D Object Detection and 6D Pose Estimation With Deep Learning
    Hoque, Sabera
    Arafat, Md. Yasir
    Xu, Shuxiang
    Maiti, Ananda
    Wei, Yuchen
    IEEE ACCESS, 2021, 9 : 143746 - 143770
  • [2] Validation of deep learning-based markerless 3D pose estimation
    Kosourikhina, Veronika
    Kavanagh, Diarmuid
    Richardson, Michael J.
    Kaplan, David M.
    PLOS ONE, 2022, 17 (10):
  • [3] Towards Learning 3d Object Detection and 6d Pose Estimation from Synthetic Data
    Rudorfer, Martin
    Neumann, Lukas
    Krueger, Joerg
    2019 24TH IEEE INTERNATIONAL CONFERENCE ON EMERGING TECHNOLOGIES AND FACTORY AUTOMATION (ETFA), 2019, : 1540 - 1543
  • [4] Deep Learning of Local RGB-D Patches for 3D Object Detection and 6D Pose Estimation
    Kehl, Wadim
    Milletari, Fausto
    Tombari, Federico
    Ilic, Slobodan
    Navab, Nassir
    COMPUTER VISION - ECCV 2016, PT III, 2016, 9907 : 205 - 220
  • [5] Learning 6D Object Pose Estimation Using 3D Object Coordinates
    Brachmann, Eric
    Krull, Alexander
    Michel, Frank
    Gumhold, Stefan
    Shotton, Jamie
    Rother, Carsten
    COMPUTER VISION - ECCV 2014, PT II, 2014, 8690 : 536 - 551
  • [6] Joint Optimization of the 3D Model and 6D Pose for Monocular Pose Estimation
    Guo, Liangchao
    Chen, Lin
    Wang, Qiufu
    Zhang, Zhuo
    Sun, Xiaoliang
    DRONES, 2024, 8 (11)
  • [7] 6D pose estimation with combined deep learning and 3D vision techniques for a fast and accurate object grasping
    Le, Tuan-Tang
    Le, Trung-Son
    Chen, Yu-Ru
    Vidal, Joel
    Lin, Chyi-Yeu
    ROBOTICS AND AUTONOMOUS SYSTEMS, 2021, 141
  • [8] Deep learning-based real-time 3D human pose estimation
    Zhang, Xiaoyan
    Zhou, Zhengchun
    Han, Ying
    Meng, Hua
    Yang, Meng
    Rajasegarar, Sutharshan
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 119
  • [9] A Comprehensive Study on Deep Learning-Based 3D Hand Pose Estimation Methods
    Chatzis, Theocharis
    Stergioulas, Andreas
    Konstantinidis, Dimitrios
    Dimitropoulos, Kosmas
    Daras, Petros
    APPLIED SCIENCES-BASEL, 2020, 10 (19): : 1 - 27
  • [10] Bayesian Optimization of 3D Feature Parameters for 6D Pose Estimation
    Hagelskjaer, Frederik
    Kruger, Norbert
    Buch, Anders
    PROCEEDINGS OF THE 14TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS (VISAPP), VOL 5, 2019, : 135 - 142