RT-less: a multi-scene RGB dataset for 6D pose estimation of reflective texture-less objects

被引:2
作者
Zhao, Xinyue [1 ]
Li, Quanzhi [1 ]
Chao, Yue [1 ]
Wang, Quanyou [1 ]
He, Zaixing [1 ]
Liang, Dong [2 ]
机构
[1] Zhejiang Univ, Sch Mech Engn, State Key Lab Fluid Power & Mechatron Syst, Hangzhou 310027, Peoples R China
[2] Nanjing Univ Aeronaut & Astronaut, Coll Comp Sci & Technol, Nanjing 210016, Peoples R China
基金
中国国家自然科学基金;
关键词
Pose estimation; Pose measurement; Object detection; Instance segmentation; Reflective; Texture-less; Machine vision;
D O I
10.1007/s00371-023-03097-1
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
The 6D (6 Degree of freedom) pose estimation (or pose measurement) of machined reflective texture-less objects, which are common in industry, is a significant but challenging technique. It has attracted increasing attention in academia and industry. However, it is difficult to obtain suitable public datasets of such objects, which makes relevant studies inconvenient. Thus, we proposed the Reflective Texture-Less (RT-Less) object dataset, which is a new public dataset of reflective texture-less metal parts for pose estimation research. The dataset contains 38 machined texture-less reflective metal parts in total. Different parts demonstrate the symmetry and similarity of shape and size. The dataset contains 289 K RGB images and the same number of masks, including 25,080 real images, 250,800 synthetic images in the training set, and 13,312 real images captured in 32 different scenes in the test set. The dataset also provides accurate ground truth poses, bounding-box annotations and masks for these images, which makes RT-Less suitable for object detection and instance segmentation. To improve the accuracy of the ground truth, an iterative pose optimization method using only RGB images is proposed. Baselines of the state-of-the-art pose estimation methods are provided for further comparative studies. The dataset and results of baselines are available at: http://www.zju-rtl.cn/RT-Less/.
引用
收藏
页码:5187 / 5200
页数:14
相关论文
共 39 条
  • [1] Brachmann E, 2014, LECT NOTES COMPUT SC, V8690, P536, DOI 10.1007/978-3-319-10605-2_35
  • [2] Symmetry Aware Evaluation of 3D Object Detection and Pose Estimation in Scenes of Many Parts in Bulk
    Bregier, Romain
    Devernay, Frederic
    Leyrit, Laetitia
    Crowley, James L.
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2017), 2017, : 2209 - 2218
  • [3] Calli B, 2015, PROCEEDINGS OF THE 17TH INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS (ICAR), P510, DOI 10.1109/ICAR.2015.7251504
  • [4] A Novel Representation of Parts for Accurate 3D Object Detection and Tracking in Monocular Images
    Crivellaro, Alberto
    Rad, Mahdi
    Verdie, Yannick
    Yi, Kwang Moo
    Fua, Pascal
    Lepetit, Vincent
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, : 4391 - 4399
  • [5] Recovering 6D Object Pose and Predicting Next-Best-View in the Crowd
    Doumanoglou, Andreas
    Kouskouridas, Rigas
    Malassiotis, Sotiris
    Kim, Tae-Kyun
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 3583 - 3592
  • [6] Introducing MVTec ITODD - A Dataset for 3D Object Recognition in Industry
    Drost, Bertram
    Ulrich, Markus
    Bergmann, Paul
    Haertinger, Philipp
    Steger, Carsten
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2017), 2017, : 2200 - 2208
  • [7] Cut, Paste and Learn: Surprisingly Easy Synthesis for Instance Detection
    Dwibedi, Debidatta
    Misra, Ishan
    Hebert, Martial
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 1310 - 1319
  • [8] Eppner C., 2016, Robotics: Science and Systems, V5, P96, DOI DOI 10.15607/RSS.2016.XII.036
  • [9] Towards Robust Part-aware Instance Segmentation for Industrial Bin Picking
    Feng, Yidan
    Yang, Biqi
    Li, Xianzhi
    Fu, Chi-Wing
    Cao, Rui
    Chen, Kai
    Dou, Qi
    Wei, Mingqiang
    Liu, Yun-Hui
    Heng, Pheng-Ann
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2022), 2022,
  • [10] Automatic generation and detection of highly reliable fiducial markers under occlusion
    Garrido-Jurado, S.
    Munoz-Salinas, R.
    Madrid-Cuevas, F. J.
    Marin-Jimenez, M. J.
    [J]. PATTERN RECOGNITION, 2014, 47 (06) : 2280 - 2292