RT-less: a multi-scene RGB dataset for 6D pose estimation of reflective texture-less objects

被引:3
作者
Zhao, Xinyue [1 ]
Li, Quanzhi [1 ]
Chao, Yue [1 ]
Wang, Quanyou [1 ]
He, Zaixing [1 ]
Liang, Dong [2 ]
机构
[1] Zhejiang Univ, Sch Mech Engn, State Key Lab Fluid Power & Mechatron Syst, Hangzhou 310027, Peoples R China
[2] Nanjing Univ Aeronaut & Astronaut, Coll Comp Sci & Technol, Nanjing 210016, Peoples R China
基金
中国国家自然科学基金;
关键词
Pose estimation; Pose measurement; Object detection; Instance segmentation; Reflective; Texture-less; Machine vision;
D O I
10.1007/s00371-023-03097-1
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
The 6D (6 Degree of freedom) pose estimation (or pose measurement) of machined reflective texture-less objects, which are common in industry, is a significant but challenging technique. It has attracted increasing attention in academia and industry. However, it is difficult to obtain suitable public datasets of such objects, which makes relevant studies inconvenient. Thus, we proposed the Reflective Texture-Less (RT-Less) object dataset, which is a new public dataset of reflective texture-less metal parts for pose estimation research. The dataset contains 38 machined texture-less reflective metal parts in total. Different parts demonstrate the symmetry and similarity of shape and size. The dataset contains 289 K RGB images and the same number of masks, including 25,080 real images, 250,800 synthetic images in the training set, and 13,312 real images captured in 32 different scenes in the test set. The dataset also provides accurate ground truth poses, bounding-box annotations and masks for these images, which makes RT-Less suitable for object detection and instance segmentation. To improve the accuracy of the ground truth, an iterative pose optimization method using only RGB images is proposed. Baselines of the state-of-the-art pose estimation methods are provided for further comparative studies. The dataset and results of baselines are available at: http://www.zju-rtl.cn/RT-Less/.
引用
收藏
页码:5187 / 5200
页数:14
相关论文
共 39 条
[31]   Learning Calibrated-Guidance for Object Detection in Aerial Images [J].
Wei, Zongqi ;
Liang, Dong ;
Zhang, Dong ;
Zhang, Liyan ;
Geng, Qixiang ;
Wei, Mingqiang ;
Zhou, Huiyu .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 :2721-2733
[32]   Pseudo-Siamese Graph Matching Network for Textureless Objects' 6-D Pose Estimation [J].
Wu, Chenrui ;
Chen, Long ;
He, Zaixing ;
Jiang, Junjie .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2022, 69 (03) :2718-2727
[33]  
Xiang Yu., 2018, PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Robotics: Science and Systems (RSS)
[34]  
Xiao JX, 2010, PROC CVPR IEEE, P3485, DOI 10.1109/CVPR.2010.5539970
[35]   ROBI: A Multi-View Dataset for Reflective Objects in Robotic Bin-Picking [J].
Yang, Jun ;
Gao, Yizhou ;
Li, Dong ;
Waslander, Steven L. .
2021 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2021, :9788-9795
[36]   Probabilistic Multi-View Fusion of Active Stereo Depth Maps for Robotic Bin-Picking [J].
Yang, Jun ;
Li, Dong ;
Waslander, Steven L. .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (03) :4472-4479
[37]   RobotP: A Benchmark Dataset for 6D Object Pose Estimation [J].
Yuan, Honglin ;
Hoogenkamp, Tim ;
Veltkamp, Remco C. .
SENSORS, 2021, 21 (04) :1-26
[38]   Correspondence-free pose estimation for 3D objects from noisy depth data [J].
Zabulis, Xenophon ;
Lourakis, Manolis I. A. ;
Koutlemanis, Panagiotis .
VISUAL COMPUTER, 2018, 34 (02) :193-211
[39]   A flexible new technique for camera calibration [J].
Zhang, ZY .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2000, 22 (11) :1330-1334