A Shared Pose Regression Network for Pose Estimation of Objects from RGB Images

被引:0
作者
Bengtson, Stefan Hein [1 ]
Astrom, Hampus [2 ]
Moeslund, Thomas B. [1 ]
Topp, Elin A. [2 ]
Krueger, Volker [2 ]
机构
[1] Aalborg Univ, Dept Architecture Design & Media Technol, Visual Anal & Percept VAP Lab, Aalborg, Denmark
[2] Lund Univ, Dept Comp Sci, Robot & Semant Syst, Lund, Sweden
来源
2022 16TH INTERNATIONAL CONFERENCE ON SIGNAL-IMAGE TECHNOLOGY & INTERNET-BASED SYSTEMS, SITIS | 2022年
关键词
pose estimation; symmetry; CAD model; differentiable rendering; robotics;
D O I
10.1109/SITIS57111.2022.00022
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper we propose a shared regression network to jointly estimate the pose of multiple objects, replacing multiple object-specific solutions. We demonstrate that this shared network can outperform other similar approaches that rely on multiple object-specific models by evaluating it on the TLESS dataset using the VSD (Visible Surface Discrepancy). Our approach offers a less complex solution, with fewer parameters, lower memory consumption and less training required. Furthermore, it inherently handles symmetric objects by using a depthbased loss during training and can predict in real-time. Finally, we show how our proposed pipeline can be used for fine-tuning a feature extractor jointly on all objects while training the shared pose regression network. This fine-tuning process improves the pose estimation performance.
引用
收藏
页码:91 / 97
页数:7
相关论文
共 20 条
[1]   Pose Estimation from RGB Images of Highly Symmetric Objects using a Novel Multi-Pose Loss and Differential Rendering [J].
Bengtson, Stefan Hein ;
Astram, Hampus ;
Moeslund, Thomas B. ;
Topp, Elin A. ;
Krueger, Volker .
2021 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2021, :4618-4624
[2]   PoseRBPF: A Rao-Blackwellized Particle Filter for 6-D Object Pose Tracking [J].
Deng, Xinke ;
Mousavian, Arsalan ;
Xiang, Yu ;
Xia, Fei ;
Bretl, Timothy ;
Fox, Dieter .
IEEE TRANSACTIONS ON ROBOTICS, 2021, 37 (05) :1328-1342
[3]   Introducing MVTec ITODD - A Dataset for 3D Object Recognition in Industry [J].
Drost, Bertram ;
Ulrich, Markus ;
Bergmann, Paul ;
Haertinger, Philipp ;
Steger, Carsten .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2017), 2017, :2200-2208
[4]  
Haugaard Rasmus Laurvig, 2021, SURFEMB DENSE CONTIN
[5]  
Hodan Tomas, 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Proceedings, P11700, DOI 10.1109/CVPR42600.2020.01172
[6]  
Hodan T, 2020, ECCV WORKSHOPS
[7]   BOP: Benchmark for 6D Object Pose Estimation [J].
Hodan, Tomas ;
Michel, Frank ;
Brachmann, Eric ;
Kehl, Wadim ;
Buch, Anders Glent ;
Kraft, Dirk ;
Drost, Bertram ;
Vidal, Joel ;
Ihrke, Stephan ;
Zabulis, Xenophon ;
Sahin, Caner ;
Manhardt, Fabian ;
Tombari, Federico ;
Kim, Tae-Kyun ;
Matas, Jiri ;
Rother, Carsten .
COMPUTER VISION - ECCV 2018, PT X, 2018, 11214 :19-35
[8]   T-LESS: An RGB-D Dataset for 6D Pose Estimation of Texture-less Objects [J].
Hodan, Tomas ;
Haluza, Pavel ;
Obdrzalek, Stepan ;
Matas, Jiri ;
Lourakis, Manolis ;
Zabulis, Xenophon .
2017 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2017), 2017, :880-888
[9]   On Evaluation of 6D Object Pose Estimation [J].
Hodan, Tomas ;
Matas, Jiri ;
Obdrzalek, Stephan .
COMPUTER VISION - ECCV 2016 WORKSHOPS, PT III, 2016, 9915 :606-619
[10]   SSD-6D: Making RGB-Based 3D Detection and 6D Pose Estimation Great Again [J].
Kehl, Wadim ;
Manhardt, Fabian ;
Tombari, Federico ;
Ilic, Slobodan ;
Navab, Nassir .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :1530-1538