InstancePose: Fast 6DoF Pose Estimation for Multiple Objects from a Single RGB Image

被引:5
作者
Aing, Lee [1 ]
Lie, Wen-Nung [1 ,2 ,3 ]
Chiang, Jui-Chiu [1 ,2 ]
Lin, Guo-Shiang [4 ]
机构
[1] Natl Chung Cheng Univ CCU, Dept Elect Engn, Minxiong Township, Chiayi, Taiwan
[2] Natl Chung Cheng Univ CCU, Ctr Innovat Res Aging Soc CIRAS, Minxiong Township, Chiayi, Taiwan
[3] Natl Chung Cheng Univ CCU, Adv Inst Mfg High Tech Innovat AIM HI, Minxiong Township, Chiayi, Taiwan
[4] Natl Chin Yi Univ Technol, Dept Comp Sci & Informat Engn, Taichung, Taiwan
来源
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2021) | 2021年
关键词
D O I
10.1109/ICCVW54120.2021.00296
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
6DoF object pose estimation depends on positional accuracy, implementation complexity and processing speed. This study presents a method to estimate 6DoF object poses for multi-instance object detection that requires less time and is accurate. The proposed method uses a deep neural network, which outputs 4 types of feature maps: the error object mask, semantic object masks, center vector maps (CVM) and 6D coordinate maps. These feature maps are combined in post processing to detect and estimate multi-object 2D-3D correspondences in parallel for PnP RANSAC estimation. The experiments show that the method can process input RGB images containing 7 different object categories/ instances at a speed of 25 frames per second with competitive accuracy, compared with current state-of-the-art methods, which focus only on some specific conditions.
引用
收藏
页码:2621 / 2630
页数:10
相关论文
共 28 条
[1]   SilhoNet: An RGB Method for 6D Object Pose Estimation [J].
Billings, Gideon ;
Johnson-Roberson, Matthew .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2019, 4 (04) :3727-3734
[2]   Uncertainty-Driven 6D Pose Estimation of Objects and Scenes from a Single RGB Image [J].
Brachmann, Eric ;
Michel, Frank ;
Krull, Alexander ;
Yang, Michael Ying ;
Gumhold, Stefan ;
Rother, Carsten .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :3364-3372
[3]  
Brachmann E, 2014, LECT NOTES COMPUT SC, V8690, P536, DOI 10.1007/978-3-319-10605-2_35
[4]   OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields [J].
Cao, Zhe ;
Hidalgo, Gines ;
Simon, Tomas ;
Wei, Shih-En ;
Sheikh, Yaser .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (01) :172-186
[5]   The PASCAL Visual Object Classes Challenge: A Retrospective [J].
Everingham, Mark ;
Eslami, S. M. Ali ;
Van Gool, Luc ;
Williams, Christopher K. I. ;
Winn, John ;
Zisserman, Andrew .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2015, 111 (01) :98-136
[6]   Res2Net: A New Multi-Scale Backbone Architecture [J].
Gao, Shang-Hua ;
Cheng, Ming-Ming ;
Zhao, Kai ;
Zhang, Xin-Yu ;
Yang, Ming-Hsuan ;
Torr, Philip .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (02) :652-662
[7]  
Hinterstoisser S., 2013, ACCV, V7724, P548, DOI [DOI 10.1007/978-3-642-37331-242, 10.1007/978- 3- 642-37331-2_42]
[8]   EPOS: Estimating 6D Pose of Objects with Symmetries [J].
Hodan, Tomas ;
Barath, Daniel ;
Matas, Jiri .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :11700-11709
[9]   Arbuscular mycorrhiza improved drought tolerance of maize seedlings by altering photosystem II efficiency and the levels of key metabolites [J].
Hu, Yanbo ;
Xie, Wei ;
Chen, Baodong .
CHEMICAL AND BIOLOGICAL TECHNOLOGIES IN AGRICULTURE, 2020, 7 (01)
[10]   Segmentation-driven 6D Object Pose Estimation [J].
Hu, Yinlin ;
Hugonot, Joachim ;
Fua, Pascal ;
Salzmann, Mathieu .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :3380-3389