6D object pose estimation via viewpoint relation reasoning

被引:16
|
作者
Zhao, Wanqing [1 ]
Zhang, Shaobo [1 ]
Guan, Ziyu [1 ]
Luo, Hangzai [1 ]
Tang, Lei [2 ]
Peng, Jinye [1 ]
Fan, Jianping [3 ]
机构
[1] Northwestern Univ, Sch Informat & Technol, Xian, Shaanxi, Peoples R China
[2] Xian Microelect Technol Inst, Xian, Shaanxi, Peoples R China
[3] UNC Charlotte, Dept Comp Sci, Charlotte, NC USA
基金
国家重点研发计划; 美国国家科学基金会;
关键词
6D object pose estimation; Keypoints detection; Convolutional neural networks; Geometric reasoning;
D O I
10.1016/j.neucom.2019.12.108
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Estimating the 6D object pose is a very challenging task in computer vision. The main difficulty is mapping the object from RGB images to 3D space. In this paper, we present a novel two-stage method for estimating the 6D object pose by using the 2D keypoints of an object and its 2D bounding box. There are two stages in our method. The first stage detects the 2D keypoints and 2D bounding boxes of objects by a stable end-to-end framework. During the training phase, this framework uses viewpoint transformation information and object saliency regions to learn geometrically and semantically consistent keypoints. Then the 6D poses of objects are calculated by a series of geometric reasoning algorithms in the second stage. Experiments show that our method achieves accurate pose estimation and robust to occluded and cluttered scenes. (C) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页码:9 / 17
页数:9
相关论文
共 50 条
  • [21] Focal segmentation for robust 6D object pose estimation
    Yuning Ye
    Hanhoon Park
    Multimedia Tools and Applications, 2024, 83 : 47563 - 47585
  • [22] Open-vocabulary object 6D pose estimation
    Corsetti, Jaime
    Boscaini, Davide
    Oh, Changjae
    Cavallaro, Andrea
    Poiesi, Fabio
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, : 18071 - 18080
  • [23] Single-Stage 6D Object Pose Estimation
    Hu, Yinlin
    Fua, Pascal
    Wang, Wei
    Salzmann, Mathieu
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 2927 - 2936
  • [24] Sparse Keypoint Models for 6D Object Pose Estimation
    Sadran, Emal
    Wurm, Kai M.
    Burschka, Darius
    2013 EUROPEAN CONFERENCE ON MOBILE ROBOTS (ECMR 2013), 2013, : 307 - 312
  • [25] ACCURATE 6D OBJECT POSE ESTIMATION BY POSE CONDITIONED MESH RECONSTRUCTION
    Castro, Pedro
    Armagan, Anil
    Kim, Tae-Kyun
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 4147 - 4151
  • [26] Global Hypothesis Generation for 6D Object Pose Estimation
    Michel, Frank
    Kirillov, Alexander
    Brachmann, Eric
    Krull, Alexander
    Gumhold, Stefan
    Savchynskyy, Bogdan
    Rother, Carsten
    30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 115 - 124
  • [27] Anchor-Based 6D Object Pose Estimation
    Liu, Zehao
    Wang, Hao
    Liu, Fuchang
    2021 IEEE 7TH INTERNATIONAL CONFERENCE ON VIRTUAL REALITY (ICVR 2021), 2021, : 33 - 40
  • [28] A Pose Proposal and Refinement Network for Better 6D Object Pose Estimation
    Trabelsi, Ameni
    Chaabane, Mohamed
    Blanchard, Nathaniel
    Beveridge, Ross
    2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WACV 2021, 2021, : 2381 - 2390
  • [29] PointPoseNet: Point Pose Network for Robust 6D Object Pose Estimation
    Chen, Wei
    Duan, Jinming
    Basevi, Hector
    Chang, Hyung Jin
    Leonardis, Ales
    2020 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2020, : 2813 - 2822
  • [30] TemporalFusion: Temporal Motion Reasoning with Multi-Frame Fusion for 6D Object Pose Estimation
    Mu, Fengjun
    Huang, Rui
    Luo, Ao
    Li, Xin
    Qiu, Jing
    Cheng, Hong
    2021 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2021, : 5930 - 5936