6D Pose Estimation Based on 3D Edge Binocular Reprojection Optimization for Robotic Assembly

被引:5
|
作者
Li, Dong [1 ]
Mu, Quan [2 ]
Yuan, Yilin [1 ]
Wu, Shiwei [1 ]
Tian, Ye [1 ]
Hong, Hualin [1 ]
Jiang, Qian [1 ]
Liu, Fei [1 ]
机构
[1] Chongqing Univ, Coll Mech & Vehicle Engn, State Key Lab Mech Transmiss, Chongqing 400000, Peoples R China
[2] Minist Ecol & Environm, Foreign Environm Cooperat Ctr, Beijing 100035, Peoples R China
基金
中国国家自然科学基金;
关键词
Three-dimensional displays; Pose estimation; Image edge detection; Feature extraction; Optimization; Solid modeling; Robots; 6D pose estimation; pose refinement; robotic assembly;
D O I
10.1109/LRA.2023.3327933
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Accurate 6D pose estimation of object is important for robot assembly. This letter presents a novel method for achieving high precision 6D pose estimation by exploiting the reprojection of 3D edges onto binocular RGB image pairs. Our proposed method encompasses three phases: detection, pose initialization, and pose refinement. In the detection phase, an existing detector is employed to identify the objects within the image pairs. Subsequently, the object image patch of interest is extracted and fed into an encoder-decoder network that leverages edge maps and RGB images for the purpose of initial pose estimation. To refine the initial pose and achieve precise 6D pose estimation, we introduce a novel binocular edge-map-based nonlinear optimization technique. Our primary contributions entail an improved initial pose estimation network and a novel pose optimization technique. The improved network is dedicated to enhancing the accuracy of initial pose estimation, while the optimization technique focuses on refining the precision of the estimations. Experimental results demonstrate the effectiveness of our method, yielding an average translation precision of 0.48 mm and rotation precision of 0.45 degrees. Consequently, our proposed method can be seamlessly integrated into robotic manipulation platforms to successfully execute diverse assembly tasks.
引用
收藏
页码:8319 / 8326
页数:8
相关论文
共 50 条
  • [1] Bayesian Optimization of 3D Feature Parameters for 6D Pose Estimation
    Hagelskjaer, Frederik
    Kruger, Norbert
    Buch, Anders
    PROCEEDINGS OF THE 14TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS (VISAPP), VOL 5, 2019, : 135 - 142
  • [2] Fast 6D object pose estimation of shell parts for robotic assembly
    Haopeng Hu
    Weikun Gu
    Xiansheng Yang
    Nan Zhang
    Yunjiang Lou
    The International Journal of Advanced Manufacturing Technology, 2022, 118 : 1383 - 1396
  • [3] Fast 6D object pose estimation of shell parts for robotic assembly
    Hu, Haopeng
    Gu, Weikun
    Yang, Xiansheng
    Zhang, Nan
    Lou, Yunjiang
    INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2022, 118 (5-6): : 1383 - 1396
  • [4] A Review on Six Degrees of Freedom (6D) Pose Estimation for Robotic Applications
    Chen, Yuanwei
    Zaman, Mohd Hairi Mohd
    Ibrahim, Mohd Faisal
    IEEE ACCESS, 2024, 12 : 161002 - 161017
  • [5] Confidence-Based 6D Object Pose Estimation
    Huang, Wei-Lun
    Hung, Chun-Yi
    Lin, I-Chen
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 3025 - 3035
  • [6] Efficient Center Voting for Object Detection and 6D Pose Estimation in 3D Point Cloud
    Guo, Jianwei
    Xing, Xuejun
    Quan, Weize
    Yan, Dong-Ming
    Gu, Qingyi
    Liu, Yang
    Zhang, Xiaopeng
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 5072 - 5084
  • [7] RGB-Based Set Prediction Transformer of 6D Pose Estimation for Robotic Grasping Application
    Ning, Xiao
    Yang, Beining
    Huang, Si
    Zhang, Zhenzhe
    Pan, Binhui
    IEEE ACCESS, 2024, 12 : 138047 - 138060
  • [8] A Comprehensive Review on 3D Object Detection and 6D Pose Estimation With Deep Learning
    Hoque, Sabera
    Arafat, Md. Yasir
    Xu, Shuxiang
    Maiti, Ananda
    Wei, Yuchen
    IEEE ACCESS, 2021, 9 : 143746 - 143770
  • [9] Weakly Supervised 6D Pose Estimation for Robotic Grasping
    Li, Yaoxin
    Sun, Jinghua
    Li, Xiaoqian
    Zhang, Zhanpeng
    Cheng, Hui
    Wang, Xiaogang
    PROCEEDINGS OF THE 16TH ACM SIGGRAPH INTERNATIONAL CONFERENCE ON VIRTUAL-REALITY CONTINUUM AND ITS APPLICATIONS IN INDUSTRY (VRCAI 2018), 2018,
  • [10] Orientation Keypoints for 6D Human Pose Estimation
    Fisch, Martin
    Clark, Ronald
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (12) : 10145 - 10158