6D Pose Estimation Based on 3D Edge Binocular Reprojection Optimization for Robotic Assembly

被引:5
|
作者
Li, Dong [1 ]
Mu, Quan [2 ]
Yuan, Yilin [1 ]
Wu, Shiwei [1 ]
Tian, Ye [1 ]
Hong, Hualin [1 ]
Jiang, Qian [1 ]
Liu, Fei [1 ]
机构
[1] Chongqing Univ, Coll Mech & Vehicle Engn, State Key Lab Mech Transmiss, Chongqing 400000, Peoples R China
[2] Minist Ecol & Environm, Foreign Environm Cooperat Ctr, Beijing 100035, Peoples R China
基金
中国国家自然科学基金;
关键词
Three-dimensional displays; Pose estimation; Image edge detection; Feature extraction; Optimization; Solid modeling; Robots; 6D pose estimation; pose refinement; robotic assembly;
D O I
10.1109/LRA.2023.3327933
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Accurate 6D pose estimation of object is important for robot assembly. This letter presents a novel method for achieving high precision 6D pose estimation by exploiting the reprojection of 3D edges onto binocular RGB image pairs. Our proposed method encompasses three phases: detection, pose initialization, and pose refinement. In the detection phase, an existing detector is employed to identify the objects within the image pairs. Subsequently, the object image patch of interest is extracted and fed into an encoder-decoder network that leverages edge maps and RGB images for the purpose of initial pose estimation. To refine the initial pose and achieve precise 6D pose estimation, we introduce a novel binocular edge-map-based nonlinear optimization technique. Our primary contributions entail an improved initial pose estimation network and a novel pose optimization technique. The improved network is dedicated to enhancing the accuracy of initial pose estimation, while the optimization technique focuses on refining the precision of the estimations. Experimental results demonstrate the effectiveness of our method, yielding an average translation precision of 0.48 mm and rotation precision of 0.45 degrees. Consequently, our proposed method can be seamlessly integrated into robotic manipulation platforms to successfully execute diverse assembly tasks.
引用
收藏
页码:8319 / 8326
页数:8
相关论文
共 50 条
  • [21] 6D Object Pose Estimation With Compact Generalized Non-Local Operation
    Jiang, Changhong
    Mu, Xiaoqiao
    Zhang, Bingbing
    Liang, Chao
    Xie, Mujun
    IEEE ACCESS, 2024, 12 : 178080 - 178088
  • [22] Anchor-Based 6D Object Pose Estimation
    Liu, Zehao
    Wang, Hao
    Liu, Fuchang
    2021 IEEE 7TH INTERNATIONAL CONFERENCE ON VIRTUAL REALITY (ICVR 2021), 2021, : 33 - 40
  • [23] A Practical Robotic Grasping Method by Using 6-D Pose Estimation With Protective Correction
    Zhang, Hui
    Liang, Zhicong
    Li, Chen
    Zhong, Hang
    Liu, Li
    Zhao, Chenyang
    Wang, Yaonan
    Wu, Q. M. Jonathan
    IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2022, 69 (04) : 3876 - 3886
  • [24] 3D Model-Based 6D Object Pose Tracking on RGB Images
    Majcher, Mateusz
    Kwolek, Bogdan
    INTELLIGENT INFORMATION AND DATABASE SYSTEMS (ACIIDS 2020), PT I, 2020, 12033 : 271 - 282
  • [25] Fundamental Coordinate Space for Object 6D Pose Estimation
    Wan, Boyan
    Zhang, Chen
    IEEE ACCESS, 2024, 12 : 146430 - 146440
  • [26] Category-Level 6D Object Pose Estimation With Structure Encoder and Reasoning Attention
    Liu, Jierui
    Cao, Zhiqiang
    Tang, Yingbo
    Liu, Xilong
    Tan, Min
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (10) : 6728 - 6740
  • [27] 6-D Object Pose Estimation Based on Point Pair Matching for Robotic Grasp Detection
    Yu, Sheng
    Zhai, Di-Hua
    Zhan, Yufeng
    Wang, Wencai
    Guan, Yuyin
    Xia, Yuanqing
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024,
  • [28] Semi-Supervised 6D Object Pose Estimation Without Using Real Annotations
    Zhou, Guangliang
    Wang, Deming
    Yan, Yi
    Chen, Huiyi
    Chen, Qijun
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (08) : 5163 - 5174
  • [29] ReFlow6D: Refraction-Guided Transparent Object 6D Pose Estimation via Intermediate Representation Learning
    Gupta, Hrishikesh
    Thalhammer, Stefan
    Weibel, Jean-Baptiste
    Haberl, Alexander
    Vincze, Markus
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (11): : 9438 - 9445
  • [30] An image appearance based optimization scheme for monocular 6D pose estimation of SOR cabins
    Yin, Xuyue
    Fan, Xiumin
    Yang, Xu
    Qiu, Shiguang
    OPTIK, 2019, 199