6D Pose Estimation Based on 3D Edge Binocular Reprojection Optimization for Robotic Assembly

被引:5
|
作者
Li, Dong [1 ]
Mu, Quan [2 ]
Yuan, Yilin [1 ]
Wu, Shiwei [1 ]
Tian, Ye [1 ]
Hong, Hualin [1 ]
Jiang, Qian [1 ]
Liu, Fei [1 ]
机构
[1] Chongqing Univ, Coll Mech & Vehicle Engn, State Key Lab Mech Transmiss, Chongqing 400000, Peoples R China
[2] Minist Ecol & Environm, Foreign Environm Cooperat Ctr, Beijing 100035, Peoples R China
基金
中国国家自然科学基金;
关键词
Three-dimensional displays; Pose estimation; Image edge detection; Feature extraction; Optimization; Solid modeling; Robots; 6D pose estimation; pose refinement; robotic assembly;
D O I
10.1109/LRA.2023.3327933
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Accurate 6D pose estimation of object is important for robot assembly. This letter presents a novel method for achieving high precision 6D pose estimation by exploiting the reprojection of 3D edges onto binocular RGB image pairs. Our proposed method encompasses three phases: detection, pose initialization, and pose refinement. In the detection phase, an existing detector is employed to identify the objects within the image pairs. Subsequently, the object image patch of interest is extracted and fed into an encoder-decoder network that leverages edge maps and RGB images for the purpose of initial pose estimation. To refine the initial pose and achieve precise 6D pose estimation, we introduce a novel binocular edge-map-based nonlinear optimization technique. Our primary contributions entail an improved initial pose estimation network and a novel pose optimization technique. The improved network is dedicated to enhancing the accuracy of initial pose estimation, while the optimization technique focuses on refining the precision of the estimations. Experimental results demonstrate the effectiveness of our method, yielding an average translation precision of 0.48 mm and rotation precision of 0.45 degrees. Consequently, our proposed method can be seamlessly integrated into robotic manipulation platforms to successfully execute diverse assembly tasks.
引用
收藏
页码:8319 / 8326
页数:8
相关论文
共 50 条
  • [31] 3-D object pose estimation for robotic assembly application
    Li, ST
    Zhao, DM
    VISUALIZATION AND OPTIMIZATION TECHNIQUES, 2001, 4553 : 61 - 71
  • [32] Survey on 6D Pose Estimation of Rigid Object
    Chen, Jiale
    Zhang, Lijun
    Liu, Yi
    Xu, Chi
    PROCEEDINGS OF THE 39TH CHINESE CONTROL CONFERENCE, 2020, : 7440 - 7445
  • [33] RPM 2.0: RF-Based Pose Machines for Multi-Person 3D Pose Estimation
    Xie, Chunyang
    Zhang, Dongheng
    Wu, Zhi
    Yu, Cong
    Hu, Yang
    Chen, Yan
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (01) : 490 - 503
  • [34] Temporally Consistent Object 6D Pose Estimation for Robot Control
    Zorina, Kateryna
    Priban, Vojtech
    Fourmy, Mederic
    Sivic, Josef
    Petrik, Vladimir
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2025, 10 (01): : 56 - 63
  • [35] NVR-Net: Normal Vector Guided Regression Network for Disentangled 6D Pose Estimation
    Feng, Guangkun
    Xu, Ting-Bing
    Liu, Fulin
    Liu, Mingkun
    Wei, Zhenzhong
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (02) : 1098 - 1113
  • [36] Data-driven method for 6D robot pose estimation
    Liu Z.
    Chen K.
    Xu J.
    Qinghua Daxue Xuebao/Journal of Tsinghua University, 2022, 62 (03): : 391 - 399
  • [37] 3D Model-based 6D Object Pose Tracking on RGB Images using Particle Filtering and Heuristic Optimization
    Majcher, Mateusz
    Kwolek, Bogdan
    PROCEEDINGS OF THE 15TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS, VOL 5: VISAPP, 2020, : 690 - 697
  • [38] 6D Pose Estimation of Industrial Parts Based on Point Cloud Geometric Information Prediction for Robotic Grasping
    Zhang, Qinglei
    Xue, Cuige
    Qin, Jiyun
    Duan, Jianguo
    Zhou, Ying
    ENTROPY, 2024, 26 (12)
  • [39] A Novel Depth and Color Feature Fusion Framework for 6D Object Pose Estimation
    Zhou, Guangliang
    Yan, Yi
    Wang, Deming
    Chen, Qijun
    IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23 : 1630 - 1639
  • [40] HYRE: Hybrid Regressor for 3D Human Pose and Shape Estimation
    Li, Wenhao
    Liu, Mengyuan
    Liu, Hong
    Ren, Bin
    Li, Xia
    You, Yingxuan
    Sebe, Nicu
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2025, 34 : 235 - 246