6D Pose Estimation Based on 3D Edge Binocular Reprojection Optimization for Robotic Assembly

被引:5
|
作者
Li, Dong [1 ]
Mu, Quan [2 ]
Yuan, Yilin [1 ]
Wu, Shiwei [1 ]
Tian, Ye [1 ]
Hong, Hualin [1 ]
Jiang, Qian [1 ]
Liu, Fei [1 ]
机构
[1] Chongqing Univ, Coll Mech & Vehicle Engn, State Key Lab Mech Transmiss, Chongqing 400000, Peoples R China
[2] Minist Ecol & Environm, Foreign Environm Cooperat Ctr, Beijing 100035, Peoples R China
基金
中国国家自然科学基金;
关键词
Three-dimensional displays; Pose estimation; Image edge detection; Feature extraction; Optimization; Solid modeling; Robots; 6D pose estimation; pose refinement; robotic assembly;
D O I
10.1109/LRA.2023.3327933
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Accurate 6D pose estimation of object is important for robot assembly. This letter presents a novel method for achieving high precision 6D pose estimation by exploiting the reprojection of 3D edges onto binocular RGB image pairs. Our proposed method encompasses three phases: detection, pose initialization, and pose refinement. In the detection phase, an existing detector is employed to identify the objects within the image pairs. Subsequently, the object image patch of interest is extracted and fed into an encoder-decoder network that leverages edge maps and RGB images for the purpose of initial pose estimation. To refine the initial pose and achieve precise 6D pose estimation, we introduce a novel binocular edge-map-based nonlinear optimization technique. Our primary contributions entail an improved initial pose estimation network and a novel pose optimization technique. The improved network is dedicated to enhancing the accuracy of initial pose estimation, while the optimization technique focuses on refining the precision of the estimations. Experimental results demonstrate the effectiveness of our method, yielding an average translation precision of 0.48 mm and rotation precision of 0.45 degrees. Consequently, our proposed method can be seamlessly integrated into robotic manipulation platforms to successfully execute diverse assembly tasks.
引用
收藏
页码:8319 / 8326
页数:8
相关论文
共 50 条
  • [41] Dual-Path Transformer for 3D Human Pose Estimation
    Zhou, Lu
    Chen, Yingying
    Wang, Jinqiao
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (05) : 3260 - 3270
  • [42] Locally Connected Network for Monocular 3D Human Pose Estimation
    Ci, Hai
    Ma, Xiaoxuan
    Wang, Chunyu
    Wang, Yizhou
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (03) : 1429 - 1442
  • [43] 3D Coordinate Calculation and Pose Estimation of Power Meter based on Binocular Stereo Vision
    Huang, Qingdan
    Mo, Wenxiong
    Pei, Liqiang
    Zeng, Lian
    2019 8TH INTERNATIONAL CONFERENCE ON SOFTWARE AND COMPUTER APPLICATIONS (ICSCA 2019), 2019, : 282 - 285
  • [44] Model-Based Underwater 6D Pose Estimation From RGB
    Sapienza D.
    Govi E.
    Aldhaheri S.
    Bertogna M.
    Roura E.
    Pairet E.
    Verucchi M.
    Ardon P.
    IEEE Robotics and Automation Letters, 2023, 8 (11) : 7535 - 7542
  • [45] An Improved 6D Pose Estimation Method Based on Point Pair Feature
    Wang, Guokang
    Yang, Lei
    Liu, Yanhong
    PROCEEDINGS OF THE 32ND 2020 CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2020), 2020, : 455 - 460
  • [46] 3D driver pose estimation based on joint 2D-3D network
    Yao, Zhijie
    Liu, Yazhou
    Ji, Zexuan
    Sun, Quansen
    Lasang, Pongsak
    Shen, Shengmei
    IET COMPUTER VISION, 2020, 14 (03) : 84 - 91
  • [47] ZeroPose: CAD-Prompted Zero-Shot Object 6D Pose Estimation in Cluttered Scenes
    Chen, Jianqiu
    Zhou, Zikun
    Sun, Mingshan
    Zhao, Rui
    Wu, Liwei
    Bao, Tianpeng
    He, Zhenyu
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2025, 35 (02) : 1251 - 1264
  • [48] 6D Pose Estimation for Subsea Intervention in Turbid Waters
    Mohammed, Ahmed
    Kvam, Johannes
    Thielemann, Jens T.
    Haugholt, Karl H.
    Risholm, Petter
    ELECTRONICS, 2021, 10 (19)
  • [49] 3D Hand Pose Estimation via Graph-Based Reasoning
    Song, Jae-Hun
    Kang, Suk-Ju
    IEEE ACCESS, 2021, 9 : 35824 - 35833
  • [50] Graph neural network for 6D object pose estimation
    Yin, Pengshuai
    Ye, Jiayong
    Lin, Guoshen
    Wu, Qingyao
    KNOWLEDGE-BASED SYSTEMS, 2021, 218