A Practical Robotic Grasping Method by Using 6-D Pose Estimation With Protective Correction

被引:27
|
作者
Zhang, Hui [1 ,2 ]
Liang, Zhicong [3 ]
Li, Chen [3 ]
Zhong, Hang [4 ]
Liu, Li [4 ]
Zhao, Chenyang [3 ]
Wang, Yaonan [4 ]
Wu, Q. M. Jonathan [5 ]
机构
[1] Hunan Univ, Sch Robot, Changsha 410012, Peoples R China
[2] Hunan Univ, Natl Engn Lab Robot Visual Percept & Control Tech, Changsha 410012, Peoples R China
[3] Changsha Univ Sci & Technol, Coll Elect & Informat Engn, Changsha 410012, Peoples R China
[4] Hunan Univ, Coll Elect & Informat Engn, Changsha 410082, Hunan, Peoples R China
[5] Univ Windsor, Dept Elect & Comp Engn, Windsor, ON N9B 3P4, Canada
基金
中国国家自然科学基金;
关键词
Pose estimation; Grasping; Three-dimensional displays; Robots; Feature extraction; Training; Solid modeling; Deep learning; point cloud segmentation; pose estimation; residual block; robotic grasping; vision detection;
D O I
10.1109/TIE.2021.3075836
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The pose estimation is the critical technology in industrial robot. Nowadays, many machine vision-based approaches have applied the technology and achieved excellent results. However, the rapid detection of the pose estimation in complex multiscene environments is still a challenge, due to the interference of multiangle light and multibackground. To address these issues, this article proposes a practical robotic grasping method by using the 6-D pose estimation with protective correction. In this method, the synthetic dataset by self-production is used to train the improved deep object pose estimation network and then use the standard perspective-n-point algorithm to estimate the 6-DoF pose for each object instance. Meanwhile, in order to prevent grasp collisions cause by misrecognition, we propose the corrected grasping pose algorithm for protective correction by measured translation and predicted translation. Finally, the proposed grasping method has an average grasping success rate of 83.3% for the three objects under normal light, and the network for single-image detection speed has been to 1.490 frames/s. The code is available at https://github.com/aimiplus/Practical_Robotic_Grasping_Method.
引用
收藏
页码:3876 / 3886
页数:11
相关论文
共 50 条
  • [1] A Depth Adaptive Feature Extraction and Dense Prediction Network for 6-D Pose Estimation in Robotic Grasping
    Liu, Xuebing
    Yuan, Xiaofang
    Zhu, Qing
    Wang, Yaonan
    Feng, Mingtao
    Zhou, Jiaming
    Zhou, Zhen
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2024, 20 (02) : 2727 - 2737
  • [2] Robotic grasping method with 6D pose estimation and point cloud fusion
    Ma, Haofei
    Wang, Gongcheng
    Bai, Hua
    Xia, Zhiyu
    Wang, Weidong
    Du, Zhijiang
    INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2024, 134 (11-12): : 5603 - 5613
  • [3] Weakly Supervised 6D Pose Estimation for Robotic Grasping
    Li, Yaoxin
    Sun, Jinghua
    Li, Xiaoqian
    Zhang, Zhanpeng
    Cheng, Hui
    Wang, Xiaogang
    PROCEEDINGS OF THE 16TH ACM SIGGRAPH INTERNATIONAL CONFERENCE ON VIRTUAL-REALITY CONTINUUM AND ITS APPLICATIONS IN INDUSTRY (VRCAI 2018), 2018,
  • [4] Robotic Continuous Grasping System by Shape Transformer-Guided Multiobject Category-Level 6-D Pose Estimation
    Liu, Jian
    Sun, Wei
    Liu, Chongpei
    Zhang, Xing
    Fu, Qiang
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2023, 19 (11) : 11171 - 11181
  • [5] Robotic Grasp Detection With 6-D Pose Estimation Based on Graph Convolution and Refinement
    Yu, Sheng
    Zhai, Di-Hua
    Xia, Yuanqing
    Wang, Wei
    Zhang, Chengyu
    Zhao, Shiqi
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2024, 54 (06): : 3783 - 3795
  • [6] MODELING AND INTERPRETING 6-D OBJECT POSE ESTIMATION
    Soler, Diego
    Hirata, Roberto, Jr.
    Espadoto, Mateus
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 2325 - 2329
  • [7] 6-D pose estimation method for large gear structure assembly using monocular vision
    Zhou, Kuai
    Huang, Xiang
    Li, Shuanggao
    Li, Hangyu
    Kong, Shengjie
    MEASUREMENT, 2021, 183
  • [8] Object pose estimation method for robotic arm grasping
    Huang C.
    Hou S.
    Journal of Intelligent and Fuzzy Systems, 2024, 46 (04): : 10787 - 10803
  • [9] 6-D Object Pose Estimation Based on Point Pair Matching for Robotic Grasp Detection
    Yu, Sheng
    Zhai, Di-Hua
    Zhan, Yufeng
    Wang, Wencai
    Guan, Yuyin
    Xia, Yuanqing
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024,
  • [10] 6-D Object Pose Estimation Using Multiscale Point Cloud Transformer
    Zhou, Guangliang
    Wang, Deming
    Yan, Yi
    Liu, Chengju
    Chen, Qijun
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72