Grasping Pose Estimation for Robots Based on Convolutional Neural Networks

被引:3
作者
Zheng, Tianjiao [1 ,2 ]
Wang, Chengzhi [1 ]
Wan, Yanduo [1 ]
Zhao, Sikai [1 ]
Zhao, Jie [1 ]
Shan, Debin [2 ]
Zhu, Yanhe [1 ]
机构
[1] Harbin Inst Technol, State Key Lab Robot & Syst, Harbin 150001, Peoples R China
[2] Harbin Inst Technol, Sch Mat Sci & Engn, Harbin 150001, Peoples R China
基金
中国博士后科学基金; 国家重点研发计划;
关键词
robot grasping; pose estimation; convolutional neural network; deep learning; MODEL;
D O I
10.3390/machines11100974
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Robots gradually have the ability to plan grasping actions in unknown scenes by learning the manipulation of typical scenes. The grasping pose estimation method, as a kind of end-to-end method, has rapidly developed in recent years because of its good generalization. In this paper, we present a grasping pose estimation method for robots based on convolutional neural networks. In this method, a convolutional neural network model was employed, which can output the grasping success rate, approach angle, and gripper opening width for the input voxel. The grasping dataset was produced, and the model was trained in the physical simulator. A position optimization of the robotic grasping was proposed according to the distribution of the object centroid to improve the grasping success rate. An experimental platform for robot grasping was established, and 11 common everyday objects were selected for the experiments. Grasping experiments involving the eleven objects individually, multiple objects, as well as a dark environment without illumination, were performed. The results show that the method has the adaptability to grasp different geometric objects, including irregular shapes, and it is not influenced by lighting conditions. The total grasping success rate was 88.2% for the individual objects and 81.1% for the cluttered scene.
引用
收藏
页数:16
相关论文
共 50 条
  • [41] Pose estimation and behavior classification of broiler chickens based on deep neural networks
    Fang, Cheng
    Zhang, Tiemin
    Zheng, Haikun
    Huang, Junduan
    Cuan, Kaixuan
    COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2021, 180
  • [42] Crowd density estimation based on convolutional neural networks with mixed pooling
    Zhang, Li
    Zheng, Hong
    Zhang, Ying
    Zhang, Dongming
    JOURNAL OF ELECTRONIC IMAGING, 2017, 26 (05)
  • [43] A fast magnitude estimation method based on deep convolutional neural networks
    Wang ZiFa
    Liao JiAn
    Wang YanWei
    Wei DongLiang
    Zhao DengKe
    CHINESE JOURNAL OF GEOPHYSICS-CHINESE EDITION, 2023, 66 (01): : 272 - 288
  • [44] Road Scene Depth Estimation Based on Deep Convolutional Neural Networks
    Yuan Jianzhong
    Zhou Wujie
    Pan Ting
    Gu Pengli
    LASER & OPTOELECTRONICS PROGRESS, 2019, 56 (08)
  • [45] ML-based Power Estimation of Convolutional Neural Networks on GPGPUs
    Metz, Christopher A.
    Goli, Mehran
    Drechsler, Rolf
    2022 25TH INTERNATIONAL SYMPOSIUM ON DESIGN AND DIAGNOSTICS OF ELECTRONIC CIRCUITS AND SYSTEMS (DDECS), 2022, : 166 - 171
  • [46] Head Pose Estimation for an Omnidirectional Camera using a Convolutional Neural Network
    Yamaura, Yusuke
    Tsuboshita, Yukihiro
    Onishi, Takeshi
    PROCEEDINGS 2018 IEEE 13TH IMAGE, VIDEO, AND MULTIDIMENSIONAL SIGNAL PROCESSING WORKSHOP (IVMSP), 2018,
  • [47] A Novel Convolutional Neural Network for Head Detection and Pose Estimation in Complex Environments from Single-Depth Images
    Wang, Qi
    Lei, Hang
    Li, Gun
    Wang, Xupeng
    Chen, Lu
    COGNITIVE COMPUTATION, 2024, 16 (04) : 2116 - 2129
  • [48] Object Pose Estimation with Point Cloud Data for Robot Grasping
    Wu, Xingfang
    Qu, Weiming
    Zhang, Tao
    Luo, Dingsheng
    PROCEEDINGS OF 2022 IEEE INTERNATIONAL CONFERENCE ON MECHATRONICS AND AUTOMATION (IEEE ICMA 2022), 2022, : 1069 - 1074
  • [49] Gaze estimation using convolutional neural networks
    Karmi, Rawdha
    Rahmany, Ines
    Khlifa, Nawres
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (01) : 389 - 398
  • [50] UNSUPERVISED CONVOLUTIONAL NEURAL NETWORKS FOR MOTION ESTIMATION
    Ahmadi, Aria
    Patras, Ioannis
    2016 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2016, : 1629 - 1633