Natural object manipulation using anthropomorphic robotic hand through deep reinforcement learning and deep grasping probability network

被引:0
|
作者
Edwin Valarezo Añazco
Patricio Rivera Lopez
Nahyeon Park
Jiheon Oh
Gahyeon Ryu
Mugahed A. Al-antari
Tae-Seong Kim
机构
[1] Kyung Hee University,Department of Biomedical Engineering, College of Electronics and Information
来源
Applied Intelligence | 2021年 / 51卷
关键词
Anthropomorphic robotic hand; Natural object grasping and relocation; Deep reinforcement learning; Human grasping hand poses; Deep grasping probability network; Natural policy gradient;
D O I
暂无
中图分类号
学科分类号
摘要
Human hands can perform complex manipulation of various objects. It is beneficial if anthropomorphic robotic hands can manipulate objects like human hands. However, it is still a challenge due to the high dimensionality and a lack of machine intelligence. In this work, we propose a novel framework based on Deep Reinforcement Learning (DRL) with Deep Grasping Probability Network (DGPN) to grasp and relocate various objects with an anthropomorphic robotic hand much like a human hand. DGPN is used to predict the probability of successful human-like natural grasping based on the priors of human grasping hand poses and object touch areas. Thus, our DRL with DGPN rewards natural grasping hand poses according to object geometry for successful human-like manipulation of objects. The proposed DRL with DGPN is evaluated by grasping and relocating five objects including apple, light bulb, cup, bottle, and can. The performance of our DRL with DGPN is compared with the standard DRL without DGPN. The results show that the standard DRL only achieves an average success rate of 22.60%, whereas our DRL with DGPN achieves 89.40% for the grasping and relocation tasks of the objects.
引用
收藏
页码:1041 / 1055
页数:14
相关论文
共 50 条
  • [1] Natural object manipulation using anthropomorphic robotic hand through deep reinforcement learning and deep grasping probability network
    Valarezo Anazco, Edwin
    Rivera Lopez, Patricio
    Park, Nahyeon
    Oh, Jiheon
    Ryu, Gahyeon
    Al-antari, Mugahed A.
    Kim, Tae-Seong
    APPLIED INTELLIGENCE, 2021, 51 (02) : 1041 - 1055
  • [2] Object Manipulation with an Anthropomorphic Robotic Hand via Deep Reinforcement Learning with a Synergy Space of Natural Hand Poses
    Rivera, Patricio
    Valarezo Anazco, Edwin
    Kim, Tae-Seong
    SENSORS, 2021, 21 (16)
  • [3] Human-like Object Grasping and Relocation for an Anthropomorphic Robotic Hand with Natural Hand Pose Priors in Deep Reinforcement Learning
    Valarezo Anazco, Edwin
    Lopez, Patricio Rivera
    Park, Hyemin
    Park, Nahyeon
    Oh, Jiheon
    Lee, Sangmin
    Byun, Kyungmin
    Kim, Tae-Seong
    ICRSA 2019: 2019 2ND INTERNATIONAL CONFERENCE ON ROBOT SYSTEMS AND APPLICATIONS, 2019, : 46 - 50
  • [4] Dexterous Object Manipulation with an Anthropomorphic Robot Hand via Natural Hand Pose Transformer and Deep Reinforcement Learning
    Lopez, Patricio Rivera
    Oh, Ji-Heon
    Jeong, Jin Gyun
    Jung, Hwanseok
    Lee, Jin Hyuk
    Jaramillo, Ismael Espinoza
    Chola, Channabasava
    Lee, Won Hee
    Kim, Tae-Seong
    APPLIED SCIENCES-BASEL, 2023, 13 (01):
  • [5] Robotic Grasping using Deep Reinforcement Learning
    Joshi, Shirin
    Kumra, Sulabh
    Sahin, Ferat
    2020 IEEE 16TH INTERNATIONAL CONFERENCE ON AUTOMATION SCIENCE AND ENGINEERING (CASE), 2020, : 1461 - 1466
  • [6] Synergistic Pushing and Grasping for Enhanced Robotic Manipulation Using Deep Reinforcement Learning
    Shiferaw, Birhanemeskel Alamir
    Agidew, Tayachew F.
    Alzahrani, Ali Saeed
    Srinivasagan, Ramasamy
    ACTUATORS, 2024, 13 (08)
  • [7] Reward Shaping to Learn Natural Object Manipulation With an Anthropomorphic Robotic Hand and Hand Pose Priors via On-Policy Reinforcement Learning
    Rivera, Patricio
    Oh, Jiheon
    Valarezo, Edwin
    Ryu, Gahyeon
    Jung, Hwanseok
    Lee, Jin Hyunk
    Jeong, Jin Gyun
    Kim, Tae-Seong
    12TH INTERNATIONAL CONFERENCE ON ICT CONVERGENCE (ICTC 2021): BEYOND THE PANDEMIC ERA WITH ICT CONVERGENCE INNOVATION, 2021, : 167 - 171
  • [8] Composable Deep Reinforcement Learning for Robotic Manipulation
    Haarnoja, Tuomas
    Pong, Vitchyr
    Zhou, Aurick
    Dalal, Murtaza
    Abbeel, Pieter
    Levine, Sergey
    2018 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2018, : 6244 - 6251
  • [9] Vision-Based Robotic Object Grasping-A Deep Reinforcement Learning Approach
    Chen, Ya-Ling
    Cai, Yan-Rou
    Cheng, Ming-Yang
    MACHINES, 2023, 11 (02)
  • [10] Deep reinforcement learning based moving object grasping
    Chen, Pengzhan
    Lu, Weiqing
    INFORMATION SCIENCES, 2021, 565 : 62 - 76