Dynamic Obstacle Avoidance for Robotic Arms Using Deep Reinforcement Learning with Adaptive Reward Mechanisms

被引:0
作者
Yan, Sen [1 ]
Zhu, Yanping [2 ]
Chen, Wenlong [2 ]
Zhang, Jianqiang [2 ]
Zhu, Chenyang [1 ]
Chen, Qi [1 ]
机构
[1] Changzhou Univ, Sch Comp Sci & Artificial Intelligence, Yanzheng West 2468, Changzhou 213164, Peoples R China
[2] Changzhou Univ, Sch Wang Zheng Microelect, Yanzheng West 2468, Changzhou 213164, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2025年 / 15卷 / 08期
关键词
obstacle avoidance; deep reinforcement learning; reward function; robotic arm; ENVIRONMENTS; DESIGN;
D O I
10.3390/app15084496
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
To address the challenges of robotic arm path-planning in dynamic environments, this study proposes a reinforcement learning-based dynamic obstacle avoidance method. The study concerns a robot with six rotational degrees of freedom when moving outside of singular configurations, enabling more flexible and precise motion-planning. First, a dynamic exploration guidance mechanism is designed to enhance learning efficiency and reduce ineffective exploration. Second, an adaptive reward function is developed to enable real-time path-planning while avoiding obstacles. A simulation environment is constructed using CoppeliaSim software, and the experiment is performed with two cylindrical obstacles that move randomly within the workspace. The experimental results demonstrate that the improved method significantly outperforms traditional algorithms in terms of convergence speed, reward value, and success rate.
引用
收藏
页数:17
相关论文
共 50 条
  • [21] OBSTACLE AVOIDANCE PLANNING OF GRAPE PICKING ROBOTS BASED ON DEEP REINFORCEMENT LEARNING
    Liu, Pei
    INMATEH-AGRICULTURAL ENGINEERING, 2024, 74 (03): : 797 - 807
  • [22] Path Planning of Mobile Robot in Dynamic Obstacle Avoidance Environment Based on Deep Reinforcement Learning
    Zhang, Qingfeng
    Ma, Wenpeng
    Zheng, Qingchun
    Zhai, Xiaofan
    Zhang, Wenqian
    Zhang, Tianchang
    Wang, Shuo
    IEEE ACCESS, 2024, 12 : 189136 - 189152
  • [23] An Obstacle Avoidance Method Using Asynchronous Policy-based Deep Reinforcement Learning with Discrete Action
    Wang, Yuechuan
    Yao, Fenxi
    Cui, Lingguo
    Chai, Senchun
    2022 34TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2022, : 6235 - 6241
  • [24] Obstacle Avoidance for Flight Safety of Unmanned Aerial Vehicles Using Deep Reinforcement Learning
    Chen, Guan-Ping
    Chen, Tzung-Shi
    Chen, Tzung-Cheng
    2024 IEEE VTS ASIA PACIFIC WIRELESS COMMUNICATIONS SYMPOSIUM, APWCS 2024, 2024,
  • [25] Pushing with Soft Robotic Arms via Deep Reinforcement Learning
    Alessi, Carlo
    Bianchi, Diego
    Stano, Gianni
    Cianchetti, Matteo
    Falotico, Egidio
    ADVANCED INTELLIGENT SYSTEMS, 2024, 6 (08)
  • [26] Hybrid Machine Learning and Reinforcement Learning Framework for Adaptive UAV Obstacle Avoidance
    Skarka, Wojciech
    Ashfaq, Rukhseena
    AEROSPACE, 2024, 11 (11)
  • [27] Generalization in Deep Reinforcement Learning for Robotic Navigation by Reward Shaping
    Miranda, Victor R. F.
    Neto, Armando A.
    Freitas, Gustavo M.
    Mozelli, Leonardo A.
    IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2024, 71 (06) : 6013 - 6020
  • [28] Learning obstacle avoidance and predation in complex reef environments with deep reinforcement learning
    Hou, Ji
    He, Changling
    Li, Tao
    Zhang, Chunze
    Zhou, Qin
    BIOINSPIRATION & BIOMIMETICS, 2024, 19 (05)
  • [29] Obstacle Avoidance Planning of Virtual Robot Picking Path Based on Deep Reinforcement Learning
    Xiong J.
    Li Z.
    Chen S.
    Zheng Z.
    Nongye Jixie Xuebao/Transactions of the Chinese Society for Agricultural Machinery, 2020, 51 : 1 - 10
  • [30] Deep Reinforcement Learning of Map-Based Obstacle Avoidance for Mobile Robot Navigation
    Chen G.
    Pan L.
    Chen Y.
    Xu P.
    Wang Z.
    Wu P.
    Ji J.
    Chen X.
    SN Computer Science, 2021, 2 (6)