Dynamic Obstacle Avoidance for Robotic Arms Using Deep Reinforcement Learning with Adaptive Reward Mechanisms

被引:0
作者
Yan, Sen [1 ]
Zhu, Yanping [2 ]
Chen, Wenlong [2 ]
Zhang, Jianqiang [2 ]
Zhu, Chenyang [1 ]
Chen, Qi [1 ]
机构
[1] Changzhou Univ, Sch Comp Sci & Artificial Intelligence, Yanzheng West 2468, Changzhou 213164, Peoples R China
[2] Changzhou Univ, Sch Wang Zheng Microelect, Yanzheng West 2468, Changzhou 213164, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2025年 / 15卷 / 08期
关键词
obstacle avoidance; deep reinforcement learning; reward function; robotic arm; ENVIRONMENTS; DESIGN;
D O I
10.3390/app15084496
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
To address the challenges of robotic arm path-planning in dynamic environments, this study proposes a reinforcement learning-based dynamic obstacle avoidance method. The study concerns a robot with six rotational degrees of freedom when moving outside of singular configurations, enabling more flexible and precise motion-planning. First, a dynamic exploration guidance mechanism is designed to enhance learning efficiency and reduce ineffective exploration. Second, an adaptive reward function is developed to enable real-time path-planning while avoiding obstacles. A simulation environment is constructed using CoppeliaSim software, and the experiment is performed with two cylindrical obstacles that move randomly within the workspace. The experimental results demonstrate that the improved method significantly outperforms traditional algorithms in terms of convergence speed, reward value, and success rate.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] Obstacle avoidance planning of autonomous vehicles using deep reinforcement learning
    Qian, Yubin
    Feng, Song
    Hu, Wenhao
    Wang, Wanqiu
    ADVANCES IN MECHANICAL ENGINEERING, 2022, 14 (12)
  • [2] Robot obstacle avoidance system using deep reinforcement learning
    Zhu, Xiaojun
    Liang, Yinghao
    Sun, Hanxu
    Wang, Xueqian
    Ren, Bin
    INDUSTRIAL ROBOT-THE INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH AND APPLICATION, 2022, 49 (02): : 301 - 310
  • [3] Robotic Arm Motion Planning with Autonomous Obstacle Avoidance Based on Deep Reinforcement Learning
    Yang, Shilin
    Wang, Qingling
    2022 41ST CHINESE CONTROL CONFERENCE (CCC), 2022, : 3692 - 3697
  • [4] MOBILE ROBOT OBSTACLE AVOIDANCE BASE ON DEEP REINFORCEMENT LEARNING
    Feng, Shumin
    Ren, Hailin
    Wang, Xinran
    Ben-Tzvi, Pinhas
    PROCEEDINGS OF THE ASME INTERNATIONAL DESIGN ENGINEERING TECHNICAL CONFERENCES AND COMPUTERS AND INFORMATION IN ENGINEERING CONFERENCE, 2019, VOL 5A, 2020,
  • [5] Agile DQN: adaptive deep recurrent attention reinforcement learning for autonomous UAV obstacle avoidance
    Fadi AlMahamid
    Katarina Grolinger
    Scientific Reports, 15 (1)
  • [6] OPTIMAL OBSTACLE AVOIDANCE STRATEGY USING DEEP REINFORCEMENT LEARNING BASED ON STEREO CAMERA
    Nguyen, Chi-Hung
    Vu, Quang-Anh
    Cong, Kim-Khol Phung
    Dang, Thai-Viet
    MM SCIENCE JOURNAL, 2024, 2024 : 7556 - 7561
  • [7] An obstacle avoidance method for robotic arm based on reinforcement learning
    Wu, Peng
    Su, Heng
    Dong, Hao
    Liu, Tengfei
    Li, Min
    Chen, Zhihao
    INDUSTRIAL ROBOT-THE INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH AND APPLICATION, 2025, 52 (01): : 9 - 17
  • [8] Reinforcement Learning with Dynamic Movement Primitives for Obstacle Avoidance
    Li, Ang
    Liu, Zhenze
    Wang, Wenrui
    Zhu, Mingchao
    Li, Yanhui
    Huo, Qi
    Dai, Ming
    APPLIED SCIENCES-BASEL, 2021, 11 (23):
  • [9] Depth-based Obstacle Avoidance through Deep Reinforcement Learning
    Wu, Keyu
    Esfahani, Mahdi Abolfazli
    Yuan, Shenghai
    Wang, Han
    PROCEEDINGS OF 2019 5TH INTERNATIONAL CONFERENCE ON MECHATRONICS AND ROBOTICS ENGINEERING (ICMRE 2019), 2019, : 102 - 106
  • [10] A UAV Indoor Obstacle Avoidance System Based on Deep Reinforcement Learning
    Lo, Chun-Huang
    Lee, Chung-Nan
    2023 ASIA PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE, APSIPA ASC, 2023, : 2137 - 2143