Dynamic Obstacle Avoidance for Robotic Arms Using Deep Reinforcement Learning with Adaptive Reward Mechanisms

被引:0
作者
Yan, Sen [1 ]
Zhu, Yanping [2 ]
Chen, Wenlong [2 ]
Zhang, Jianqiang [2 ]
Zhu, Chenyang [1 ]
Chen, Qi [1 ]
机构
[1] Changzhou Univ, Sch Comp Sci & Artificial Intelligence, Yanzheng West 2468, Changzhou 213164, Peoples R China
[2] Changzhou Univ, Sch Wang Zheng Microelect, Yanzheng West 2468, Changzhou 213164, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2025年 / 15卷 / 08期
关键词
obstacle avoidance; deep reinforcement learning; reward function; robotic arm; ENVIRONMENTS; DESIGN;
D O I
10.3390/app15084496
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
To address the challenges of robotic arm path-planning in dynamic environments, this study proposes a reinforcement learning-based dynamic obstacle avoidance method. The study concerns a robot with six rotational degrees of freedom when moving outside of singular configurations, enabling more flexible and precise motion-planning. First, a dynamic exploration guidance mechanism is designed to enhance learning efficiency and reduce ineffective exploration. Second, an adaptive reward function is developed to enable real-time path-planning while avoiding obstacles. A simulation environment is constructed using CoppeliaSim software, and the experiment is performed with two cylindrical obstacles that move randomly within the workspace. The experimental results demonstrate that the improved method significantly outperforms traditional algorithms in terms of convergence speed, reward value, and success rate.
引用
收藏
页数:17
相关论文
共 50 条
  • [31] Deep Reinforcement Learning of Map-Based Obstacle Avoidance for Mobile Robot Navigation
    Chen G.
    Pan L.
    Chen Y.
    Xu P.
    Wang Z.
    Wu P.
    Ji J.
    Chen X.
    SN Computer Science, 2021, 2 (6)
  • [32] Autonomous Obstacle Avoidance Algorithm for Unmanned Aerial Vehicles Based on Deep Reinforcement Learning
    Gao, Yuan
    Ren, Ling
    Shi, Tianwei
    Xu, Teng
    Ding, Jianbang
    ENGINEERING LETTERS, 2024, 32 (03) : 650 - 660
  • [33] Goal-Oriented Obstacle Avoidance with Deep Reinforcement Learning in Continuous Action Space
    Cimurs, Reinis
    Lee, Jin Han
    Suh, Il Hong
    ELECTRONICS, 2020, 9 (03)
  • [34] Design of Multimodal Obstacle Avoidance Algorithm Based on Deep Reinforcement Learning
    Zhu, Wenming
    Gao, Xuan
    Wu, Haibin
    Chen, Jiawei
    Zhou, Xuehua
    Zhou, Zhiguo
    ELECTRONICS, 2025, 14 (01):
  • [35] Obstacle Avoidance Based on Deep Reinforcement Learning and Artificial Potential Field
    Han, Haoran
    Xi, Zhilong
    Cheng, Jian
    Lv, Maolong
    2023 9TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND ROBOTICS, ICCAR, 2023, : 215 - 220
  • [36] Deep reinforcement learning based proactive dynamic obstacle avoidance for safe human-robot collaboration
    Xia, Wanqing
    Lu, Yuqian
    Xu, Weiliang
    Xu, Xun
    MANUFACTURING LETTERS, 2024, 41 : 1246 - 1256
  • [37] Reinforcement Learning for Mobile Robot Obstacle Avoidance Under Dynamic Environments
    Huang, Liwei
    Qu, Hong
    Fu, Mingsheng
    Deng, Wu
    PRICAI 2018: TRENDS IN ARTIFICIAL INTELLIGENCE, PT I, 2018, 11012 : 441 - 453
  • [38] A Lunar Robot Obstacle Avoidance Planning Method Using Deep Reinforcement Learning for Data Fusion
    Hu, Ruijun
    Wang, Zhaokui
    2019 CHINESE AUTOMATION CONGRESS (CAC2019), 2019, : 5365 - 5370
  • [39] CMADRL: cross-modal attention based deep reinforcement learning for mobile robot's obstacle avoidance
    Lu, Zhaoqing
    He, Li
    Wang, Hongwei
    Yuan, Liang
    Xiao, Wendong
    Liu, Zhening
    Chen, Yaohua
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2025, 36 (03)
  • [40] Dynamic Obstacle Avoidance for USVs Using Cross-Domain Deep Reinforcement Learning and Neural Network Model Predictive Controller
    Li, Jianwen
    Chavez-Galaviz, Jalil
    Azizzadenesheli, Kamyar
    Mahmoudian, Nina
    SENSORS, 2023, 23 (07)