Dynamic Obstacle Avoidance for Robotic Arms Using Deep Reinforcement Learning with Adaptive Reward Mechanisms

被引:0
作者
Yan, Sen [1 ]
Zhu, Yanping [2 ]
Chen, Wenlong [2 ]
Zhang, Jianqiang [2 ]
Zhu, Chenyang [1 ]
Chen, Qi [1 ]
机构
[1] Changzhou Univ, Sch Comp Sci & Artificial Intelligence, Yanzheng West 2468, Changzhou 213164, Peoples R China
[2] Changzhou Univ, Sch Wang Zheng Microelect, Yanzheng West 2468, Changzhou 213164, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2025年 / 15卷 / 08期
关键词
obstacle avoidance; deep reinforcement learning; reward function; robotic arm; ENVIRONMENTS; DESIGN;
D O I
10.3390/app15084496
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
To address the challenges of robotic arm path-planning in dynamic environments, this study proposes a reinforcement learning-based dynamic obstacle avoidance method. The study concerns a robot with six rotational degrees of freedom when moving outside of singular configurations, enabling more flexible and precise motion-planning. First, a dynamic exploration guidance mechanism is designed to enhance learning efficiency and reduce ineffective exploration. Second, an adaptive reward function is developed to enable real-time path-planning while avoiding obstacles. A simulation environment is constructed using CoppeliaSim software, and the experiment is performed with two cylindrical obstacles that move randomly within the workspace. The experimental results demonstrate that the improved method significantly outperforms traditional algorithms in terms of convergence speed, reward value, and success rate.
引用
收藏
页数:17
相关论文
共 50 条
  • [41] Cascaded Fuzzy Reward Mechanisms in Deep Reinforcement Learning for Comprehensive Path Planning in Textile Robotic Systems
    Zhao, Di
    Ding, Zhenyu
    Li, Wenjie
    Zhao, Sen
    Du, Yuhong
    [J]. APPLIED SCIENCES-BASEL, 2024, 14 (02):
  • [42] Obstacle avoidance of redundant manipulators using neural networks based reinforcement learning
    Duguleana, Mihai
    Barbuceanu, Florin Grigore
    Teirelbar, Ahmed
    Mogan, Gheorghe
    [J]. ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING, 2012, 28 (02) : 132 - 146
  • [43] Real-time obstacle avoidance with deep reinforcement learning * Three-Dimensional Autonomous Obstacle Avoidance for UAV
    Yang, Songyue
    Meng, Zhijun
    Chen, Xuzhi
    Xie, Ronglei
    [J]. PROCEEDINGS OF THE 2019 INTERNATIONAL CONFERENCE ON ROBOTICS, INTELLIGENT CONTROL AND ARTIFICIAL INTELLIGENCE (RICAI 2019), 2019, : 324 - 329
  • [44] Safe Reinforcement Learning and Adaptive Optimal Control With Applications to Obstacle Avoidance Problem
    Wang, Ke
    Mu, Chaoxu
    Ni, Zhen
    Liu, Derong
    [J]. IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2024, 21 (03) : 4599 - 4612
  • [45] Monocular Camera-Based Complex Obstacle Avoidance via Efficient Deep Reinforcement Learning
    Ding, Jianchuan
    Gao, Lingping
    Liu, Wenxi
    Piao, Haiyin
    Pan, Jia
    Du, Zhenjun
    Yang, Xin
    Yin, Baocai
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (02) : 756 - 770
  • [46] Multi-Objective Optimal Trajectory Planning for Robotic Arms Using Deep Reinforcement Learning
    Zhang, Shaobo
    Xia, Qinxiang
    Chen, Mingxing
    Cheng, Sizhu
    [J]. SENSORS, 2023, 23 (13)
  • [47] Dynamic Positioning using Deep Reinforcement Learning
    Overeng, Simen Sem
    Nguyen, Dong Trong
    Hamre, Geir
    [J]. OCEAN ENGINEERING, 2021, 235
  • [48] The autonomous navigation and obstacle avoidance for USVs with ANOA deep reinforcement learning method
    Wu, Xing
    Chen, Haolei
    Chen, Changgu
    Zhong, Mingyu
    Xie, Shaorong
    Guo, Yike
    Fujita, Hamido
    [J]. KNOWLEDGE-BASED SYSTEMS, 2020, 196 (196)
  • [49] Autonomous Obstacle Avoidance and Target Tracking of UAV Based on Deep Reinforcement Learning
    Xu, Guoqiang
    Jiang, Weilai
    Wang, Zhaolei
    Wang, Yaonan
    [J]. JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2022, 104 (04)
  • [50] Comparison of Deep Reinforcement Learning Policies to Formal Methods for Moving Obstacle Avoidance
    Garg, Arpit
    Chiang, Hao-Tien Lewis
    Sugaya, Satomi
    Faust, Aleksandra
    Tapia, Lydia
    [J]. 2019 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2019, : 3534 - 3541