Deep reinforcement learning and robust SLAM based robotic control algorithm for self-driving path optimization

被引:0
|
作者
Khan, Samiullah [1 ]
Niaz, Ashfaq [1 ]
Yinke, Dou [1 ]
Shoukat, Muhammad Usman [2 ]
Nawaz, Saqib Ali [3 ]
机构
[1] Taiyuan Univ Technol, Coll Elect & Power Engn, Taiyuan, Peoples R China
[2] Wuhan Univ Technol, Sch Automot Engn, Hubei Key Lab Adv Technol Automot Components, Wuhan, Peoples R China
[3] Hainan Univ, Sch Informat & Commun Engn, Haikou, Peoples R China
来源
FRONTIERS IN NEUROROBOTICS | 2025年 / 18卷
基金
中国国家自然科学基金;
关键词
autonomous navigation; robotic control; path tracking; deep reinforcement learning; SLAM; RS-DDPG algorithm;
D O I
10.3389/fnbot.2024.1428358
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A reward shaping deep deterministic policy gradient (RS-DDPG) and simultaneous localization and mapping (SLAM) path tracking algorithm is proposed to address the issues of low accuracy and poor robustness of target path tracking for robotic control during maneuver. RS-DDPG algorithm is based on deep reinforcement learning (DRL) and designs a reward function to optimize the parameters of DDPG to achieve the required tracking accuracy and stability. A visual SLAM algorithm based on semantic segmentation and geometric information is proposed to address the issues of poor robustness and susceptibility to interference from dynamic objects in dynamic scenes for SLAM based on visual sensors. Using the Apollo autonomous driving simulation platform, simulation experiments were conducted on the actual DDPG algorithm and the improved RS-DDPG path-tracking control algorithm. The research results indicate that the proposed RS-DDPG algorithm outperforms the DDPG algorithm in terms of path tracking accuracy and robustness. The results showed that it effectively improved the performance of visual SLAM systems in dynamic scenarios.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] ICRAN: Intelligent Control for Self-Driving RAN Based on Deep Reinforcement Learning
    Ahmed, Azza H.
    Elmokashfi, Ahmed
    IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2022, 19 (03): : 2751 - 2766
  • [2] A Deep Reinforcement Learning Method for Self-driving
    Fang, Yong
    Gu, Jianfeng
    INTELLIGENT COMPUTING THEORIES AND APPLICATION, PT II, 2018, 10955 : 143 - 152
  • [3] Toward self-driving processes: A deep reinforcement learning approach to control
    Spielberg, Steven
    Tulsyan, Aditya
    Lawrence, Nathan P.
    Loewen, Philip D.
    Gopaluni, R. Bhushan
    AICHE JOURNAL, 2019, 65 (10)
  • [4] Deep Reinforcement Learning with external control: Self-driving car application
    Youssef, Fenjiro
    Houda, Benbrahim
    4TH INTERNATIONAL CONFERENCE ON SMART CITY APPLICATIONS (SCA' 19), 2019,
  • [5] Deep imitation reinforcement learning for self-driving by vision
    Zou, Qijie
    Xiong, Kang
    Fang, Qiang
    Jiang, Bohan
    CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY, 2021, 6 (04) : 493 - 503
  • [6] Path planning of robotic arm based on deep reinforcement learning algorithm
    Al-Gabalawy M.
    Advanced Control for Applications: Engineering and Industrial Systems, 2022, 4 (01):
  • [7] Reinforcement Learning for Vision-Based Lateral Control of a Self-Driving Car
    Huang, Mengzhe
    Zhao, Mingyu
    Parikh, Parthiv
    Wang, Yebin
    Ozbay, Kaan
    Jiang, Zhong-Ping
    2019 IEEE 15TH INTERNATIONAL CONFERENCE ON CONTROL AND AUTOMATION (ICCA), 2019, : 1126 - 1131
  • [8] Path tracking control based on Deep reinforcement learning in Autonomous driving
    Jiang, Le
    Wang, Yafei
    Wang, Lin
    Wu, Jingkai
    2019 3RD CONFERENCE ON VEHICLE CONTROL AND INTELLIGENCE (CVCI), 2019, : 414 - 419
  • [9] Deep Reinforcement Learning based Planning for Urban Self-driving with Demonstration and Depth Completion
    Wang, Chuyao
    Aouf, Nabil
    2021 21ST INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND SYSTEMS (ICCAS 2021), 2021, : 962 - 967
  • [10] Self-driving network and service coordination using deep reinforcement learning
    Schneider, Stefan
    Manzoor, Adnan
    Qarawlus, Haydar
    Schellenberg, Rafael
    Karl, Holger
    Khalili, Ramin
    Hecker, Artur
    16th International Conference on Network and Service Management, CNSM 2020, 2nd International Workshop on Analytics for Service and Application Management, AnServApp 2020 and 1st International Workshop on the Future Evolution of Internet Protocols, IPFuture 2020, 2020,