Fuzzy A* quantum multi-stage Q-learning artificial potential field for path planning of mobile robots

被引:1
|
作者
Hu, Likun [1 ]
Wei, Chunyou [1 ]
Yin, Linfei [1 ]
机构
[1] Guangxi Univ, Guangxi Key Lab Power Syst Optimizat & Energy Tech, Nanning 530004, Guangxi, Peoples R China
基金
中国国家自然科学基金;
关键词
Reinforcement learning; Quantum calculation; Fuzzy system; Path planning; Real-time intelligent automation; ALGORITHM;
D O I
10.1016/j.engappai.2024.109866
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Aiming at problem of the efficiency of mobile robots heavily depends on the employed path-planning algorithms that encounter significant challenges from dynamic obstacles and complex environments. This work develops a fuzzy A* quantum multi-stage Q-learning artificial potential field approach, which combines fuzzy A*, quantum multi-stage Q-learning, and artificial potential field (APF) algorithms. The fuzzy A* quantum multi-stage Qlearning APF algorithm combines a fuzzy system with an A* algorithm to improve the A* algorithm. In addition, the fuzzy A* quantum multi-stage Q-learning APF algorithm applies quantum computing methods and multistage training methods to improve the convergence speed of the Q-learning algorithm. If dynamic obstacles exist in environments and dynamic obstacles can block the global path, the obtained A* path points are a dopted as sub-goal points for the APF to plan paths. If mobile robots fall into trap areas, the quantum multi-stage Qlearning is then invoked to plan a path between the local minimum trap and the sub-goal point. Except for escaping the local minimum trap, the proposed fuzzy A* quantum multi-stage Q-learning APF has the advantage of consuming less time. The study tests the fuzzy A* quantum multi-stage Q-learning APF on environments with narrow passages and traps. The results verify that the proposed fuzzy A* quantum multi-stage Q-learning APF can navigate beyond complex environment situations and break free from local minimum traps.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] Path planning of mobile robots with Q-learning
    Cetin, Halil
    Durdu, Akif
    2014 22ND SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2014, : 2162 - 2165
  • [2] Online path planning of cooperative mobile robots in unknown environments using improved Q-Learning and adaptive artificial potential field
    Ataollahi, Melika
    Farrokhi, Mohammad
    JOURNAL OF ENGINEERING-JOE, 2023, 2023 (02):
  • [3] A path planning approach for mobile robots using short and safe Q-learning
    Du, He
    Hao, Bing
    Zhao, Jianshuo
    Zhang, Jiamin
    Wang, Qi
    Yuan, Qi
    PLOS ONE, 2022, 17 (09):
  • [4] Optimal path planning approach based on Q-learning algorithm for mobile robots
    Maoudj, Abderraouf
    Hentout, Abdelfetah
    APPLIED SOFT COMPUTING, 2020, 97
  • [5] A Path-Planning Approach Based on Potential and Dynamic Q-Learning for Mobile Robots in Unknown Environment
    Hao, Bing
    Du, He
    Zhao, Jianshuo
    Zhang, Jiamin
    Wang, Qi
    COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2022, 2022
  • [6] Dynamic fuzzy Q-Learning and control of mobile robots
    Deng, C
    Er, MJ
    Xu, J
    2004 8TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION, ROBOTICS AND VISION, VOLS 1-3, 2004, : 2336 - 2341
  • [7] PATH PLANNING FOR TWO MOBILE ROBOTS BY USING ARTIFICIAL POTENTIAL FIELD
    Nooraliei, Amir
    Altun, Adem Alpaslan
    PROCEEDINGS OF THE 2ND INTERNATIONAL CONFERENCE ON ADVANCED COMPUTER THEORY AND ENGINEERING (ICACTE 2009), VOLS 1 AND 2, 2009, : 381 - 389
  • [8] Adaptive Improved Q-Learning Path Planning Algorithm Based on Obstacle Learning Matrix and Artificial Potential Field
    Zhang, Lieping
    Chen, Hongyuan
    Shi, Xiaoxu
    Zou, Jianchu
    Wang, Yilin
    JOURNAL OF ELECTRICAL AND COMPUTER ENGINEERING, 2024, 2024 (01)
  • [9] Mobile robot path planning based on the fuzzy artificial potential field
    Huang, Bing-Qiang
    Cao, Guang-Yi
    Shanghai Ligong Daxue Xuebao/Journal of University of Shanghai for Science and Technology, 2006, 28 (04): : 347 - 350
  • [10] Application of artificial neural network based on Q-learning for mobile robot path planning
    Li, Caihong
    Zhang, Jingyuan
    Li, Yibin
    2006 IEEE INTERNATIONAL CONFERENCE ON INFORMATION ACQUISITION, VOLS 1 AND 2, CONFERENCE PROCEEDINGS, 2006, : 978 - 982