Improved Q-Learning Algorithm Based on Flower Pollination Algorithm and Tabulation Method for Unmanned Aerial Vehicle Path Planning

被引:0
|
作者
Bo, Lan [1 ]
Zhang, Tiezhu [1 ]
Zhang, Hongxin [1 ]
Yang, Jian [1 ,2 ]
Zhang, Zhen [1 ]
Zhang, Caihong [3 ]
Liu, Mingjie [1 ]
机构
[1] Qingdao Univ, Coll Mech & Elect Engn, Qingdao 266071, Peoples R China
[2] Univ Sci & Technol Beijing, Sch Mech Engn, Beijing 100083, Peoples R China
[3] Qingdao Univ, Sch Automat, Qingdao 266071, Peoples R China
来源
IEEE ACCESS | 2024年 / 12卷
基金
中国国家自然科学基金;
关键词
Path planning; Q-learning; Flowering plants; Collision avoidance; Heuristic algorithms; Autonomous aerial vehicles; Convergence; unmanned aerial vehicle; obstacle avoidance; reinforcement learning; flower pollination algorithm; COLLISION-AVOIDANCE; NEURAL-NETWORKS; UAV;
D O I
10.1109/ACCESS.2024.3434621
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Planning a path is crucial for safe and efficient Unmanned aerial vehicle flights, especially in complex environments. While the Q-learning algorithm in reinforcement learning performs better in handling such environments, it suffers from slow convergence speed and limited real-time capability. To address these problems, this study proposes an enhanced initialization process using the flower pollination algorithm and employs a tabulation method to improve local obstacle avoidance ability. An improved Q-learning algorithm based on the flower pollination algorithm and tabulation method (IQ-FAT) is proposed, which can perform both global and local path planning, enhance the convergence time of Q-learning, and expedite obstacle avoidance. Evaluation results on various obstacle maps demonstrate that the modified algorithm has a significant improvement convergence speed of approximately 40% compared to the original algorithm while enabling global path planning and local obstacle avoidance. Furthermore, the algorithm demonstrates superior path-planning capabilities in complex environments and enhances the dynamic response time of UAVs by approximately 90% compared to the artificial potential field method.
引用
收藏
页码:104429 / 104444
页数:16
相关论文
共 50 条
  • [1] Path planning for unmanned surface vehicle based on improved Q-Learning algorithm
    Wang, Yuanhui
    Lu, Changzhou
    Wu, Peng
    Zhang, Xiaoyue
    OCEAN ENGINEERING, 2024, 292
  • [2] Quality-Oriented Hybrid Path Planning Based on A* and Q-Learning for Unmanned Aerial Vehicle
    Li, Dongcheng
    Yin, Wangping
    Wong, W. Eric
    Jian, Mingyong
    Chau, Matthew
    IEEE ACCESS, 2022, 10 : 7664 - 7674
  • [3] A path planning method for unmanned aerial vehicle based on improved wolf pack algorithm
    Jiang, Hao
    Yu, Qizhou
    Han, Dan
    Chen, Yaqing
    Li, Zejun
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2024, 36 (14)
  • [4] Simulation for Path Planning of Autonomous Underwater Vehicle Using Flower Pollination Algorithm, Genetic Algorithm and Q-Learning
    Gautam, Utkarsh
    Malmathanraj, R.
    Srivastav, Chhavi
    2015 INTERNATIONAL CONFERENCE ON COGNITIVE COMPUTING AND INFORMATION PROCESSING (CCIP), 2015,
  • [5] A Path Planning Algorithm for UAV Based on Improved Q-Learning
    Yan, Chao
    Xiang, Xiaojia
    2018 2ND INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION SCIENCES (ICRAS), 2018, : 46 - 50
  • [6] Neighborhood global learning based flower pollination algorithm and its application to unmanned aerial vehicle path planning
    Chen, Yang
    Pi, Dechang
    Xu, Yue
    EXPERT SYSTEMS WITH APPLICATIONS, 2021, 170
  • [7] Unmanned Aerial Vehicle Path Planning Based on Improved DDQN Algorithm
    Chen, Desheng
    Wen, Jiabao
    Xi, Meng
    Xiao, Shuai
    Yang, Jiachen
    19TH IEEE INTERNATIONAL SYMPOSIUM ON BROADBAND MULTIMEDIA SYSTEMS AND BROADCASTING, BMSB 2024, 2024, : 599 - 604
  • [8] An Improved Flower Pollination Algorithm for Optimal Unmanned Undersea Vehicle Path Planning Problem
    Zhou, Yongquan
    Wang, Rui
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2016, 30 (04)
  • [9] An immune plasma algorithm with Q-learning based pandemic management for path planning of unmanned aerial vehicles
    Aslan, Selcuk
    Demirci, Sercan
    EGYPTIAN INFORMATICS JOURNAL, 2024, 26
  • [10] ETQ-learning: an improved Q-learning algorithm for path planning
    Wang, Huanwei
    Jing, Jing
    Wang, Qianlv
    He, Hongqi
    Qi, Xuyan
    Lou, Rui
    INTELLIGENT SERVICE ROBOTICS, 2024, 17 (04) : 915 - 929