Improved Q-Learning Algorithm Based on Flower Pollination Algorithm and Tabulation Method for Unmanned Aerial Vehicle Path Planning

被引:0
作者
Bo, Lan [1 ]
Zhang, Tiezhu [1 ]
Zhang, Hongxin [1 ]
Yang, Jian [1 ,2 ]
Zhang, Zhen [1 ]
Zhang, Caihong [3 ]
Liu, Mingjie [1 ]
机构
[1] Qingdao Univ, Coll Mech & Elect Engn, Qingdao 266071, Peoples R China
[2] Univ Sci & Technol Beijing, Sch Mech Engn, Beijing 100083, Peoples R China
[3] Qingdao Univ, Sch Automat, Qingdao 266071, Peoples R China
来源
IEEE ACCESS | 2024年 / 12卷
基金
中国国家自然科学基金;
关键词
Path planning; Q-learning; Flowering plants; Collision avoidance; Heuristic algorithms; Autonomous aerial vehicles; Convergence; unmanned aerial vehicle; obstacle avoidance; reinforcement learning; flower pollination algorithm; COLLISION-AVOIDANCE; NEURAL-NETWORKS; UAV;
D O I
10.1109/ACCESS.2024.3434621
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Planning a path is crucial for safe and efficient Unmanned aerial vehicle flights, especially in complex environments. While the Q-learning algorithm in reinforcement learning performs better in handling such environments, it suffers from slow convergence speed and limited real-time capability. To address these problems, this study proposes an enhanced initialization process using the flower pollination algorithm and employs a tabulation method to improve local obstacle avoidance ability. An improved Q-learning algorithm based on the flower pollination algorithm and tabulation method (IQ-FAT) is proposed, which can perform both global and local path planning, enhance the convergence time of Q-learning, and expedite obstacle avoidance. Evaluation results on various obstacle maps demonstrate that the modified algorithm has a significant improvement convergence speed of approximately 40% compared to the original algorithm while enabling global path planning and local obstacle avoidance. Furthermore, the algorithm demonstrates superior path-planning capabilities in complex environments and enhances the dynamic response time of UAVs by approximately 90% compared to the artificial potential field method.
引用
收藏
页码:104429 / 104444
页数:16
相关论文
共 50 条
  • [41] Global path planning of unmanned vehicle based on improved A* algorithm
    Liang, Hao
    Du, Xiaofang
    PROCEEDINGS OF INTERNATIONAL CONFERENCE ON ALGORITHMS, SOFTWARE ENGINEERING, AND NETWORK SECURITY, ASENS 2024, 2024, : 176 - 184
  • [42] Hybrid Path Planning Algorithm of the Mobile Agent Based on Q-Learning
    Caihong Tengteng Gao
    Guoming Li
    Na Liu
    Di Guo
    Yongdi Wang
    Automatic Control and Computer Sciences, 2022, 56 : 130 - 142
  • [43] Hybrid Path Planning of A Quadrotor UAV Based on Q-Learning Algorithm
    Zhang, Tianze
    Huo, Xin
    Chen, Songlin
    Yang, Baoqing
    Zhang, Guojiang
    2018 37TH CHINESE CONTROL CONFERENCE (CCC), 2018, : 5415 - 5419
  • [44] Adaptive sensitivity decision based path planning algorithm for unmanned aerial vehicle with improved particle swarm optimization
    Liu, Yang
    Zhang, Xuejun
    Guan, Xiangmin
    Delahaye, Daniel
    AEROSPACE SCIENCE AND TECHNOLOGY, 2016, 58 : 92 - 102
  • [45] Path planning based on unmanned aerial vehicle performance with segmented cellular genetic algorithm
    Gezer, Ahmet
    Turan, Onder
    Baklacioglu, Tolga
    JOURNAL OF THE FACULTY OF ENGINEERING AND ARCHITECTURE OF GAZI UNIVERSITY, 2025, 40 (01): : 135 - 153
  • [46] Local Path Planning for Unmanned Surface Vehicle based on the Improved DWA Algorithm
    Tan, Zhikun
    Wei, Naxin
    Liu, Zhengfeng
    2022 41ST CHINESE CONTROL CONFERENCE (CCC), 2022, : 3820 - 3825
  • [47] Path planning for mobile robot based on improved ant colony Q-learning algorithm
    Cui, Mengru
    He, Maowei
    Chen, Hanning
    Liu, Kunpeng
    Hu, Yabao
    Zheng, Chen
    Wang, Xuliang
    INTERNATIONAL JOURNAL OF INTERACTIVE DESIGN AND MANUFACTURING - IJIDEM, 2025, 19 (04): : 3069 - 3087
  • [48] Adaptive Improved Q-Learning Path Planning Algorithm Based on Obstacle Learning Matrix and Artificial Potential Field
    Zhang, Lieping
    Chen, Hongyuan
    Shi, Xiaoxu
    Zou, Jianchu
    Wang, Yilin
    JOURNAL OF ELECTRICAL AND COMPUTER ENGINEERING, 2024, 2024 (01)
  • [49] A Q-learning based multi-strategy integrated artificial bee colony algorithm with application in unmanned vehicle path planning
    Ni, Xinrui
    Hu, Wei
    Fan, Qiaochu
    Cui, Yibing
    Qi, Chongkai
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 236
  • [50] Unmanned Aerial Vehicle Coverage Path Planning Algorithm Based on Cellular Automata
    Song, Zhihua
    Zhang, Han
    Liu, Fei
    Chen, Shitao
    Zhang, Fa
    PROCEEDINGS OF 2018 INTERNATIONAL CONFERENCE ON INFORMATION SYSTEMS AND COMPUTER AIDED EDUCATION (ICISCAE 2018), 2018, : 371 - 374