Improved Q-Learning Algorithm Based on Flower Pollination Algorithm and Tabulation Method for Unmanned Aerial Vehicle Path Planning

被引:0
作者
Bo, Lan [1 ]
Zhang, Tiezhu [1 ]
Zhang, Hongxin [1 ]
Yang, Jian [1 ,2 ]
Zhang, Zhen [1 ]
Zhang, Caihong [3 ]
Liu, Mingjie [1 ]
机构
[1] Qingdao Univ, Coll Mech & Elect Engn, Qingdao 266071, Peoples R China
[2] Univ Sci & Technol Beijing, Sch Mech Engn, Beijing 100083, Peoples R China
[3] Qingdao Univ, Sch Automat, Qingdao 266071, Peoples R China
来源
IEEE ACCESS | 2024年 / 12卷
基金
中国国家自然科学基金;
关键词
Path planning; Q-learning; Flowering plants; Collision avoidance; Heuristic algorithms; Autonomous aerial vehicles; Convergence; unmanned aerial vehicle; obstacle avoidance; reinforcement learning; flower pollination algorithm; COLLISION-AVOIDANCE; NEURAL-NETWORKS; UAV;
D O I
10.1109/ACCESS.2024.3434621
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Planning a path is crucial for safe and efficient Unmanned aerial vehicle flights, especially in complex environments. While the Q-learning algorithm in reinforcement learning performs better in handling such environments, it suffers from slow convergence speed and limited real-time capability. To address these problems, this study proposes an enhanced initialization process using the flower pollination algorithm and employs a tabulation method to improve local obstacle avoidance ability. An improved Q-learning algorithm based on the flower pollination algorithm and tabulation method (IQ-FAT) is proposed, which can perform both global and local path planning, enhance the convergence time of Q-learning, and expedite obstacle avoidance. Evaluation results on various obstacle maps demonstrate that the modified algorithm has a significant improvement convergence speed of approximately 40% compared to the original algorithm while enabling global path planning and local obstacle avoidance. Furthermore, the algorithm demonstrates superior path-planning capabilities in complex environments and enhances the dynamic response time of UAVs by approximately 90% compared to the artificial potential field method.
引用
收藏
页码:104429 / 104444
页数:16
相关论文
共 50 条
  • [31] Mobile robot path planning based on Q-learning algorithm
    Li, Shaochuan
    Wang, Xuiqing
    Hu, Liwei
    Liu, Ying
    2019 WORLD ROBOT CONFERENCE SYMPOSIUM ON ADVANCED ROBOTICS AND AUTOMATION (WRC SARA 2019), 2019, : 160 - 165
  • [32] An improved ant colony algorithm based on Q-Learning for route planning of autonomous vehicle
    Zhao, Liping
    Li, Feng
    Sun, Dongye
    Zhao, Zihan
    INTERNATIONAL JOURNAL OF COMPUTERS COMMUNICATIONS & CONTROL, 2024, 19 (03) : 1 - 15
  • [33] A Path Planning Method of Unmanned Aerial Vehicle
    Zhao, Peihai
    Wang, Mimi
    Cao, Ruihao
    2019 11TH INTERNATIONAL CONFERENCE ON INTELLIGENT HUMAN-MACHINE SYSTEMS AND CYBERNETICS (IHMSC 2019), VOL 2, 2019, : 202 - 206
  • [34] Research on Trajectory Planning Algorithm of Unmanned Aerial Vehicle Based on Improved A* algorithm
    Fang Mao-hui
    Xu Jun
    2017 INTERNATIONAL CONFERENCE ON COMPUTER SYSTEMS, ELECTRONICS AND CONTROL (ICCSEC), 2017, : 1348 - 1352
  • [35] A* algorithm based on adaptive expansion convolution for unmanned aerial vehicle path planning
    Xu, Yu
    Li, Yang
    Tai, Yubo
    Lu, Xiaohan
    Jia, Yaodong
    Wang, Yifan
    INTELLIGENT SERVICE ROBOTICS, 2024, 17 (03) : 521 - 531
  • [36] An Improved Artificial Potential Field based Path Planning Algorithm for Unmanned Aerial Vehicle in Dynamic Environments
    Chen, Shoufeng
    Yang, Zhihua
    Liu, Zhentao
    Jin, Haojie
    2017 INTERNATIONAL CONFERENCE ON SECURITY, PATTERN ANALYSIS, AND CYBERNETICS (SPAC), 2017, : 591 - 596
  • [37] Path Planning of an Unmanned Aerial Vehicle Based on a Multi-Strategy Improved Pelican Optimization Algorithm
    Qiu, Shaoming
    Dai, Jikun
    Zhao, Dongsheng
    BIOMIMETICS, 2024, 9 (10)
  • [38] Adaptive Q-learning path planning algorithm based on virtual target guidance
    Li Z.
    Hu X.
    Zhang Y.
    Xu J.
    Jisuanji Jicheng Zhizao Xitong/Computer Integrated Manufacturing Systems, CIMS, 2024, 30 (02): : 553 - 568
  • [39] Application of Improved Cuckoo Search Algorithm to Path Planning Unmanned Aerial Vehicle
    Xie, Cong
    Zheng, Hongqing
    INTELLIGENT COMPUTING THEORIES AND APPLICATION, ICIC 2016, PT I, 2016, 9771 : 722 - 729
  • [40] A novel hybrid improved dingo algorithm for unmanned aerial vehicle path planning
    Wang, Shoubin
    Lv, Xuanman
    Li, Youbing
    Jing, Lewei
    Fang, Xinchang
    Peng, Guili
    Zhou, Yuan
    Sun, Wenhao
    JOURNAL OF THE BRAZILIAN SOCIETY OF MECHANICAL SCIENCES AND ENGINEERING, 2025, 47 (01)