Improved Q-Learning Algorithm Based on Flower Pollination Algorithm and Tabulation Method for Unmanned Aerial Vehicle Path Planning

被引:0
|
作者
Bo, Lan [1 ]
Zhang, Tiezhu [1 ]
Zhang, Hongxin [1 ]
Yang, Jian [1 ,2 ]
Zhang, Zhen [1 ]
Zhang, Caihong [3 ]
Liu, Mingjie [1 ]
机构
[1] Qingdao Univ, Coll Mech & Elect Engn, Qingdao 266071, Peoples R China
[2] Univ Sci & Technol Beijing, Sch Mech Engn, Beijing 100083, Peoples R China
[3] Qingdao Univ, Sch Automat, Qingdao 266071, Peoples R China
来源
IEEE ACCESS | 2024年 / 12卷
基金
中国国家自然科学基金;
关键词
Path planning; Q-learning; Flowering plants; Collision avoidance; Heuristic algorithms; Autonomous aerial vehicles; Convergence; unmanned aerial vehicle; obstacle avoidance; reinforcement learning; flower pollination algorithm; COLLISION-AVOIDANCE; NEURAL-NETWORKS; UAV;
D O I
10.1109/ACCESS.2024.3434621
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Planning a path is crucial for safe and efficient Unmanned aerial vehicle flights, especially in complex environments. While the Q-learning algorithm in reinforcement learning performs better in handling such environments, it suffers from slow convergence speed and limited real-time capability. To address these problems, this study proposes an enhanced initialization process using the flower pollination algorithm and employs a tabulation method to improve local obstacle avoidance ability. An improved Q-learning algorithm based on the flower pollination algorithm and tabulation method (IQ-FAT) is proposed, which can perform both global and local path planning, enhance the convergence time of Q-learning, and expedite obstacle avoidance. Evaluation results on various obstacle maps demonstrate that the modified algorithm has a significant improvement convergence speed of approximately 40% compared to the original algorithm while enabling global path planning and local obstacle avoidance. Furthermore, the algorithm demonstrates superior path-planning capabilities in complex environments and enhances the dynamic response time of UAVs by approximately 90% compared to the artificial potential field method.
引用
收藏
页码:104429 / 104444
页数:16
相关论文
共 50 条
  • [21] A Study on Path Planning of Unmanned Aerial Vehicle Based on Improved Genetic Algorithm
    Tao, Jihua
    Zhong, Chaoliang
    Gao, Li
    Deng, Hao
    2016 8TH INTERNATIONAL CONFERENCE ON INTELLIGENT HUMAN-MACHINE SYSTEMS AND CYBERNETICS (IHMSC), VOL. 2, 2016, : 392 - 395
  • [22] Round-trip path planning for unmanned aerial vehicle based on improved RRT* algorithm
    Yu C.
    Chen M.
    Yong K.
    Zhongguo Kexue Jishu Kexue/Scientia Sinica Technologica, 2023, 53 (11): : 1911 - 1921
  • [23] GUIDING UNMANNED AERIAL VEHICLE PATH PLANNING DESIGN BASED ON IMPROVED ANT COLONY ALGORITHM
    Wu, Wenzhi
    Wei, Ying
    MECHATRONIC SYSTEMS AND CONTROL, 2021, 49 (01): : 48 - 54
  • [24] UNMANNED AERIAL VEHICLE PATH PLANNING BASED ON TLBO ALGORITHM
    Yu, Guolin
    Song, Hui
    Gao, Jie
    INTERNATIONAL JOURNAL ON SMART SENSING AND INTELLIGENT SYSTEMS, 2014, 7 (03) : 1310 - 1325
  • [25] Hybrid Path Planning Algorithm of the Mobile Agent Based on Q-Learning
    Gao, Tengteng
    Li, Caihong
    Liu, Guoming
    Guo, Na
    Wang, Di
    Li, Yongdi
    AUTOMATIC CONTROL AND COMPUTER SCIENCES, 2022, 56 (02) : 130 - 142
  • [26] Unmanned Aerial Vehicle Path-Planning Method Based on Improved P-RRT* Algorithm
    Xu, Xing
    Zhang, Feifan
    Zhao, Yun
    ELECTRONICS, 2023, 12 (22)
  • [27] Q-Learning based system for Path Planning with Unmanned Aerial Vehicles swarms in obstacle environments
    Puente-Castro, Alejandro
    Rivero, Daniel
    Pedrosa, Eurico
    Pereira, Artur
    Lau, Nuno
    Fernandez-Blanco, Enrique
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 235
  • [28] Hybrid FWPS cooperation algorithm based unmanned aerial vehicle constrained path planning
    Zhang, Xiangyin
    Xia, Shuang
    Zhang, Tian
    Li, Xiuzhi
    AEROSPACE SCIENCE AND TECHNOLOGY, 2021, 118
  • [29] Dynamic Path Planning of a Mobile Robot with Improved Q-Learning algorithm
    Li, Siding
    Xu, Xin
    Zuo, Lei
    2015 IEEE INTERNATIONAL CONFERENCE ON INFORMATION AND AUTOMATION, 2015, : 409 - 414
  • [30] An Improved Path Planning Algorithm for Unmanned Aerial Vehicle Based on RRT-Connect
    Zhang, Denggui
    Xu, Yong
    Yao, Xingting
    2018 37TH CHINESE CONTROL CONFERENCE (CCC), 2018, : 4854 - 4858