Biologically Inspired Complete Coverage Path Planning Algorithm Based on Q-Learning

被引:11
|
作者
Tan, Xiangquan [1 ]
Han, Linhui [2 ]
Gong, Hao [2 ]
Wu, Qingwen [1 ,2 ]
机构
[1] Chinese Acad Sci, Changchun Inst Opt Fine Mech & Phys, CAS Key Lab Onorbit Mfg & Integrat Space Opt Syst, Changchun 130033, Peoples R China
[2] Univ Chinese Acad Sci, Res Ctr Mat & Optoelect, Beijing 100049, Peoples R China
关键词
complete coverage path planning; biologically inspired neural network; Q-learning; mobile robot;
D O I
10.3390/s23104647
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Complete coverage path planning requires that the mobile robot traverse all reachable positions in the environmental map. Aiming at the problems of local optimal path and high path coverage ratio in the complete coverage path planning of the traditional biologically inspired neural network algorithm, a complete coverage path planning algorithm based on Q-learning is proposed. The global environment information is introduced by the reinforcement learning method in the proposed algorithm. In addition, the Q-learning method is used for path planning at the positions where the accessible path points are changed, which optimizes the path planning strategy of the original algorithm near these obstacles. Simulation results show that the algorithm can automatically generate an orderly path in the environmental map, and achieve 100% coverage with a lower path repetition ratio.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Coverage Path Planning Optimization Based on Q-Learning Algorithm
    Piardi, Luis
    Lima, Jose
    Pereira, Ana, I
    Costa, Paulo
    INTERNATIONAL CONFERENCE ON NUMERICAL ANALYSIS AND APPLIED MATHEMATICS (ICNAAM-2018), 2019, 2116
  • [2] An Improved Algorithm for Complete Coverage Path Planning Based on Biologically Inspired Neural Network
    Han, Linhui
    Tan, Xiangquan
    Wu, Qingwen
    Deng, Xu
    IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2023, 15 (03) : 1605 - 1617
  • [3] Mobile robot path planning based on Q-learning algorithm
    Li, Shaochuan
    Wang, Xuiqing
    Hu, Liwei
    Liu, Ying
    2019 WORLD ROBOT CONFERENCE SYMPOSIUM ON ADVANCED ROBOTICS AND AUTOMATION (WRC SARA 2019), 2019, : 160 - 165
  • [4] A Path Planning Algorithm for Space Manipulator Based on Q-Learning
    Li, Taiguo
    Li, Quanhong
    Li, Wenxi
    Xia, Jiagao
    Tang, Wenhua
    Wang, Weiwen
    PROCEEDINGS OF 2019 IEEE 8TH JOINT INTERNATIONAL INFORMATION TECHNOLOGY AND ARTIFICIAL INTELLIGENCE CONFERENCE (ITAIC 2019), 2019, : 1566 - 1571
  • [5] A Path Planning Algorithm for UAV Based on Improved Q-Learning
    Yan, Chao
    Xiang, Xiaojia
    2018 2ND INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION SCIENCES (ICRAS), 2018, : 46 - 50
  • [6] Hybrid Path Planning Algorithm of the Mobile Agent Based on Q-Learning
    Gao, Tengteng
    Li, Caihong
    Liu, Guoming
    Guo, Na
    Wang, Di
    Li, Yongdi
    AUTOMATIC CONTROL AND COMPUTER SCIENCES, 2022, 56 (02) : 130 - 142
  • [7] Indoor Emergency Path Planning Based on the Q-Learning Optimization Algorithm
    Xu, Shenghua
    Gu, Yang
    Li, Xiaoyan
    Chen, Cai
    Hu, Yingyi
    Sang, Yu
    Jiang, Wenxing
    ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2022, 11 (01)
  • [8] PATH PLANNING OF MOBILE ROBOT BASED ON THE IMPROVED Q-LEARNING ALGORITHM
    Chen, Chaorui
    Wang, Dongshu
    INTERNATIONAL JOURNAL OF INNOVATIVE COMPUTING INFORMATION AND CONTROL, 2022, 18 (03): : 687 - 702
  • [9] Hybrid Path Planning Algorithm of the Mobile Agent Based on Q-Learning
    Caihong Tengteng Gao
    Guoming Li
    Na Liu
    Di Guo
    Yongdi Wang
    Automatic Control and Computer Sciences, 2022, 56 : 130 - 142
  • [10] Hybrid Path Planning of A Quadrotor UAV Based on Q-Learning Algorithm
    Zhang, Tianze
    Huo, Xin
    Chen, Songlin
    Yang, Baoqing
    Zhang, Guojiang
    2018 37TH CHINESE CONTROL CONFERENCE (CCC), 2018, : 5415 - 5419