The Improved Q-Learning Algorithm based on Pheromone Mechanism for Swarm Robot System

被引:0
|
作者
Shi, Zhiguo [1 ,2 ]
Tu, Jun [1 ]
Zhang, Qiao [1 ]
Zhang, Xiaomeng [1 ]
Wei, Junming [3 ]
机构
[1] Univ Sci & Technol Beijing, Sch Comp & Commun Engn, Beijing 100083, Peoples R China
[2] Ryerson Univ, Dept Aerosp Engn, Toronto, ON M5B 2K3, Canada
[3] Australian Natl Univ, ANU Coll Engn & Comp Sci, Canberra, ACT 2601, Australia
来源
2013 32ND CHINESE CONTROL CONFERENCE (CCC) | 2013年
基金
北京市自然科学基金;
关键词
Swarm robotics system; Distribute reinforcement learning; Q-Learning; Pheromone mechanism;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The reinforcement learning of the robot learning have general applicability in path planning, motion control and other aspects of mobile robot, which not only converges of reinforcement learning but also attributes to the simple implementation of the reinforcement learning, the typical reinforcement learning method is Q-Learning. Some improvements of the shortcomings of the Q-Learning is proposed by using the pheromone mechanism of the ant colony algorithm to solve the information sharing problem in the reinforcement learning system. Finally, the improved Q-Learning algorithm is simulated in the platform of Player/Stage. The results are compared with Q-Learning algorithm and PSO algorithm, which prove that the improved Q-Learning has high efficiency in the path planning of swarm robotics.
引用
收藏
页码:6033 / 6038
页数:6
相关论文
共 50 条
  • [1] PATH PLANNING OF MOBILE ROBOT BASED ON THE IMPROVED Q-LEARNING ALGORITHM
    Chen, Chaorui
    Wang, Dongshu
    INTERNATIONAL JOURNAL OF INNOVATIVE COMPUTING INFORMATION AND CONTROL, 2022, 18 (03): : 687 - 702
  • [2] An improved Q-learning algorithm using experience sharing for multi-robot system
    School of Astronautics, Harbin Institute of Technology, Harbin, China
    不详
    J. Comput. Inf. Syst., 9 (3387-3394): : 3387 - 3394
  • [3] An improved Q-learning algorithm for an autonomous mobile robot navigation problem
    Muhammad, Jawad
    Bucak, Ihsan Omur
    2013 INTERNATIONAL CONFERENCE ON TECHNOLOGICAL ADVANCES IN ELECTRICAL, ELECTRONICS AND COMPUTER ENGINEERING (TAEECE), 2013, : 239 - 243
  • [4] Dynamic Path Planning of a Mobile Robot with Improved Q-Learning algorithm
    Li, Siding
    Xu, Xin
    Zuo, Lei
    2015 IEEE INTERNATIONAL CONFERENCE ON INFORMATION AND AUTOMATION, 2015, : 409 - 414
  • [5] Robot location privacy protection based on Q-learning particle swarm optimization algorithm in mobile crowdsensing
    Ma, Dandan
    Kong, Dequan
    Chen, Xiaowei
    Zhang, Lingyu
    Yuan, Mingrun
    FRONTIERS IN NEUROROBOTICS, 2022, 16
  • [6] Behavior Control Algorithm for Mobile Robot Based on Q-Learning
    Yang, Shiqiang
    Li, Congxiao
    2017 INTERNATIONAL CONFERENCE ON COMPUTER NETWORK, ELECTRONIC AND AUTOMATION (ICCNEA), 2017, : 45 - 48
  • [7] Mobile robot path planning based on Q-learning algorithm
    Li, Shaochuan
    Wang, Xuiqing
    Hu, Liwei
    Liu, Ying
    2019 WORLD ROBOT CONFERENCE SYMPOSIUM ON ADVANCED ROBOTICS AND AUTOMATION (WRC SARA 2019), 2019, : 160 - 165
  • [8] A robot demonstration method based on LWR and Q-learning algorithm
    Zhao, Guangzhe
    Tao, Yong
    Liu, Hui
    Deng, Xianling
    Chen, Youdong
    Xiong, Hegen
    Xie, Xianwu
    Fang, Zengliang
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2018, 35 (01) : 35 - 46
  • [9] A Path Planning Algorithm for UAV Based on Improved Q-Learning
    Yan, Chao
    Xiang, Xiaojia
    2018 2ND INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION SCIENCES (ICRAS), 2018, : 46 - 50
  • [10] Dynamic feature selection algorithm based on Q-learning mechanism
    Ruohao Xu
    Mengmeng Li
    Zhongliang Yang
    Lifang Yang
    Kangjia Qiao
    Zhigang Shang
    Applied Intelligence, 2021, 51 : 7233 - 7244