Multi-Robot Gas-Source Localization based on Reinforcement Learning

被引:0
作者
Wei, Jian-Long [1 ]
Meng, Qing-Hao [1 ]
Yan, Ci [1 ]
Zeng, Ming [1 ]
Li, Wei [1 ]
机构
[1] Tianjin Univ, Sch Elect Engn & Automat, Inst Robot & Autonomous Syst, Tianjin 300072, Peoples R China
来源
2012 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (ROBIO 2012) | 2012年
关键词
Gas source localization; multiple robots; turbulence dominated airflow environment; reinforcement learning; strategy sharing; ENVIRONMENT;
D O I
暂无
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Multi-robot based gas source localization (GSL) in turbulence dominated airflow environments is addressed. A multi-agent reinforcement learning (RL) algorithm is proposed for training multiple robots to finish the GSL task. To improve searching efficiency, the strategy-sharing based RL algorithm is implemented for the GSL task in three different large-scale advection-diffusion simulated plume environments by using different number of robots. Simulation results show that multiple robots could successfully locate the gas source in turbulence dominated airflow environments with the proposed algorithm; Moreover, the results also demonstrate that the strategy-sharing RL outperforms the RL which does not share strategies.
引用
收藏
页数:6
相关论文
共 15 条
[1]  
[Anonymous], P INT S DISTR AUT RO
[2]  
Byrne R. H., 2002, Journal of Micromechatronics, V1, P253, DOI 10.1163/156856301760132141
[3]   Filament-Based Atmospheric Dispersion Model to Achieve Short Time-Scale Structure of Odor Plumes [J].
Farrell, Jay A. ;
Murlis, John ;
Long, Xuezhu ;
Li, Wei ;
Carde, Ring T. .
ENVIRONMENTAL FLUID MECHANICS, 2002, 2 (1-2) :143-169
[4]   SPIRAL: A novel biologically-inspired algorithm for gas/odor source localization in an indoor environment with no strong airflow [J].
Ferri, Gabriele ;
Caselli, Emanuele ;
Mattoli, Virgilio ;
Mondini, Alessio ;
Mazzolai, Barbara ;
Dario, Paolo .
ROBOTICS AND AUTONOMOUS SYSTEMS, 2009, 57 (04) :393-402
[5]   Distributed Odor Source Localization [J].
Hayes, Adam T. ;
Martinoli, Alcherio ;
Goodman, Rodney M. .
IEEE SENSORS JOURNAL, 2002, 2 (03) :260-271
[6]   A PSO-based mobile robot for odor source localization in dynamic advection-diffusion with obstacles environment: Theory, simulation and measurement [J].
Jatmiko, Wisnu ;
Sekiyama, Kosuke ;
Fukuda, Toshio .
IEEE COMPUTATIONAL INTELLIGENCE MAGAZINE, 2007, 2 (02) :37-51
[7]  
Kang X. D., 2012, ADAPTIVE BEHAV
[8]  
Lytridis C., 2004, P 7 INT C CLIMB WALK, P1107
[9]   Multi-robot olfactory search in structured environments [J].
Marjovi, Ali ;
Marques, Lino .
ROBOTICS AND AUTONOMOUS SYSTEMS, 2011, 59 (11) :867-881
[10]   Particle swarm-based olfactory guided search [J].
Marques, Lino ;
Nunes, Urbano ;
de Almeida, A. T. .
AUTONOMOUS ROBOTS, 2006, 20 (03) :277-287