Learning to Coordinate for a Worker-Station Multi-Robot System in Planar Coverage Tasks

被引:3
|
作者
Tang, Jingtao [1 ]
Gao, Yuan [2 ]
Lam, Tin Lun [1 ]
机构
[1] Chinese Univ Hong Kong, Sch Sci & Engn, Shenzhen 518172, Peoples R China
[2] Shenzhen Inst Artificial Intelligence & Robot Soc, Shenzhen 518049, Guangdong, Peoples R China
基金
国家重点研发计划;
关键词
Multi-robot systems; planning; scheduling and coordination; reinforcement learning; EFFICIENT;
D O I
10.1109/LRA.2022.3214446
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
For massive large-scale tasks, a multi-robot system (MRS) can effectively improve efficiency by utilizing each robot's different capabilities, mobility, and functionality. In this letter, we focus on the multi-robot coverage path planning (mCPP) problem in large-scale planar areas with random dynamic interferers in the environment, where the robots have limited resources. We introduce a worker-station MRS consisting of multiple workers with limited resources for actual work, and one station with enough resources for resource replenishment. We aim to solve the mCPP problem for the worker-station MRS by formulating it as a fully cooperative multi-agent reinforcement learning problem. Then we propose an end-to-end decentralized online planning method, which simultaneously solves coverage planning for workers and rendezvous planning for station. Our method manages to reduce the influence of random dynamic interferers on planning, while the robots can avoid collisions with them. We conduct simulation and real robot experiments, and the comparison results show that our method has competitive performance in solving the mCPP problem for worker-station MRS in metric of task finish time.
引用
收藏
页码:12315 / 12322
页数:8
相关论文
共 50 条
  • [21] A framework for multi-robot node coverage in sensor networks
    Andrea Gasparri
    Bhaskar Krishnamachari
    Gaurav S. Sukhatme
    Annals of Mathematics and Artificial Intelligence, 2008, 52 : 281 - 305
  • [22] Multi-Robot Coverage: A Bee Pheromone Signalling Approach
    Caliskanelli, Ipek
    Broecker, Bastian
    Tuyls, Karl
    ARTIFICIAL LIFE AND INTELLIGENT AGENTS, ALIA 2014, 2015, 519 : 124 - 140
  • [23] A framework for multi-robot node coverage in sensor networks
    Gasparri, Andrea
    Krishnamachari, Bhaskar
    Sukhatme, Gaurav S.
    ANNALS OF MATHEMATICS AND ARTIFICIAL INTELLIGENCE, 2008, 52 (2-4) : 281 - 305
  • [24] Social Insect-Inspired Multi-Robot Coverage
    Broecker, Bastian
    Caliskanelli, Ipek
    Tuyls, Karl
    Sklar, Elizabeth
    Hennes, Daniel
    PROCEEDINGS OF THE 2015 INTERNATIONAL CONFERENCE ON AUTONOMOUS AGENTS & MULTIAGENT SYSTEMS (AAMAS'15), 2015, : 1775 - 1776
  • [25] BoB: an online coverage approach for multi-robot systems
    Hoang Huu Viet
    Viet-Hung Dang
    Choi, SeungYoon
    Chung, TaeChoong
    APPLIED INTELLIGENCE, 2015, 42 (02) : 157 - 173
  • [26] Multi-Robot Coverage to locate fixed and moving targets
    Rogge, Jonathan A.
    Aeyels, Dirk
    2009 IEEE CONTROL APPLICATIONS CCA & INTELLIGENT CONTROL (ISIC), VOLS 1-3, 2009, : 902 - 907
  • [27] Applying Reinforcement Learning to Multi-robot Team Coordination
    Sanz, Yolanda
    de Lope, Javier
    Antonio Martin H, Jose
    HYBRID ARTIFICIAL INTELLIGENCE SYSTEMS, 2008, 5271 : 625 - +
  • [28] Sequencing of multi-robot behaviors using reinforcement learning
    Pietro Pierpaoli
    Thinh T. Doan
    Justin Romberg
    Magnus Egerstedt
    Control Theory and Technology, 2021, 19 : 529 - 537
  • [29] A review of developments in reinforcement learning for multi-robot systems
    Ma, Lei, 1600, Science Press (49): : 1032 - 1044
  • [30] Applications of Voronoi Diagrams in Multi-Robot Coverage: A Review
    Zhou, Meng
    Li, Jianyu
    Wang, Chang
    Wang, Jing
    Wang, Li
    JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2024, 12 (06)