Learning to Coordinate for a Worker-Station Multi-Robot System in Planar Coverage Tasks

被引:3
|
作者
Tang, Jingtao [1 ]
Gao, Yuan [2 ]
Lam, Tin Lun [1 ]
机构
[1] Chinese Univ Hong Kong, Sch Sci & Engn, Shenzhen 518172, Peoples R China
[2] Shenzhen Inst Artificial Intelligence & Robot Soc, Shenzhen 518049, Guangdong, Peoples R China
基金
国家重点研发计划;
关键词
Multi-robot systems; planning; scheduling and coordination; reinforcement learning; EFFICIENT;
D O I
10.1109/LRA.2022.3214446
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
For massive large-scale tasks, a multi-robot system (MRS) can effectively improve efficiency by utilizing each robot's different capabilities, mobility, and functionality. In this letter, we focus on the multi-robot coverage path planning (mCPP) problem in large-scale planar areas with random dynamic interferers in the environment, where the robots have limited resources. We introduce a worker-station MRS consisting of multiple workers with limited resources for actual work, and one station with enough resources for resource replenishment. We aim to solve the mCPP problem for the worker-station MRS by formulating it as a fully cooperative multi-agent reinforcement learning problem. Then we propose an end-to-end decentralized online planning method, which simultaneously solves coverage planning for workers and rendezvous planning for station. Our method manages to reduce the influence of random dynamic interferers on planning, while the robots can avoid collisions with them. We conduct simulation and real robot experiments, and the comparison results show that our method has competitive performance in solving the mCPP problem for worker-station MRS in metric of task finish time.
引用
收藏
页码:12315 / 12322
页数:8
相关论文
共 50 条
  • [1] COOPERATIVE MULTI-ROBOT SYSTEM FOR INFRASTRUCTURE SECURITY TASKS
    Hernandez, Erik
    Barrientos, Antonio
    Rossi, Claudio
    del Cerro, Jaime
    ICAART: PROCEEDINGS OF THE 4TH INTERNATIONAL CONFERENCE ON AGENTS AND ARTIFICIAL INTELLIGENCE, VOL. 2, 2012, : 313 - 316
  • [2] Distributed Reinforcement Learning for Coordinate Multi-Robot Foraging
    Guo, Hongliang
    Meng, Yan
    JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2010, 60 (3-4) : 531 - 551
  • [3] Distributed Reinforcement Learning for Coordinate Multi-Robot Foraging
    Hongliang Guo
    Yan Meng
    Journal of Intelligent & Robotic Systems, 2010, 60 : 531 - 551
  • [4] Cooperative Aerial-Ground Multi-Robot System for Automated Construction Tasks
    Krizmancic, Marko
    Arbanas, Barbara
    Petrovic, Tamara
    Petric, Frano
    Bogdan, Stjepan
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2020, 5 (02) : 798 - 805
  • [5] Scalable Multi-Robot Cooperation for Multi-Goal Tasks Using Reinforcement Learning
    An, Tianxu
    Lee, Joonho
    Bjelonic, Marko
    De Vincenti, Flavio
    Hutter, Marco
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2025, 10 (02): : 1585 - 1592
  • [6] On Multi-robot Area Coverage
    Fazli, Pooyan
    ADVANCES IN ARTIFICIAL INTELLIGENCE, PROCEEDINGS, 2010, 6085 : 384 - 387
  • [7] Cooperative and Competitive Behaviors in a Multi-robot System for Surveillance Tasks
    Quinonez, Yadira
    de Lope, Javier
    Maravall, Dario
    COMPUTER AIDED SYSTEMS THEORY - EUROCAST 2009, 2009, 5717 : 437 - 444
  • [8] Dynamic token generation for constrained tasks in a Multi-Robot System
    Cottefoglie, F
    Farinelli, A
    Locchi, L
    Nardi, D
    2004 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN & CYBERNETICS, VOLS 1-7, 2004, : 911 - 917
  • [9] Heterogeneous Multi-robot Task Allocation and Scheduling via Reinforcement Learning
    Dai, Weiheng
    Rai, Utkarsh
    Chiun, Jimmy
    Cao, Yuhong
    Sartoretti, Guillaume
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2025, 10 (03): : 2654 - 2661
  • [10] Multi-robot repeated area coverage
    Pooyan Fazli
    Alireza Davoodi
    Alan K. Mackworth
    Autonomous Robots, 2013, 34 : 251 - 276