Learning to Coordinate for a Worker-Station Multi-Robot System in Planar Coverage Tasks

被引:3
|
作者
Tang, Jingtao [1 ]
Gao, Yuan [2 ]
Lam, Tin Lun [1 ]
机构
[1] Chinese Univ Hong Kong, Sch Sci & Engn, Shenzhen 518172, Peoples R China
[2] Shenzhen Inst Artificial Intelligence & Robot Soc, Shenzhen 518049, Guangdong, Peoples R China
基金
国家重点研发计划;
关键词
Multi-robot systems; planning; scheduling and coordination; reinforcement learning; EFFICIENT;
D O I
10.1109/LRA.2022.3214446
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
For massive large-scale tasks, a multi-robot system (MRS) can effectively improve efficiency by utilizing each robot's different capabilities, mobility, and functionality. In this letter, we focus on the multi-robot coverage path planning (mCPP) problem in large-scale planar areas with random dynamic interferers in the environment, where the robots have limited resources. We introduce a worker-station MRS consisting of multiple workers with limited resources for actual work, and one station with enough resources for resource replenishment. We aim to solve the mCPP problem for the worker-station MRS by formulating it as a fully cooperative multi-agent reinforcement learning problem. Then we propose an end-to-end decentralized online planning method, which simultaneously solves coverage planning for workers and rendezvous planning for station. Our method manages to reduce the influence of random dynamic interferers on planning, while the robots can avoid collisions with them. We conduct simulation and real robot experiments, and the comparison results show that our method has competitive performance in solving the mCPP problem for worker-station MRS in metric of task finish time.
引用
收藏
页码:12315 / 12322
页数:8
相关论文
共 50 条
  • [31] Multi-robot Online Complete Coverage Based on Collaboration
    Duan, Leilei
    Wang, Jianming
    Sun, Yukuan
    WEB AND BIG DATA. APWEB-WAIM 2022 INTERNATIONAL WORKSHOPS, KGMA 2022, SEMIBDMA 2022, DEEPLUDA 2022, 2023, 1784 : 219 - 231
  • [32] Sequencing of multi-robot behaviors using reinforcement learning
    Pierpaoli, Pietro
    Doan, Thinh T.
    Romberg, Justin
    Egerstedt, Magnus
    CONTROL THEORY AND TECHNOLOGY, 2021, 19 (04) : 529 - 537
  • [33] Reinforcement Learning in the Multi-Robot Domain
    Maja J. Matarić
    Autonomous Robots, 1997, 4 : 73 - 83
  • [34] Reinforcement learning in the multi-robot domain
    Mataric, MJ
    AUTONOMOUS ROBOTS, 1997, 4 (01) : 73 - 83
  • [35] Multi-robot exploration and terrain coverage in an unknown environment
    Senthilkumar, K. S.
    Bharadwaj, K. K.
    ROBOTICS AND AUTONOMOUS SYSTEMS, 2012, 60 (01) : 123 - 132
  • [36] Communication-Efficient Multi-Robot Exploration Using Coverage-Biased Distributed Q-Learning
    Latif, Ehsan
    Parasuraman, Ramviyas
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (03) : 2622 - 2629
  • [37] Effective Approximations for Multi-Robot Coordination in Spatially Distributed Tasks
    Claes, Daniel
    Robbel, Philipp
    Oliehoek, Frans A.
    Tuyls, Karl
    Hennes, Daniel
    van der Hoek, Wiebe
    PROCEEDINGS OF THE 2015 INTERNATIONAL CONFERENCE ON AUTONOMOUS AGENTS & MULTIAGENT SYSTEMS (AAMAS'15), 2015, : 881 - 890
  • [38] Emergence analysis in a Multi-robot System
    Gil, Angel
    Aguilar, Jose
    Puerto, Eduard
    Dapena, Eladio
    2018 XLIV LATIN AMERICAN COMPUTER CONFERENCE (CLEI 2018), 2018, : 662 - 669
  • [39] Effects of Multi-Robot Team Formations on Distributed Area Coverage
    Dasgupta, Prithviraj
    Whipple, Taylor
    Cheng, Ke
    INTERNATIONAL JOURNAL OF SWARM INTELLIGENCE RESEARCH, 2011, 2 (01) : 44 - 69
  • [40] Experimental Evaluation of Multi-robot Online Terrain Coverage Approach
    Gautam, Avinash
    Richhariya, Aashish
    Shekhawat, Virendra Singh
    Mohan, Sudeept
    2018 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (ROBIO), 2018, : 1183 - 1189