Learning to Coordinate for a Worker-Station Multi-Robot System in Planar Coverage Tasks

被引:3
|
作者
Tang, Jingtao [1 ]
Gao, Yuan [2 ]
Lam, Tin Lun [1 ]
机构
[1] Chinese Univ Hong Kong, Sch Sci & Engn, Shenzhen 518172, Peoples R China
[2] Shenzhen Inst Artificial Intelligence & Robot Soc, Shenzhen 518049, Guangdong, Peoples R China
基金
国家重点研发计划;
关键词
Multi-robot systems; planning; scheduling and coordination; reinforcement learning; EFFICIENT;
D O I
10.1109/LRA.2022.3214446
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
For massive large-scale tasks, a multi-robot system (MRS) can effectively improve efficiency by utilizing each robot's different capabilities, mobility, and functionality. In this letter, we focus on the multi-robot coverage path planning (mCPP) problem in large-scale planar areas with random dynamic interferers in the environment, where the robots have limited resources. We introduce a worker-station MRS consisting of multiple workers with limited resources for actual work, and one station with enough resources for resource replenishment. We aim to solve the mCPP problem for the worker-station MRS by formulating it as a fully cooperative multi-agent reinforcement learning problem. Then we propose an end-to-end decentralized online planning method, which simultaneously solves coverage planning for workers and rendezvous planning for station. Our method manages to reduce the influence of random dynamic interferers on planning, while the robots can avoid collisions with them. We conduct simulation and real robot experiments, and the comparison results show that our method has competitive performance in solving the mCPP problem for worker-station MRS in metric of task finish time.
引用
收藏
页码:12315 / 12322
页数:8
相关论文
共 50 条
  • [41] Cluster, Allocate, Cover: An Efficient Approach for Multi-Robot Coverage
    Gautam, Avinash
    Murthy, J. Krishna
    Kumar, Gourav
    Ram, S. P. Arjun
    Jha, Bhargav
    Mohan, Sudeept
    2015 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC 2015): BIG DATA ANALYTICS FOR HUMAN-CENTRIC SYSTEMS, 2015, : 197 - 203
  • [42] Cooperative Flocking and Learning in Multi-Robot Systems for Predator Avoidance
    La, Hung Manh
    Lim, Ronny Salim
    Sheng, Weihua
    Chen, Jiming
    2013 IEEE 3RD ANNUAL INTERNATIONAL CONFERENCE ON CYBER TECHNOLOGY IN AUTOMATION, CONTROL AND INTELLIGENT SYSTEMS (CYBER), 2013, : 337 - +
  • [43] A Novel Hybrid Learning Technique Applied to a Self-Learning Multi-Robot System
    Desouky, Sameh F.
    Schwartz, Howard M.
    2009 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN AND CYBERNETICS (SMC 2009), VOLS 1-9, 2009, : 2616 - 2623
  • [44] Online Multi-Robot Coverage: Algorithm Comparisons Extended Abstract
    Jensen, Elizabeth A.
    Gini, Maria
    PROCEEDINGS OF THE 17TH INTERNATIONAL CONFERENCE ON AUTONOMOUS AGENTS AND MULTIAGENT SYSTEMS (AAMAS' 18), 2018, : 1974 - 1976
  • [45] Heterogeneous Multi-Robot Cooperation With Asynchronous Multi-Agent Reinforcement Learning
    Zhang, Han
    Zhang, Xiaohui
    Feng, Zhao
    Xiao, Xiaohui
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (01): : 159 - 166
  • [46] Multi-robot concurrent learning in museum problem
    Liu, Zheng
    Ang, Marcelo H., Jr.
    Seah, Winston Khoon Guan
    DISTRIBUTED AUTONOMOUS ROBOTIC SYSTEMS 6, 2007, : 65 - +
  • [47] MAC-Planner: A Novel Task Allocation and Path Planning Framework for Multi-Robot Online Coverage Processes
    Wang, Zikai
    Lyu, Xiaoxu
    Zhang, Jiekai
    Wang, Pengyu
    Zhong, Yuxing
    Shi, Ling
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2025, 10 (05): : 4404 - 4411
  • [48] APF-CPP: An Artificial Potential Field Based Multi-Robot Online Coverage Path Planning Approach
    Wang, Zikai
    Zhao, Xiaoqi
    Zhang, Jiekai
    Yang, Nachuan
    Wang, Pengyu
    Tang, Jiawei
    Zhang, Jiuzhou
    Shi, Ling
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (11): : 9199 - 9206
  • [49] Behavior-based multi-robot collaboration for autonomous construction tasks
    Stroupe, A
    Huntsberger, T
    Okon, A
    Aghazarian, H
    Robinson, M
    2005 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, VOLS 1-4, 2005, : 1989 - 1994
  • [50] Reactivity and Social Cooperation in a Multi-Robot System
    Gharbi, Atef
    Ben Halima, Nadhir
    Gharsellaoui, Hamza
    2015 10TH INTERNATIONAL JOINT CONFERENCE ON SOFTWARE TECHNOLOGIES (ICSOFT), VOL 1, 2015, : 253 - 260