Cooperative Multi-Robot Task Allocation with Reinforcement Learning

被引:14
|
作者
Park, Bumjin [1 ]
Kang, Cheongwoong [1 ]
Choi, Jaesik [1 ]
机构
[1] Korea Adv Inst Sci & Technol KAIST, Kim Jaechul Grad Sch AI, Daejeon 34141, South Korea
来源
APPLIED SCIENCES-BASEL | 2022年 / 12卷 / 01期
关键词
multi robot task allocation; reinforcement learning; deep learning; artificial intelligence; TAXONOMY; COORDINATION;
D O I
10.3390/app12010272
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
This paper deals with the concept of multi-robot task allocation, referring to the assignment of multiple robots to tasks such that an objective function is maximized. The performance of existing meta-heuristic methods worsens as the number of robots or tasks increases. To tackle this problem, a novel Markov decision process formulation for multi-robot task allocation is presented for reinforcement learning. The proposed formulation sequentially allocates robots to tasks to minimize the total time taken to complete them. Additionally, we propose a deep reinforcement learning method to find the best allocation schedule for each problem. Our method adopts the cross-attention mechanism to compute the preference of robots to tasks. The experimental results show that the proposed method finds better solutions than meta-heuristic methods, especially when solving large-scale allocation problems.
引用
收藏
页数:19
相关论文
共 50 条
  • [41] An effective method to use centralized Q-learning in multi-robot task allocation
    Ezercan Kayir, Hatice Hilal
    PAMUKKALE UNIVERSITY JOURNAL OF ENGINEERING SCIENCES-PAMUKKALE UNIVERSITESI MUHENDISLIK BILIMLERI DERGISI, 2021, 27 (05): : 579 - 588
  • [42] Multi-robot Task Allocation Based on Ant Colony Algorithm
    Wang, Jian-Ping
    Gu, Yuesheng
    Li, Xiao-Min
    JOURNAL OF COMPUTERS, 2012, 7 (09) : 2160 - 2167
  • [43] An Optimal Task Allocation Strategy for Heterogeneous Multi-Robot Systems
    Notomista, Gennaro
    Mayya, Siddharth
    Hutchinson, Seth
    Egerstedt, Magnus
    2019 18TH EUROPEAN CONTROL CONFERENCE (ECC), 2019, : 2071 - 2076
  • [44] Distributed Hedonic Coalition Formation for Multi-robot Task Allocation
    Dutta, Ayan
    Ufimtsev, Vladimir
    Said, Tuffa
    Jang, Inmo
    Eggen, Roger
    2021 IEEE 17TH INTERNATIONAL CONFERENCE ON AUTOMATION SCIENCE AND ENGINEERING (CASE), 2021, : 639 - 644
  • [45] Multi-Robot Task Allocation with Auctions in Harsh Communication Environments
    Otte, Michael
    Kuhlman, Michael
    Sofge, Donald
    2017 INTERNATIONAL SYMPOSIUM ON MULTI-ROBOT AND MULTI-AGENT SYSTEMS (MRS), 2017,
  • [46] Combinatorial bids based multi-robot task allocation method
    Lin, L
    Zheng, ZQ
    2005 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), VOLS 1-4, 2005, : 1145 - 1150
  • [47] Multi-robot system task allocation mechanism for smart factory
    Huang, Yin
    Zhang, Yi
    Xiao, Hong
    PROCEEDINGS OF 2019 IEEE 8TH JOINT INTERNATIONAL INFORMATION TECHNOLOGY AND ARTIFICIAL INTELLIGENCE CONFERENCE (ITAIC 2019), 2019, : 587 - 591
  • [48] On-line task allocation for multi-robot teams under dynamic scenarios
    Arif, Muhammad Usman
    Haider, Sajjad
    INTELLIGENT DECISION TECHNOLOGIES-NETHERLANDS, 2024, 18 (02): : 1053 - 1076
  • [49] A Flexible Evolutionary Algorithm for Task Allocation in Multi-robot Team
    Arif, Muhammad Usman
    Haider, Sajjad
    COMPUTATIONAL COLLECTIVE INTELLIGENCE, ICCCI 2018, PT II, 2018, 11056 : 89 - 99
  • [50] SMT-Based Dynamic Multi-Robot Task Allocation
    Tuck, Victoria Marie
    Chen, Pei-Wei
    Fainekos, Georgios
    Hoxha, Bardh
    Okamoto, Hideki
    Sastry, S. Shankar
    Seshia, Sanjit A.
    NASA FORMAL METHODS, NFM 2024, 2024, 14627 : 331 - 351