Decentralized Coordination of Multi-Agent Systems Based on POMDPs and Consensus for Active Perception

被引:1
作者
Peti, Marijana [1 ]
Petric, Frano [1 ]
Bogdan, Stjepan [1 ]
机构
[1] Univ Zagreb, Fac Elect Engn & Comp, Lab Robot & Intelligent Control Syst LARICS, Zagreb 10000, Croatia
关键词
Multi-agent systems; Decision making; Markov processes; Consensus protocol; Observability; Active perception; Toy manufacturing industry; POMDP; consensus; multi-agent systems; decentralized-POMDP; mixed-observability-POMDP; decision-making; NETWORKS;
D O I
10.1109/ACCESS.2023.3280413
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This work presents the method based on the Partially Observable Markov Decision Processes (POMDP) and consensus protocol. The main idea is to share the belief and reach the consensus on the belief state in order to improve local decision making. To show that the belief update is important after reaching the observation, alongside the average consensus, we also examine novelty-biased consensus. The proposed method is applied on several benchmark problems and compared to an established method called Decentralized POMDP. Additionally, it is thoroughly examined in the simulation scenario. The results obtained in this work show that our method is efficient on the scenarios where agents explore the environment and it manages to execute mission in the scenarios where agents need to coordinate.
引用
收藏
页码:52480 / 52491
页数:12
相关论文
共 24 条
  • [1] Consensus Problems on Networks With Antagonistic Interactions
    Altafini, Claudio
    [J]. IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2013, 58 (04) : 935 - 946
  • [2] Amato C, 2018, PROCEEDINGS OF THE TWENTY-SEVENTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, P5662
  • [3] Policy search for multi-robot coordination under uncertainty
    Amato, Christopher
    Konidaris, George
    Anders, Ariel
    Cruz, Gabriel
    How, Jonathan P.
    Kaelbling, Leslie P.
    [J]. INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2016, 35 (14) : 1760 - 1778
  • [4] Amato C, 2013, IEEE DECIS CONTR P, P2398, DOI 10.1109/CDC.2013.6760239
  • [5] Bernstein DS, 2005, 19TH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE (IJCAI-05), P1287
  • [6] Brock O., 2009, SARSOP EFFICIENT POI, P65
  • [7] Dong JG, 2015, Arxiv, DOI arXiv:1406.1862
  • [8] Trust-based self-organising network control
    Haus, Tomislav
    Palunko, Ivana
    Tolic, Domagoj
    Bogdan, Stjepan
    Lewis, Frank L.
    Mikulski, Dariusz G.
    [J]. IET CONTROL THEORY AND APPLICATIONS, 2014, 8 (18) : 2126 - 2135
  • [9] Social Learning and Distributed Hypothesis Testing
    Lalitha, Anusha
    Javidi, Tara
    Sarwate, Anand D.
    [J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 2018, 64 (09) : 6161 - 6179
  • [10] Lauri M, 2019, AAMAS '19: PROCEEDINGS OF THE 18TH INTERNATIONAL CONFERENCE ON AUTONOMOUS AGENTS AND MULTIAGENT SYSTEMS, P1143