Critic learning in multi agent credit assignment problem

被引:5
作者
Rahaie, Zahra [1 ]
Beigy, Hamid [1 ]
机构
[1] Sharif Univ Technol, Dept Comp Engn, Tehran, Iran
关键词
Multi-agent systems; credit assignment; reinforcement learning; interaction; history; knowledge; MODEL;
D O I
10.3233/IFS-162093
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Multi-agent systems can be seen as an apparatus for testing the performance of real distributed systems. One problem encountered in multi-agent systems with the learning capability is credit assignment. This paper presents two methods for solving this problem. The first method assigns credit to the agents according to the history of the interaction while the second method assigns credit to the agents according to the knowledge of agents, and thus the shares of the agents are extracted from the feedback of the environment. The computer experiments show that critic learning has a positive impact in credit assignment problem.
引用
收藏
页码:3465 / 3480
页数:16
相关论文
共 50 条
  • [21] A multi-agent reinforcement learning using Actor-Critic methods
    Li, Chun-Gui
    Wang, Meng
    Yuan, Qing-Neng
    PROCEEDINGS OF 2008 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-7, 2008, : 878 - 882
  • [22] An Object Oriented Approach to Fuzzy Actor-Critic Learning for Multi-Agent Differential Games
    Schwartz, Howard
    2019 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (IEEE SSCI 2019), 2019, : 183 - 190
  • [23] Learning controlled and targeted communication with the centralized critic for the multi-agent system
    Sun, Qingshuang
    Yao, Yuan
    Yi, Peng
    Hu, YuJiao
    Yang, Zhao
    Yang, Gang
    Zhou, Xingshe
    APPLIED INTELLIGENCE, 2023, 53 (12) : 14819 - 14837
  • [24] Learning controlled and targeted communication with the centralized critic for the multi-agent system
    Qingshuang Sun
    Yuan Yao
    Peng Yi
    YuJiao Hu
    Zhao Yang
    Gang Yang
    Xingshe Zhou
    Applied Intelligence, 2023, 53 : 14819 - 14837
  • [25] Multi-agent off-policy actor-critic algorithm for distributed multi-task reinforcement learning
    Stankovic, Milos S.
    Beko, Marko
    Ilic, Nemanja
    Stankovic, Srdjan S.
    EUROPEAN JOURNAL OF CONTROL, 2023, 74
  • [26] Multi-agent actor centralized-critic with communication
    Simoes, David
    Lau, Nuno
    Reis, Luis Paulo
    NEUROCOMPUTING, 2020, 390 : 40 - 56
  • [27] Solving the credit assignment problem: explicit and implicit learning of action sequences with probabilistic outcomes
    Wai-Tat Fu
    John R. Anderson
    Psychological Research, 2008, 72 : 321 - 330
  • [28] Multi-Agent Credit Assignment and Bankruptcy Game for Improving Resource Allocation in Smart Cities
    Yarahmadi, Hossein
    Shiri, Mohammad Ebrahim
    Challenger, Moharram
    Navidi, Hamidreza
    Sharifi, Arash
    SENSORS, 2023, 23 (04)
  • [29] Actor-Critic for Multi-Agent Reinforcement Learning with Self-Attention
    Zhao, Juan
    Zhu, Tong
    Xiao, Shuo
    Gao, Zongqian
    Sun, Hao
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2022, 36 (09)
  • [30] Cooperative targets assignment based on multi-agent reinforcement learning
    Ma Y.
    Wu L.
    Xu X.
    Xi Tong Gong Cheng Yu Dian Zi Ji Shu/Systems Engineering and Electronics, 2023, 45 (09): : 2793 - 2801