Critic learning in multi agent credit assignment problem

被引:5
|
作者
Rahaie, Zahra [1 ]
Beigy, Hamid [1 ]
机构
[1] Sharif Univ Technol, Dept Comp Engn, Tehran, Iran
关键词
Multi-agent systems; credit assignment; reinforcement learning; interaction; history; knowledge; MODEL;
D O I
10.3233/IFS-162093
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Multi-agent systems can be seen as an apparatus for testing the performance of real distributed systems. One problem encountered in multi-agent systems with the learning capability is credit assignment. This paper presents two methods for solving this problem. The first method assigns credit to the agents according to the history of the interaction while the second method assigns credit to the agents according to the knowledge of agents, and thus the shares of the agents are extracted from the feedback of the environment. The computer experiments show that critic learning has a positive impact in credit assignment problem.
引用
收藏
页码:3465 / 3480
页数:16
相关论文
共 50 条
  • [1] Addition of Learning to Critic Agent as a Solution to the Multi-Agent Credit Assignment Problem
    Rahaie, Zahra
    Beigy, Hamid
    2009 FIFTH INTERNATIONAL CONFERENCE ON SOFT COMPUTING, COMPUTING WITH WORDS AND PERCEPTIONS IN SYSTEM ANALYSIS, DECISION AND CONTROL, 2010, : 219 - 222
  • [2] A bankruptcy based approach to solving multi-agent credit assignment problem
    Yarahmadi, Hossein
    Shiri, Mohammad Ebrahim
    Navidi, Hamidreza
    Sharifi, Arash
    INTERNATIONAL JOURNAL OF NONLINEAR ANALYSIS AND APPLICATIONS, 2021, 12 : 1987 - 2018
  • [3] Toward a Solution to Multi-Agent Credit Assignment Problem
    Rahaie, Zahra
    Beigy, Hamid
    2009 INTERNATIONAL CONFERENCE OF SOFT COMPUTING AND PATTERN RECOGNITION, 2009, : 563 - 568
  • [4] Closely Cooperative Multi-Agent Reinforcement Learning Based on Intention Sharing and Credit Assignment
    Fu, Hao
    You, Mingyu
    Zhou, Hongjun
    He, Bin
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (12): : 11770 - 11777
  • [5] Expertness framework in multi-agent systems and its application in credit assignment problem
    Rahaie, Zahra
    Beigy, Hamid
    INTELLIGENT DATA ANALYSIS, 2014, 18 (03) : 511 - 528
  • [6] Multi-Level Credit Assignment for Cooperative Multi-Agent Reinforcement Learning
    Feng, Lei
    Xie, Yuxuan
    Liu, Bing
    Wang, Shuyan
    APPLIED SCIENCES-BASEL, 2022, 12 (14):
  • [7] Credit assignment with predictive contribution measurement in multi-agent reinforcement learning
    Chen, Renlong
    Tan, Ying
    NEURAL NETWORKS, 2023, 164 : 681 - 690
  • [8] Effective credit assignment deep policy gradient multi-agent reinforcement learning for vehicle dispatch
    Xiaohui Huang
    Xiong Zhang
    Jiahao Ling
    Xuebo Cheng
    Applied Intelligence, 2023, 53 : 23457 - 23469
  • [9] Effective credit assignment deep policy gradient multi-agent reinforcement learning for vehicle dispatch
    Huang, Xiaohui
    Zhang, Xiong
    Ling, Jiahao
    Cheng, Xuebo
    APPLIED INTELLIGENCE, 2023, 53 (20) : 23457 - 23469
  • [10] Credit assignment in heterogeneous multi-agent reinforcement learning for fully cooperative tasks
    Kun Jiang
    Wenzhang Liu
    Yuanda Wang
    Lu Dong
    Changyin Sun
    Applied Intelligence, 2023, 53 : 29205 - 29222