Cooperative Action Acquisition Based on Intention Estimation in a Multi-Agent Reinforcement Learning System

被引:1
|
作者
Tsubakimoto, Tatsuya [1 ]
Kobayashi, Kunikazu [1 ]
机构
[1] Aichi Prefectural Univ, Sch Informat Sci & Technol, Nagakute, Aichi, Japan
关键词
multi-agent; reinforcement learning; Q-learning; cooperation; intention estimation;
D O I
10.1002/ecj.11821
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this paper, we propose a method to acquire a series of cooperative actions to reach an appropriate goal without the designer controlling the reward. To accomplish this, we introduce a new concept of "reward interpretation." This is the idea that an agent can increase or decrease the reward given by the environment through the reward interpretation on its won. We applied this idea to the Q-learning method. The simulation results show that the proposed method is superior to a standard Q-learning method and a Q-learning method with cooperation in terms of the number of successful instances of cooperation. (C) 2017 Wiley Periodicals, Inc.
引用
收藏
页码:3 / 10
页数:8
相关论文
共 50 条
  • [41] A Deep Reinforcement Learning Method based on Deterministic Policy Gradient for Multi-Agent Cooperative Competition
    Zuo, Xuan
    Xue, Hui-Feng
    Wang, Xiao-Yin
    Du, Wan-Ru
    Tian, Tao
    Gao, Shan
    Zhang, Pu
    CONTROL ENGINEERING AND APPLIED INFORMATICS, 2021, 23 (03): : 88 - 98
  • [42] Research on cooperative hunting method of unmanned surface vehicle based on multi-agent reinforcement learning
    Xia J.-W.
    Zhu X.-F.
    Zhang J.-Q.
    Luo Y.-S.
    Liu Z.
    Kongzhi yu Juece/Control and Decision, 2023, 38 (05): : 1438 - 1447
  • [43] Reinforcement Learning Approach for Cooperative Control of Multi-Agent Systems
    Javalera-Rincon, Valeria
    Puig Cayuela, Vicenc
    Morcego Seix, Bernardo
    Orduna-Cabrera, Fernando
    PROCEEDINGS OF THE 11TH INTERNATIONAL CONFERENCE ON AGENTS AND ARTIFICIAL INTELLIGENCE (ICAART), VOL 2, 2019, : 80 - 91
  • [44] Mention Recommendation in Twitter with Cooperative Multi-Agent Reinforcement Learning
    Gui, Tao
    Liu, Peng
    Zhang, Qi
    Zhu, Liang
    Peng, Minlong
    Zhou, Yunhua
    Huang, Xuanjing
    PROCEEDINGS OF THE 42ND INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (SIGIR '19), 2019, : 535 - 544
  • [45] Multi-Agent Reinforcement Learning for Cooperative Adaptive Cruise Control
    Peake, Ashley
    McCalmon, Joe
    Raiford, Benjamin
    Liu, Tongtong
    Alqahtani, Sarra
    2020 IEEE 32ND INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI), 2020, : 15 - 22
  • [46] Cooperative Multi-Agent Deep Reinforcement Learning with Counterfactual Reward
    Shao, Kun
    Zhu, Yuanheng
    Tang, Zhentao
    Zhao, Dongbin
    2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [47] WRFMR: A Multi-Agent Reinforcement Learning Method for Cooperative Tasks
    Liu, Hui
    Zhang, Zhen
    Wang, Dongqing
    IEEE ACCESS, 2020, 8 : 216320 - 216331
  • [48] Cooperative Multi-Agent Jamming of Multiple Rogue Drones Using Reinforcement Learning
    Valianti, Panayiota
    Malialis, Kleanthis
    Kolios, Panayiotis
    Ellinas, Georgios
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (12) : 12345 - 12359
  • [49] Better value estimation in Q-learning-based multi-agent reinforcement learning
    Ding, Ling
    Du, Wei
    Zhang, Jian
    Guo, Lili
    Zhang, Chenglong
    Jin, Di
    Ding, Shifei
    SOFT COMPUTING, 2024, 28 (06) : 5625 - 5638
  • [50] Better value estimation in Q-learning-based multi-agent reinforcement learning
    Ling Ding
    Wei Du
    Jian Zhang
    Lili Guo
    Chenglong Zhang
    Di Jin
    Shifei Ding
    Soft Computing, 2024, 28 : 5625 - 5638