Reinforcement learning and aggregation

被引:0
|
作者
Jiang, J [1 ]
Kamel, M [1 ]
Chen, L [1 ]
机构
[1] Univ Waterloo, Dept Elect & Comp Engn, Waterloo, ON N2L 3G1, Canada
来源
2004 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN & CYBERNETICS, VOLS 1-7 | 2004年
关键词
reinforcement learning; multiagent systems; aggregation;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Reinforcement learning (RL) is a learning technique that provides a means for learning an optimal control policy when the dynamics of the environment under consideration is unavailable [7, 13]. While RL has been successfully applied in many, single or multiple agents systems [1, 3, 14, 10], the learning quality is greatly influenced by learning algorithms and their parameters. Setting of the parameters of RL algorithms is something of a black art, and small differences in these parameters can lead to large differences in learning qualities. Determining the best algorithm. and the optimal parameters can be costly in terms of time and computation. Even if the cost is acceptable, the robustness of learning is still. a question. In order to address the difficulty, an Aggregated Multiagent Reinforcement Learning System. (AMRLS) is proposed to deal with the RL environment as a multiagent environment. A maze world environment is used to validate the AMRLS. Experimental results illustrate that compared with normal Q(lambda)-learning and SARSA(lambda) algorithms, the AMRLS increases both the learning speed and the rate of reaching the shortest path.
引用
收藏
页码:1303 / 1308
页数:6
相关论文
共 50 条
  • [1] Aggregation of multiple reinforcement learning algorithms
    Jiang, Ju
    Kamel, Mohamed S.
    Chen, Lei
    INTERNATIONAL JOURNAL ON ARTIFICIAL INTELLIGENCE TOOLS, 2006, 15 (05) : 855 - 861
  • [2] Reinforcement learning-based aggregation for robot swarms
    Amjadi, Arash Sadeghi
    Bilaloglu, Cem
    Turgut, Ali Emre
    Na, Seongin
    Sahin, Erol
    Krajnik, Tomas
    Arvin, Farshad
    ADAPTIVE BEHAVIOR, 2024, 32 (03) : 265 - 281
  • [3] Adaptive State Aggregation for Reinforcement Learning
    Hwang, Kao-Shing
    Chen, Yu-Jen
    Jiang, Wei-Cheng
    PROCEEDINGS 2012 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2012, : 2452 - 2456
  • [4] STATE AGGREGATION FOR REINFORCEMENT LEARNING USING NEUROEVOLUTION
    Wright, Robert
    Gemelli, Nathaniel
    ICAART 2009: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON AGENTS AND ARTIFICIAL INTELLIGENCE, 2009, : 45 - +
  • [5] Byzantine-Robust Aggregation for Federated Learning with Reinforcement Learning
    Yan, Sizheng
    Du, Junping
    Xue, Zhe
    Li, Ang
    WEB AND BIG DATA, APWEB-WAIM 2024, PT IV, 2024, 14964 : 152 - 166
  • [6] Aggregation Transfer Learning for Multi-Agent Reinforcement learning
    Xu, Dongsheng
    Qiao, Peng
    Dou, Yong
    2021 2ND INTERNATIONAL CONFERENCE ON BIG DATA & ARTIFICIAL INTELLIGENCE & SOFTWARE ENGINEERING (ICBASE 2021), 2021, : 547 - 551
  • [7] Effective Experiences Collection and State Aggregation in Reinforcement Learning
    Zhang, Tao
    Liu, Ying
    Chen, Yu-Jen
    Hwang, Kao-Shing
    IEEE ACCESS, 2019, 7 : 120917 - 120928
  • [8] Minimax-based reinforcement learning with state aggregation
    Jiang, GF
    Wu, CP
    Cybenko, G
    PROCEEDINGS OF THE 37TH IEEE CONFERENCE ON DECISION AND CONTROL, VOLS 1-4, 1998, : 1236 - 1241
  • [9] Feature-Based Aggregation and Deep Reinforcement Learning: A Survey and Some New Implementations
    Bertsekas, Dimitri P.
    IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2019, 6 (01) : 1 - 31
  • [10] Feature-Based Aggregation and Deep Reinforcement Learning:A Survey and Some New Implementations
    Dimitri P.Bertsekas
    IEEE/CAA Journal of Automatica Sinica, 2019, 6 (01) : 1 - 31