Convergence and Stability of Coupled Belief-Strategy Learning Dynamics in Continuous Games

被引:0
|
作者
Wu, Manxi [1 ]
Amin, Saurabh [2 ]
Ozdaglar, Asuman [3 ]
机构
[1] Cornell Univ, Sch Operat Res & Informat Engn, Ithaca, NY 14850 USA
[2] MIT, Lab Informat & Decis Syst, Cambridge, MA 02139 USA
[3] MIT, Dept Elect Engn & Comp Sci, Cambridge, MA 02139 USA
关键词
learning in games; Bayesian learning; stochastic dynamics; stability analysis; RESPONSE DYNAMICS; FICTITIOUS PLAY;
D O I
10.1287/moor.2022.0161
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
We propose a learning dynamics to model how strategic agents repeatedly play a continuous game while relying on an information platform to learn an unknown payoffrelevant parameter. In each time step, the platform updates a belief estimate of the parameter based on players' strategies and realized payoffs using Bayes' rule. Then, players adopt a generic learning rule to adjust their strategies based on the updated belief. We present results on the convergence of beliefs and strategies and the properties of convergent fixed points of the dynamics. We obtain sufficient and necessary conditions for the existence of globally stable fixed points. We also provide sufficient conditions for the local stability of fixed points. These results provide an approach to analyzing the long-term outcomes that arise from the interplay between Bayesian belief learning and strategy learning in games and enable us to characterize conditions under which learning leads to a complete information equilibrium.
引用
收藏
页数:24
相关论文
共 36 条
  • [1] Log-Linear Learning: Convergence in Discrete and Continuous Strategy Potential Games
    Tatarenko, Tatiana
    2014 IEEE 53RD ANNUAL CONFERENCE ON DECISION AND CONTROL (CDC), 2014, : 426 - 432
  • [2] Stability of Gradient Learning Dynamics in Continuous Games: Scalar Action Spaces
    Chasnov, Benjamin J.
    Calderone, Daniel
    Acikmese, Behcet
    Burden, Samuel A.
    Ratliff, Lillian J.
    2020 59TH IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2020, : 3543 - 3548
  • [3] Convergence of Learning Dynamics in Information Retrieval Games
    Ben-Porat, Omer
    Rosenberg, Itay
    Tennenholtz
    THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 1780 - 1787
  • [4] Imitative dynamics for games with continuous strategy space
    Cheung, Man-Wah
    GAMES AND ECONOMIC BEHAVIOR, 2016, 99 : 206 - 223
  • [5] Evolutionary dynamics and stability in discrete and continuous games
    Day, T
    Taylor, PD
    EVOLUTIONARY ECOLOGY RESEARCH, 2003, 5 (04) : 605 - 613
  • [6] Stochastic Learning Dynamics and Speed of Convergence in Population Games
    Arieli, Itai
    Young, H. Peyton
    ECONOMETRICA, 2016, 84 (02) : 627 - 676
  • [7] Pairwise comparison dynamics for games with continuous strategy space
    Cheung, Man-Wah
    JOURNAL OF ECONOMIC THEORY, 2014, 153 : 344 - 375
  • [8] Convergence Analysis of Gradient-Based Learning in Continuous Games
    Chasnov, Benjamin
    Ratliff, Lillian
    Mazumdar, Eric
    Burden, Samuel
    35TH UNCERTAINTY IN ARTIFICIAL INTELLIGENCE CONFERENCE (UAI 2019), 2020, 115 : 935 - 944
  • [9] ON THE STABILITY OF AN ADAPTIVE LEARNING DYNAMICS IN TRAFFIC GAMES
    Dumett, Miguel A.
    Cominetti, Roberto
    JOURNAL OF DYNAMICS AND GAMES, 2018, 5 (04): : 265 - 282
  • [10] Linear Last-Iterate Convergence for Continuous Games with Coupled Inequality Constraints
    Meng, Min
    Li, Xiuxian
    2023 62ND IEEE CONFERENCE ON DECISION AND CONTROL, CDC, 2023, : 1076 - 1081