Robustness of Learning in Games With Heterogeneous Players

被引:2
|
作者
Akbar, Aqsa Shehzadi [1 ]
Jaleel, Hassan [1 ]
Abbas, Waseem [2 ]
Shamma, Jeff S. [3 ]
机构
[1] Syed Babar Ali Sch Sci & Engn LUMS, Dept Elect Engn, Intelligent Machines & Sociotechn Syst iMaSS Lab, Lahore 54792, Pakistan
[2] Univ Texas Dallas, Syst Engn Dept, Richardson, TX 75080 USA
[3] Univ Illinois, Dept Head & Dobrovolny Chair Ind & Enterprise Syst, Champaign, IL 61801 USA
关键词
Games; Robustness; Statistics; Sociology; Resistance; Markov processes; Network topology; Game theory; heterogeneous agents; stochastic systems; STOCHASTIC STABILITY; LONG-RUN; EQUILIBRIA; EVOLUTION; DYNAMICS;
D O I
10.1109/TAC.2022.3166717
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We consider stochastic learning dynamics in games and present a novel notion of robustness to heterogeneous players for a stochastically stable action profile. A standard assumption in these dynamics is that all the players are homogeneous, and their decision strategies can be modeled as perturbed versions of myopic best or better response strategies. We relax this assumption and propose a robustness criteria, which characterizes a stochastically stable action profile as robust to heterogeneous behaviors if a small fraction of heterogeneous players cannot alter the long-run behavior of the rest of the population. In particular, we consider confused players who randomly update their actions, stubborn players who never update their actions, and strategic players who attempt to manipulate the population behavior. We establish that radius-coradius based analysis can provide valuable insights into the robustness properties of stochastic learning dynamics for various game settings. We derive sufficient conditions for a stochastically stable profile to be robust to a confused, stubborn, or strategic player and elaborate these conditions through carefully designed examples. Then we explore the role of network structure in our proposed notion of robustness by considering graphical coordination games and identifying network topologies in which a single heterogeneous player is sufficient to alter the population's behavior. Our results will provide foundations for future research on designing networked systems that are robust to players with heterogeneous decision strategies.
引用
收藏
页码:1553 / 1567
页数:15
相关论文
共 50 条
  • [1] On the robustness of learning in games with stochastically perturbed payoff observations
    Bravo, Mario
    Mertikopoulos, Panayotis
    GAMES AND ECONOMIC BEHAVIOR, 2017, 103 : 41 - 66
  • [2] Stochastic adaptation in finite games played by heterogeneous populations
    Josephson, Jens
    JOURNAL OF ECONOMIC DYNAMICS & CONTROL, 2009, 33 (08): : 1543 - 1554
  • [3] Stability in large Bayesian games with heterogeneous players
    Deb, Joyee
    Kalai, Ehud
    JOURNAL OF ECONOMIC THEORY, 2015, 157 : 1041 - 1055
  • [4] Robustness Of Stochastic Learning Dynamics To Player Heterogeneity In Games
    Jaleel, Hassan
    Abbas, Waseem
    Shamma, Jeff S.
    2019 IEEE 58TH CONFERENCE ON DECISION AND CONTROL (CDC), 2019, : 5002 - 5007
  • [5] On network formation games with heterogeneous players and basic network creation games
    Kaklamanis, Christos
    Kanellopoulos, Panagiotis
    Tsokana, Sophia
    THEORETICAL COMPUTER SCIENCE, 2018, 717 : 62 - 72
  • [6] On Network Formation Games with Heterogeneous Players and Basic Network Creation Games
    Kaklamanis, Christos
    Kanellopoulos, Panagiotis
    Tsokana, Sophia
    ALGORITHMIC ASPECTS IN INFORMATION AND MANAGEMENT, 2016, 9778 : 125 - 136
  • [7] On Passivity, Reinforcement Learning, and Higher Order Learning in Multiagent Finite Games
    Gao, Bolin
    Pavel, Lacra
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2021, 66 (01) : 121 - 136
  • [8] Learning by (limited) forward looking players
    Mengel, Friederike
    JOURNAL OF ECONOMIC BEHAVIOR & ORGANIZATION, 2014, 108 : 59 - 77
  • [9] Learning With Heterogeneous Misspecified Models: Characterization and Robustness
    Bohren, J. Aislinn
    Hauser, Daniel N.
    ECONOMETRICA, 2021, 89 (06) : 3025 - 3077
  • [10] The limits and robustness of reinforcement learning in Lewis signalling games
    Catteeuw, David
    Manderick, Bernard
    CONNECTION SCIENCE, 2014, 26 (02) : 161 - 177