A Timestamp-Based Inertial Best-Response Dynamics for Distributed Nash Equilibrium Seeking in Weakly Acyclic Games

被引:7
作者
Tan, Shaolin [1 ]
Fang, Zhihong [1 ]
Wang, Yaonan [1 ]
Lu, Jinhu [2 ]
机构
[1] Hunan Univ, Coll Elect & Informat Engn, Changsha 410082, Peoples R China
[2] Beihang Univ, Beijing Adv Innovat Ctr Big Data & Brain Machine, Sch Automat Sci & Elect Engn, State Key Lab Software Dev Environm, Beijing 100191, Peoples R China
基金
中国国家自然科学基金;
关键词
Games; Nash equilibrium; Heuristic algorithms; Convergence; Communication networks; Protocols; Learning systems; Best-response dynamics; distributed Nash equilibrium seeking; finite games; game-theoretic learning; CONVERGENCE; CONSENSUS; PLAY;
D O I
10.1109/TNNLS.2022.3183250
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this article, we consider the problem of distributed game-theoretic learning in games with finite action sets. A timestamp-based inertial best-response dynamics is proposed for Nash equilibrium seeking by players over a communication network. We prove that if all players adhere to the dynamics, then the states of players will almost surely reach consensus and the joint action profile of players will be absorbed into a Nash equilibrium of the game. This convergence result is proven under the condition of weakly acyclic games and strongly connected networks. Furthermore, to encounter more general circumstances, such as games with graphical action sets, state-based games, and switching communication networks, several variants of the proposed dynamics and its convergent results are also developed. To demonstrate the validity and applicability, we apply the proposed timestamp-based learning dynamics to design distributed algorithms for solving some typical finite games, including the coordination games and congestion games.
引用
收藏
页码:1330 / 1340
页数:11
相关论文
共 18 条
  • [1] Utility Decoupling for Distributed Nash Equilibrium Seeking in Weakly Acyclic Games
    Tan, Shaolin
    Yang, Guang
    Gu, Haibo
    Liu, Kexin
    Lu, Jinhu
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2024, 54 (07): : 4031 - 4041
  • [2] A timestamp-based projected gradient play for distributed Nash equilibrium seeking in monotone games☆
    Tan, Shaolin
    AUTOMATICA, 2024, 160
  • [3] A timestamp-based Nesterov's accelerated projected gradient method for distributed Nash equilibrium seeking in monotone games
    Liu, Nian
    Tan, Shaolin
    Tao, Ye
    Lue, Jinhu
    SYSTEMS & CONTROL LETTERS, 2024, 194
  • [4] Distributed best response dynamics for Nash equilibrium seeking in potential games
    Huang, Shijie
    Yi, Peng
    CONTROL THEORY AND TECHNOLOGY, 2020, 18 (03) : 324 - 332
  • [5] Distributed best response dynamics for Nash equilibrium seeking in potential games
    Shijie Huang
    Peng Yi
    Control Theory and Technology, 2020, 18 : 324 - 332
  • [6] Distributed Inertial Best-Response Dynamics
    Swenson, Brian
    Eksin, Ceyhun
    Kar, Soummya
    Ribeiro, Alejandro
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2018, 63 (12) : 4294 - 4300
  • [7] Distributed Nash Equilibrium Seeking for Aggregative Games With Nonlinear Dynamics Under External Disturbances
    Zhang, Yawei
    Liang, Shu
    Wang, Xinghu
    Ji, Haibo
    IEEE TRANSACTIONS ON CYBERNETICS, 2020, 50 (12) : 4876 - 4885
  • [8] Nash Equilibrium in Iterated Multiplayer Games Under Asynchronous Best-Response Dynamics
    Zhu, Yuying
    Xia, Chengyi
    Chen, Zengqiang
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2023, 68 (09) : 5798 - 5805
  • [9] Compression-Based Privacy Preservation for Distributed Nash Equilibrium Seeking in Aggregative Games
    Huo, Wei
    Chen, Xiaomeng
    Ding, Kemi
    Dey, Subhrakanti
    Shi, Ling
    IEEE CONTROL SYSTEMS LETTERS, 2024, 8 : 886 - 891
  • [10] Distributed Robust Nash Equilibrium Seeking for Mixed-Order Games by a Neural-Network-Based Approach
    Ye, Maojiao
    Ding, Lei
    Yin, Jizhao
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2023, 53 (08): : 4808 - 4819