DISTRIBUTED ACCELERATED NASH EQUILIBRIUM LEARNING FOR TWO-SUBNETWORK ZERO-SUM GAME WITH BILINEAR COUPLING

被引:0
作者
Zeng, Xianlin [1 ]
Dou, Lihua [1 ]
Cui, Jinqiang [2 ]
机构
[1] Beijing Inst Technol, Sch Automat, Natl Key Lab Autonomous Intelligent Unmanned Syst, Beijing 100081, Peoples R China
[2] Peng Cheng Lab, Shenzhen 518055, Peoples R China
基金
中国国家自然科学基金;
关键词
two-subnetwork zero-sum game; distributed accelerated algorithm; Nash equilibrium learning; nonsmooth function; continuous-time algorithm; SADDLE-POINT DYNAMICS; CONVEX-OPTIMIZATION; CONVERGENCE; STABILITY; ALGORITHM;
D O I
10.14736/kyb-2023-3-0418
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
This paper proposes a distributed accelerated first-order continuous-time algorithm for O(1/t2) convergence to Nash equilibria in a class of two-subnetwork zero-sum games with bi-linear couplings. First-order methods, which only use subgradients of functions, are frequently used in distributed/parallel algorithms for solving large-scale and big-data problems due to their simple structures. However, in the worst cases, first-order methods for two-subnetwork zero-sum games often have an asymptotic or O(1/t) convergence. In contrast to existing time -invariant first-order methods, this paper designs a distributed accelerated algorithm by combin-ing saddle-point dynamics and time-varying derivative feedback techniques. If the parameters of the proposed algorithm are suitable, the algorithm owns O(1/t2) convergence in terms of the duality gap function without any uniform or strong convexity requirement. Numerical simulations show the efficacy of the algorithm.
引用
收藏
页码:418 / 436
页数:19
相关论文
共 19 条
  • [1] Nash Equilibrium Computation in Subnetwork Zero-Sum Games With Switching Communications
    Lou, Youcheng
    Hong, Yiguang
    Xie, Lihua
    Shi, Guodong
    Johansson, Karl Henrik
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2016, 61 (10) : 2920 - 2935
  • [2] Distributed Algorithm for Continuous-Type Bayesian Nash Equilibrium in Subnetwork Zero-Sum Games
    Zhang, Hanzheng
    Chen, Guanpu
    Hong, Yiguang
    IEEE TRANSACTIONS ON CONTROL OF NETWORK SYSTEMS, 2024, 11 (02): : 915 - 927
  • [3] No-Regret Distributed Learning in Subnetwork Zero-Sum Games
    Huang, Shijie
    Lei, Jinlong
    Hong, Yiguang
    Shanbhag, Uday V.
    Chen, Jie
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2024, 69 (10) : 6620 - 6635
  • [4] Distributed convergence to Nash equilibria in two-network zero-sum games
    Gharesifard, B.
    Cortes, J.
    AUTOMATICA, 2013, 49 (06) : 1683 - 1692
  • [5] Nash equilibrium computation in two-network zero-sum games: An incremental algorithm
    Shi, Chong-Xiao
    Yang, Guang-Hong
    NEUROCOMPUTING, 2019, 359 (114-121) : 114 - 121
  • [6] Nash equilibrium computation of two-network zero-sum games with event-triggered communication
    Xiong, Hongyun
    Han, Jiangxiong
    Nian, Xiaohong
    Li, Shiling
    JOURNAL OF CONTROL AND DECISION, 2022, 9 (03) : 334 - 346
  • [7] Distributed projection subgradient algorithm for two-network zero-sum game with random sleep scheme
    Xiong, Hongyun
    Han, Jiangxiong
    Nian, Xiaohong
    Li, Shiling
    CONTROL THEORY AND TECHNOLOGY, 2021, 19 (03) : 405 - 417
  • [8] Stability and Stabilization of Nash Equilibrium for Uncertain Noncooperative Dynamical Systems With Zero-Sum Tax/Subsidy Approach
    Yan, Yuyue
    Hayakawa, Tomohisa
    IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (11) : 11287 - 11298
  • [9] Approximate Nash Solutions for Multiplayer Mixed-Zero-Sum Game With Reinforcement Learning
    Lv, Yongfeng
    Ren, Xuemei
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2019, 49 (12): : 2739 - 2750
  • [10] Online Minimax Q Network Learning for Two-Player Zero-Sum Markov Games
    Zhu, Yuanheng
    Zhao, Dongbin
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (03) : 1228 - 1241