Geometric Convergence of Gradient Play Algorithms for Distributed Nash Equilibrium Seeking

被引:67
作者
Tatarenko, Tatiana [1 ]
Shi, Wei [1 ]
Nedic, Angelia [2 ]
机构
[1] Arizona State Univ, Sch Elect Comp & Energy Engn, Phoenix, AZ 85004 USA
[2] Moscow Inst Phys & Technol, Dolgoprudnyi 141701, Russia
关键词
Games; Nash equilibrium; Convergence; Cost function; Acceleration; Distributed algorithms; Symmetric matrices; gradient methods; multi-agent systems; GAMES;
D O I
10.1109/TAC.2020.3046232
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We study distributed algorithms for seeking a Nash equilibrium in a class of convex networked Nash games with strongly monotone mappings. Each player has access to her own smooth local cost function and can communicate to her neighbors in some undirected graph. To deal with fast distributed learning of Nash equilibria under such settings, we introduce a so called augmented game mapping and provide conditions under which this mapping is strongly monotone. We consider a distributed gradient play algorithm for determining a Nash equilibrium (GRANE). The algorithm involves every player performing a gradient step to minimize her own cost function while sharing and retrieving information locally among her neighbors in the network. Using the reformulation of the Nash equilibrium problem based on the strong monotone augmented game mapping, we prove the convergence of this algorithm to a Nash equilibrium with a geometric rate. Furthermore, we introduce the Nesterov type acceleration for the gradient play algorithm. We demonstrate that, similarly to the accelerated algorithms in centralized optimization and variational inequality problems, our accelerated algorithm outperforms GRANE in the convergence rate. Moreover, to relax assumptions required to guarantee the strongly monotone augmented mapping, we analyze the restricted strongly monotone property of this mapping and prove geometric convergence of the distributed gradient play under milder assumptions.
引用
收藏
页码:5342 / 5353
页数:12
相关论文
共 32 条
[1]   Distributed algorithms for Nash equilibria of flow control games [J].
Alpcan, T ;
Basar, T .
ADVANCES IN DYNAMIC GAMES: APPLICATIONS TO ECONOMICS, FINANCE, OPTIMIZATION, AND STOCHASTIC CONTROL, 2005, 7 :473-498
[2]   Noncooperative and Cooperative Optimization of Distributed Energy Generation and Storage in the Demand-Side of the Smart Grid [J].
Atzeni, Italo ;
Ordonez, Luis G. ;
Scutari, Gesualdo ;
Palomar, Daniel P. ;
Fonollosa, Javier R. .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2013, 61 (10) :2454-2472
[3]  
Brouwer AE, 2012, UNIVERSITEXT, P1, DOI 10.1007/978-1-4614-1939-6
[4]   Distributed Generalized Nash Equilibrium Seeking Algorithm Design for Aggregative Games Over Weight-Balanced Digraphs [J].
Deng, Zhenhua ;
Nian, Xiaohong .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2019, 30 (03) :695-706
[5]   Nash Equilibrium Seeking in Noncooperative Games [J].
Frihauf, Paul ;
Krstic, Miroslav ;
Basar, Tamer .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2012, 57 (05) :1192-1207
[6]   A Passivity-Based Approach to Nash Equilibrium Seeking Over Networks [J].
Gadjov, Dian ;
Pavel, Lacra .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2019, 64 (03) :1077-1092
[7]  
Koshal J, 2012, IEEE DECIS CONTR P, P4840, DOI 10.1109/CDC.2012.6426136
[8]   Designing Games for Distributed Optimization [J].
Li, Na ;
Marden, Jason R. .
IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2013, 7 (02) :230-242
[9]   A Decentralized Proximal-Gradient Method With Network Independent Step-Sizes and Separated Convergence Rates [J].
Li, Zhi ;
Shi, Wei ;
Yan, Ming .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2019, 67 (17) :4494-4506
[10]   Revisiting log-linear learning: Asynchrony, completeness and payoff-based implementation [J].
Marden, Jason R. ;
Shamma, Jeff S. .
GAMES AND ECONOMIC BEHAVIOR, 2012, 75 (02) :788-808