Geometric bounds for convergence rates of averaging algorithms

被引:2
作者
Charron-Bost, Bernadette [1 ]
机构
[1] CNRS, Ecole Normale Super, Dept Informat, F-75005 Paris, France
关键词
CONSENSUS; TIME;
D O I
10.1016/j.ic.2022.104909
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
We develop a generic method for bounding the convergence rate of an averaging algorithm running in a multiagent system with a time-varying network, where the associated stochastic matrices have a time-independent Perron vector. The resulting bounds depend on geometric parameters of the dynamic communication graph such as the weighted diameter or the bottleneck measure. As corollaries, we show that the convergence rate of the Metropolis algorithm in a system of n agents is less than 1 - 1/4n2 if the communication graph is permanently connected and bidirectional. We prove a similar upper bound for the EqualNeighbor algorithm under the additional assumptions that the number of neighbors of each agent is constant and the communication graph is not too irregular. In general, our bounds offer improved convergence rates for several averaging algorithms and specific families of communication graphs.
引用
收藏
页数:24
相关论文
共 50 条
[21]   CONVERGENCE OF A DISTRIBUTED PARAMETER ESTIMATOR FOR SENSOR NETWORKS WITH LOCAL AVERAGING OF THE ESTIMATES [J].
Bianchi, P. ;
Fort, G. ;
Hachem, W. ;
Jakubowicz, J. .
2011 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2011, :3764-3767
[22]   Convergence Rates for Cooperation in Heterogeneous Populations [J].
Bean, Andrew ;
Kairouz, Peter ;
Singer, Andrew .
2012 CONFERENCE RECORD OF THE FORTY SIXTH ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS AND COMPUTERS (ASILOMAR), 2012, :531-534
[23]   On the existence of common Lyapunov functions for consensus algorithms based on averaging [J].
Akar, Mehmet ;
Shorten, Robert .
TURKISH JOURNAL OF ELECTRICAL ENGINEERING AND COMPUTER SCIENCES, 2011, 19 (03) :483-493
[24]   MAXIMIZING CONVERGENCE TIME IN NETWORK AVERAGING DYNAMICS SUBJECT TO EDGE REMOVAL [J].
Etesami, S. Rasoul .
SIAM JOURNAL ON OPTIMIZATION, 2022, 32 (04) :2718-2744
[25]   Finite Rate Quantized Distributed Optimization with Geometric Convergence [J].
Lee, Chang-Shen ;
Michelusi, Nicolo ;
Scutari, Gesualdo .
2018 CONFERENCE RECORD OF 52ND ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS, AND COMPUTERS, 2018, :1876-1880
[26]   Efficient learning algorithms yield circuit lower bounds [J].
Fortnow, Lance ;
Klivans, Adam R. .
JOURNAL OF COMPUTER AND SYSTEM SCIENCES, 2009, 75 (01) :27-36
[27]   Distributed Augmented Lagrangian Algorithms: Convergence Rate [J].
Jakovetic, Dusan ;
Moura, Jose M. F. ;
Xavier, Joao .
2013 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP), 2013, :563-566
[28]   Sharp Bounds for Genetic Drift in Estimation of Distribution Algorithms [J].
Doerr, Benjamin ;
Zheng, Weijie .
IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2020, 24 (06) :1140-1149
[29]   DISTRIBUTED NESTEROV GRADIENT METHODS FOR RANDOM NETWORKS: CONVERGENCE IN PROBABILITY AND CONVERGENCE RATES [J].
Jakovetic, Dusan ;
Xavier, Joao ;
Moura, Jose M. F. .
2014 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2014,
[30]   Rates of convergence of extremes for mixed exponential distributions [J].
Peng Zuoxiang ;
Weng, Zhichao ;
Nadarajah, Saralees .
MATHEMATICS AND COMPUTERS IN SIMULATION, 2010, 81 (01) :92-99