ADD-OPT: Accelerated Distributed Directed Optimization

被引:133
作者
Xi, Chenguang [1 ]
Xin, Ran [1 ]
Khan, Usman A. [1 ]
机构
[1] Tufts Univ, Dept Elect & Comp Engn, Medford, MA 02155 USA
关键词
DEXTRA; directed graph; distributed optimization; linear convergence; DECENTRALIZED CONSENSUS OPTIMIZATION; CONVEX-OPTIMIZATION; SUBGRADIENT METHODS; ALGORITHM; NETWORKS; DIGRAPHS; GRAPHS; COMMUNICATION; COMPUTATION; SPECTRUM;
D O I
10.1109/TAC.2017.2737582
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we consider distributed optimization problems where the goal is to minimize a sum of objective functions over a multiagent network. We focus on the case when the interagent communication is described by a strongly connected, directed graph. The proposed algorithm, Accelerated Distributed Directed OPTimization (ADD-OPT), achieves the best known convergence rate for this class of problems, O(mu(k)), 0 < mu < 1, given strongly convex, objective functions with globally Lipschitz-continuous gradients, where k is the number of iterations. Moreover, ADD-OPT supports a wider and more realistic range of step sizes in contrast to existing work. In particular, we show that ADD-OPT converges for arbitrarily small (positive) step sizes. Simulations further illustrate our results.
引用
收藏
页码:1329 / 1339
页数:11
相关论文
共 43 条
  • [31] Harnessing Smoothness to Accelerate Distributed Optimization
    Qu, Guannan
    Li, Na
    [J]. IEEE TRANSACTIONS ON CONTROL OF NETWORK SYSTEMS, 2018, 5 (03): : 1245 - 1260
  • [32] Rabbat M, 2004, IPSN '04: THIRD INTERNATIONAL SYMPOSIUM ON INFORMATION PROCESSING IN SENSOR NETWORKS, P20
  • [33] Distributed Stochastic Subgradient Projection Algorithms for Convex Optimization
    Ram, S. Sundhar
    Nedic, A.
    Veeravalli, V. V.
    [J]. JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2010, 147 (03) : 516 - 545
  • [34] EXTRA: AN EXACT FIRST-ORDER ALGORITHM FOR DECENTRALIZED CONSENSUS OPTIMIZATION
    Shi, Wei
    Ling, Qing
    Wu, Gang
    Yin, Wotao
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2015, 25 (02) : 944 - 966
  • [35] On the Linear Convergence of the ADMM in Decentralized Consensus Optimization
    Shi, Wei
    Ling, Qing
    Yuan, Kun
    Wu, Gang
    Yin, Wotao
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2014, 62 (07) : 1750 - 1761
  • [36] Push-Sum Distributed Dual Averaging for Convex Optimization
    Tsianos, Konstantinos I.
    Lawlor, Sean
    Rabbat, Michael G.
    [J]. 2012 IEEE 51ST ANNUAL CONFERENCE ON DECISION AND CONTROL (CDC), 2012, : 5453 - 5458
  • [37] Tsianos KI, 2012, ANN ALLERTON CONF, P1543, DOI 10.1109/Allerton.2012.6483403
  • [38] Wei E, 2012, IEEE DECIS CONTR P, P5445, DOI 10.1109/CDC.2012.6425904
  • [39] Xi C., 2017, IEEE T AUTO IN PRESS
  • [40] On the distributed optimization over directed networks
    Xi, Chenguang
    Wu, Qiong
    Khan, Usman A.
    [J]. NEUROCOMPUTING, 2017, 267 : 508 - 515