ADD-OPT: Accelerated Distributed Directed Optimization

被引:147
作者
Xi, Chenguang [1 ]
Xin, Ran [1 ]
Khan, Usman A. [1 ]
机构
[1] Tufts Univ, Dept Elect & Comp Engn, Medford, MA 02155 USA
关键词
DEXTRA; directed graph; distributed optimization; linear convergence; DECENTRALIZED CONSENSUS OPTIMIZATION; CONVEX-OPTIMIZATION; SUBGRADIENT METHODS; ALGORITHM; NETWORKS; DIGRAPHS; GRAPHS; COMMUNICATION; COMPUTATION; SPECTRUM;
D O I
10.1109/TAC.2017.2737582
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we consider distributed optimization problems where the goal is to minimize a sum of objective functions over a multiagent network. We focus on the case when the interagent communication is described by a strongly connected, directed graph. The proposed algorithm, Accelerated Distributed Directed OPTimization (ADD-OPT), achieves the best known convergence rate for this class of problems, O(mu(k)), 0 < mu < 1, given strongly convex, objective functions with globally Lipschitz-continuous gradients, where k is the number of iterations. Moreover, ADD-OPT supports a wider and more realistic range of step sizes in contrast to existing work. In particular, we show that ADD-OPT converges for arbitrarily small (positive) step sizes. Simulations further illustrate our results.
引用
收藏
页码:1329 / 1339
页数:11
相关论文
共 43 条
[31]   Harnessing Smoothness to Accelerate Distributed Optimization [J].
Qu, Guannan ;
Li, Na .
IEEE TRANSACTIONS ON CONTROL OF NETWORK SYSTEMS, 2018, 5 (03) :1245-1260
[32]  
Rabbat M, 2004, IPSN '04: THIRD INTERNATIONAL SYMPOSIUM ON INFORMATION PROCESSING IN SENSOR NETWORKS, P20
[33]   Distributed Stochastic Subgradient Projection Algorithms for Convex Optimization [J].
Ram, S. Sundhar ;
Nedic, A. ;
Veeravalli, V. V. .
JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2010, 147 (03) :516-545
[34]   EXTRA: AN EXACT FIRST-ORDER ALGORITHM FOR DECENTRALIZED CONSENSUS OPTIMIZATION [J].
Shi, Wei ;
Ling, Qing ;
Wu, Gang ;
Yin, Wotao .
SIAM JOURNAL ON OPTIMIZATION, 2015, 25 (02) :944-966
[35]   On the Linear Convergence of the ADMM in Decentralized Consensus Optimization [J].
Shi, Wei ;
Ling, Qing ;
Yuan, Kun ;
Wu, Gang ;
Yin, Wotao .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2014, 62 (07) :1750-1761
[36]   Push-Sum Distributed Dual Averaging for Convex Optimization [J].
Tsianos, Konstantinos I. ;
Lawlor, Sean ;
Rabbat, Michael G. .
2012 IEEE 51ST ANNUAL CONFERENCE ON DECISION AND CONTROL (CDC), 2012, :5453-5458
[37]  
Tsianos KI, 2012, ANN ALLERTON CONF, P1543, DOI 10.1109/Allerton.2012.6483403
[38]  
Wei E, 2012, IEEE DECIS CONTR P, P5445, DOI 10.1109/CDC.2012.6425904
[39]  
Xi C., 2017, IEEE T AUTO IN PRESS
[40]   On the distributed optimization over directed networks [J].
Xi, Chenguang ;
Wu, Qiong ;
Khan, Usman A. .
NEUROCOMPUTING, 2017, 267 :508-515