ADD-OPT: Accelerated Distributed Directed Optimization

被引:147
作者
Xi, Chenguang [1 ]
Xin, Ran [1 ]
Khan, Usman A. [1 ]
机构
[1] Tufts Univ, Dept Elect & Comp Engn, Medford, MA 02155 USA
关键词
DEXTRA; directed graph; distributed optimization; linear convergence; DECENTRALIZED CONSENSUS OPTIMIZATION; CONVEX-OPTIMIZATION; SUBGRADIENT METHODS; ALGORITHM; NETWORKS; DIGRAPHS; GRAPHS; COMMUNICATION; COMPUTATION; SPECTRUM;
D O I
10.1109/TAC.2017.2737582
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we consider distributed optimization problems where the goal is to minimize a sum of objective functions over a multiagent network. We focus on the case when the interagent communication is described by a strongly connected, directed graph. The proposed algorithm, Accelerated Distributed Directed OPTimization (ADD-OPT), achieves the best known convergence rate for this class of problems, O(mu(k)), 0 < mu < 1, given strongly convex, objective functions with globally Lipschitz-continuous gradients, where k is the number of iterations. Moreover, ADD-OPT supports a wider and more realistic range of step sizes in contrast to existing work. In particular, we show that ADD-OPT converges for arbitrarily small (positive) step sizes. Simulations further illustrate our results.
引用
收藏
页码:1329 / 1339
页数:11
相关论文
共 43 条
[1]   Convex Optimization: Algorithms and Complexity [J].
不详 .
FOUNDATIONS AND TRENDS IN MACHINE LEARNING, 2015, 8 (3-4) :232-+
[2]  
[Anonymous], 2013, Matrix Analysis
[3]  
[Anonymous], 2009, PROC 2 IFIP WIREL DA
[4]  
[Anonymous], FOUND TRENDS MACH LE
[5]  
[Anonymous], 1987, Introduction to optimization: optimization software
[6]  
[Anonymous], 2013, MATRIX ANAL
[7]  
[Anonymous], 2013, THESIS
[8]   Distributed Spectrum Sensing for Cognitive Radio Networks by Exploiting Sparsity [J].
Bazerque, Juan Andres ;
Giannakis, Georgios B. .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2010, 58 (03) :1847-1862
[9]   Weighted Gossip: Distributed Averaging Using Non-Doubly Stochastic Matrices [J].
Benezit, Florence ;
Blondel, Vincent ;
Thiran, Patrick ;
Tsitsiklis, John ;
Vetterli, Martin .
2010 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY, 2010, :1753-1757
[10]  
Bullo F., 2009, Lectures on Network Systems