ADD-OPT: Accelerated Distributed Directed Optimization

被引:133
作者
Xi, Chenguang [1 ]
Xin, Ran [1 ]
Khan, Usman A. [1 ]
机构
[1] Tufts Univ, Dept Elect & Comp Engn, Medford, MA 02155 USA
关键词
DEXTRA; directed graph; distributed optimization; linear convergence; DECENTRALIZED CONSENSUS OPTIMIZATION; CONVEX-OPTIMIZATION; SUBGRADIENT METHODS; ALGORITHM; NETWORKS; DIGRAPHS; GRAPHS; COMMUNICATION; COMPUTATION; SPECTRUM;
D O I
10.1109/TAC.2017.2737582
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we consider distributed optimization problems where the goal is to minimize a sum of objective functions over a multiagent network. We focus on the case when the interagent communication is described by a strongly connected, directed graph. The proposed algorithm, Accelerated Distributed Directed OPTimization (ADD-OPT), achieves the best known convergence rate for this class of problems, O(mu(k)), 0 < mu < 1, given strongly convex, objective functions with globally Lipschitz-continuous gradients, where k is the number of iterations. Moreover, ADD-OPT supports a wider and more realistic range of step sizes in contrast to existing work. In particular, we show that ADD-OPT converges for arbitrarily small (positive) step sizes. Simulations further illustrate our results.
引用
收藏
页码:1329 / 1339
页数:11
相关论文
共 43 条
  • [1] Convex Optimization: Algorithms and Complexity
    不详
    [J]. FOUNDATIONS AND TRENDS IN MACHINE LEARNING, 2015, 8 (3-4): : 232 - +
  • [2] [Anonymous], 2013, Matrix Analysis
  • [3] [Anonymous], 2009, PROC 2 IFIP WIREL DA
  • [4] [Anonymous], FOUND TRENDS MACH LE
  • [5] [Anonymous], 1987, Introduction to optimization: optimization software
  • [6] [Anonymous], 2013, MATRIX ANAL
  • [7] [Anonymous], 2013, THESIS
  • [8] Distributed Spectrum Sensing for Cognitive Radio Networks by Exploiting Sparsity
    Bazerque, Juan Andres
    Giannakis, Georgios B.
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2010, 58 (03) : 1847 - 1862
  • [9] Weighted Gossip: Distributed Averaging Using Non-Doubly Stochastic Matrices
    Benezit, Florence
    Blondel, Vincent
    Thiran, Patrick
    Tsitsiklis, John
    Vetterli, Martin
    [J]. 2010 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY, 2010, : 1753 - 1757
  • [10] Bullo F., 2009, Lectures on Network Systems