Distributed Subgradient Projection Algorithm Over Directed Graphs

被引:138
作者
Xi, Chenguang [1 ]
Khan, Usman A. [1 ]
机构
[1] Tufts Univ, Elect & Comp Engn Dept, Medford, MA 02155 USA
基金
美国国家科学基金会;
关键词
Constrained optimization; directed graphs; distributed optimization; projected subgradient; CONVEX-OPTIMIZATION; CONSENSUS; ADMM;
D O I
10.1109/TAC.2016.2615066
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We propose Directed-Distributed Projected Subgradient (D-DPS) to solve a constrained optimization problem over a multi-agent network, where the goal of agents is to collectively minimize the sum of locally known convex functions. Each agent in the network owns only its local objective function, constrained to a commonly known convex set. We focus on the circumstance when communications between agents are described by a directed network. The D-DPS combines surplus consensus to overcome the asymmetry caused by the directed communication network. The analysis shows the convergence rate to be O(ln k/root k).
引用
收藏
页码:3986 / 3992
页数:7
相关论文
共 30 条
[1]  
[Anonymous], 2015, ARXIV151002149
[2]  
[Anonymous], ARXIV151002146
[3]  
[Anonymous], 2012, MATH PROGRAMMING
[4]   Weighted Gossip: Distributed Averaging Using Non-Doubly Stochastic Matrices [J].
Benezit, Florence ;
Blondel, Vincent ;
Thiran, Patrick ;
Tsitsiklis, John ;
Vetterli, Martin .
2010 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY, 2010, :1753-1757
[5]  
Bianchi P., 2014, ARXIV14070898
[6]   Average consensus on general strongly connected digraphs [J].
Cai, Kai ;
Ishii, Hideaki .
AUTOMATICA, 2012, 48 (11) :2750-2761
[7]   Convex Optimization for Big Data [J].
Cevher, Volkan ;
Becker, Stephen ;
Schmidt, Mark .
IEEE SIGNAL PROCESSING MAGAZINE, 2014, 31 (05) :32-43
[8]   Dual Averaging for Distributed Optimization: Convergence Analysis and Network Scaling [J].
Duchi, John C. ;
Agarwal, Alekh ;
Wainwright, Martin J. .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2012, 57 (03) :592-606
[9]   Linear Convergence Rate of a Class of Distributed Augmented Lagrangian Algorithms [J].
Jakovetic, Dusan ;
Moura, Jose M. F. ;
Xavier, Joao .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2015, 60 (04) :922-936
[10]   Fast Distributed Gradient Methods [J].
Jakovetic, Dusan ;
Xavier, Joao ;
Moura, Jose M. F. .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2014, 59 (05) :1131-1146