Parallel alternating direction method of multipliers

被引:19
作者
Yan, Jiaqi [1 ]
Guo, Fanghong [2 ]
Wen, Changyun [1 ]
Li, Guoqi [3 ]
机构
[1] Nanyang Technol Univ, Singapore, Singapore
[2] Zhejiang Univ Technol, Hangzhou, Zhejiang, Peoples R China
[3] Tsinghua Univ, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Distributed optimization; ADMM; Parallel algorithm; DISTRIBUTED OPTIMIZATION; SENSOR NETWORKS; CONSENSUS; ALGORITHM; ADMM; DECOMPOSITION; CONVERGENCE;
D O I
10.1016/j.ins.2019.08.039
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we consider the distributed optimization problem, where the objective function is the sum of local cost functions. To solve this problem, a new parallel Alternating Direction Method of Multipliers (ADMM) algorithm is developed, which guarantees that the agents cooperatively reach an optimal agreement. Different from most of the existing ADMM approaches, our algorithm allows all the agents to update their local variables simultaneously in a parallel manner. It is theoretically proved that the local solutions of all the agents could reach a consensus, and converge to the optimal solution asymptotically with the rate of O(1/k). Numerical examples are finally provided to validate the effectiveness of the proposed method. (C) 2019 Elsevier Inc. All rights reserved.
引用
收藏
页码:185 / 196
页数:12
相关论文
共 38 条
[1]   A zero-gradient-sum algorithm for distributed cooperative learning using a feedforward neural network with random weights [J].
Ai, Wu ;
Chen, Weisheng ;
Xie, Jin .
INFORMATION SCIENCES, 2016, 373 :404-418
[2]  
Anderson Jr W. N., 1985, Linear Multilinear Algebra, V18, P141
[3]  
[Anonymous], 2014, Advances in Neural Information Processing Systems
[4]  
Boyd S., 2011, DISTRIBUTED OPTIMIZA, DOI DOI 10.1561/2200000016
[5]  
Droge G., 2014, J CONTROL DECIS, V1, P191
[6]   Dual Averaging for Distributed Optimization: Convergence Analysis and Network Scaling [J].
Duchi, John C. ;
Agarwal, Alekh ;
Wainwright, Martin J. .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2012, 57 (03) :592-606
[7]  
Gharesifard B, 2012, IEEE DECIS CONTR P, P7451, DOI 10.1109/CDC.2012.6426897
[8]  
Gordon G., 2012, Optimization, V10, P725
[9]   A distributed hierarchical algorithm for multi-cluster constrained optimization [J].
Guo, Fanghong ;
Wen, Changyun ;
Mao, Jianfeng ;
Li, Guoqi ;
Song, Yong-Duan .
AUTOMATICA, 2017, 77 :230-238
[10]   ON FULL JACOBIAN DECOMPOSITION OF THE AUGMENTED LAGRANGIAN METHOD FOR SEPARABLE CONVEX PROGRAMMING [J].
He, Bingsheng ;
Hou, Liusheng ;
Yuan, Xiaoming .
SIAM JOURNAL ON OPTIMIZATION, 2015, 25 (04) :2274-2312