Linear Convergence of ADMM Under Metric Subregularity for Distributed Optimization

被引:4
作者
Pan, Xiaowei [1 ]
Liu, Zhongxin [1 ]
Chen, Zengqiang [1 ]
机构
[1] Nankai Univ, Coll Artificial Intelligence, Tianjin 300350, Peoples R China
基金
中国国家自然科学基金;
关键词
Convergence; Convex functions; Measurement; Optimization; Cost function; Symmetric matrices; Simulation; Alternating direction method of multipliers (ADMM); composite optimization; distributed optimization; linear rate; metric subregularity; nonergodic; ALTERNATING DIRECTION METHOD; OPTIMALITY CONDITIONS; ALGORITHM; CONSENSUS;
D O I
10.1109/TAC.2022.3185178
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The alternating direction method of multipliers (ADMM) has seen much progress in the literature in recent years. Usually, linear convergence of distributed ADMM is proved under either second-order conditions or strong convexity. When both conditions fail, an alternative is expected to play the role. In this article, it is shown that distributed ADMM can achieve a linear convergence rate by imposing metric subregularity on a defined mapping. Furthermore, it is proved that both second-order conditions and strong convexity imply metric subregularity under reasonable conditions, e.g., the cost functions being twice continuously differentiable in a neighborhood. In addition, nonergodic convergence rates are presented as well for problems under consideration. Finally, simulation results are carried out to illustrate the efficiency of the proposed algorithm.
引用
收藏
页码:2513 / 2520
页数:8
相关论文
共 48 条
[1]   Distributed Linearized Alternating Direction Method of Multipliers for Composite Convex Consensus Optimization [J].
Aybat, N. S. ;
Wang, Z. ;
Lin, T. ;
Ma, S. .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2018, 63 (01) :5-20
[2]  
Bauschke HH, 2011, CMS BOOKS MATH, P1, DOI 10.1007/978-1-4419-9467-7
[3]   Distributed optimization and statistical learning via the alternating direction method of multipliers [J].
Boyd S. ;
Parikh N. ;
Chu E. ;
Peleato B. ;
Eckstein J. .
Foundations and Trends in Machine Learning, 2010, 3 (01) :1-122
[4]  
Boyd S. P., 2014, Convex Optimization
[5]   Proximal Splitting Methods in Signal Processing [J].
Combettes, Patrick L. ;
Pesquet, Jean-Christophe .
FIXED-POINT ALGORITHMS FOR INVERSE PROBLEMS IN SCIENCE AND ENGINEERING, 2011, 49 :185-+
[6]   Dual Averaging for Distributed Optimization: Convergence Analysis and Network Scaling [J].
Duchi, John C. ;
Agarwal, Alekh ;
Wainwright, Martin J. .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2012, 57 (03) :592-606
[7]   ON LIPSCHITZIAN PROPERTIES OF IMPLICIT MULTIFUNCTIONS [J].
Gfrerer, Helmut ;
Outrata, Jiri V. .
SIAM JOURNAL ON OPTIMIZATION, 2016, 26 (04) :2160-2189
[8]   Lipschitz and Holder stability of optimization problems and generalized equations [J].
Gfrerer, Helmut ;
Klatte, Diethard .
MATHEMATICAL PROGRAMMING, 2016, 158 (1-2) :35-75
[9]   OPTIMALITY CONDITIONS FOR DISJUNCTIVE PROGRAMS BASED ON GENERALIZED DIFFERENTIATION WITH APPLICATION TO MATHEMATICAL PROGRAMS WITH EQUILIBRIUM CONSTRAINTS [J].
Gfrerer, Helmut .
SIAM JOURNAL ON OPTIMIZATION, 2014, 24 (02) :898-931
[10]   ON DIRECTIONAL METRIC SUBREGULARITY AND SECOND-ORDER OPTIMALITY CONDITIONS FOR A CLASS OF NONSMOOTH MATHEMATICAL PROGRAMS [J].
Gfrerer, Helmut .
SIAM JOURNAL ON OPTIMIZATION, 2013, 23 (01) :632-665