On the convergence of the direct extension of ADMM for three-block separable convex minimization models with one strongly convex function

被引:81
作者
Cai, Xingju [1 ]
Han, Deren [1 ]
Yuan, Xiaoming [2 ]
机构
[1] Nanjing Normal Univ, Sch Math Sci, Key Lab NSLSCS Jiangsu Prov, Nanjing 210023, Jiangsu, Peoples R China
[2] Hong Kong Baptist Univ, Dept Math, Hong Kong, Hong Kong, Peoples R China
关键词
Alternating direction method of multipliers; Convergence analysis; Convex programming; Separable structure; LOCAL LINEAR CONVERGENCE; SPLITTING METHOD; LOW-RANK; MULTIPLIERS;
D O I
10.1007/s10589-016-9860-y
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
The alternating direction method of multipliers (ADMM) is a benchmark for solving a two-block linearly constrained convex minimization model whose objective function is the sum of two functions without coupled variables. Meanwhile, it is known that the convergence is not guaranteed if the ADMM is directly extended to a multiple-block convex minimization model whose objective function has more than two functions. Recently, some authors have actively studied the strong convexity condition on the objective function to sufficiently ensure the convergence of the direct extension of ADMM or the resulting convergence when the original scheme is appropriately twisted. We focus on the three-block case of such a model whose objective function is the sum of three functions, and discuss the convergence of the direct extension of ADMM. We show that when one function in the objective is strongly convex, the penalty parameter and the operators in the linear equality constraint are appropriately restricted, it is sufficient to guarantee the convergence of the direct extension of ADMM. We further estimate the worst-case convergence rate measured by the iteration complexity in both the ergodic and nonergodic senses, and derive the globally linear convergence in asymptotical sense under some additional conditions.
引用
收藏
页码:39 / 73
页数:35
相关论文
共 38 条
[1]  
[Anonymous], 2004, DISCRIMINANT ANAL ST
[2]  
[Anonymous], 1984, Numerical Methods for Nonlinear Variational Problems
[3]   LOCAL LINEAR CONVERGENCE OF THE ALTERNATING DIRECTION METHOD OF MULTIPLIERS ON QUADRATIC OR LINEAR PROGRAMS [J].
Boley, Daniel .
SIAM JOURNAL ON OPTIMIZATION, 2013, 23 (04) :2183-2207
[4]  
Boyd S., 2011, FOUND TRENDS MACH LE, V3, P1, DOI DOI 10.1561/2200000016
[5]   A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging [J].
Chambolle, Antonin ;
Pock, Thomas .
JOURNAL OF MATHEMATICAL IMAGING AND VISION, 2011, 40 (01) :120-145
[6]   LATENT VARIABLE GRAPHICAL MODEL SELECTION VIA CONVEX OPTIMIZATION [J].
Chandrasekaran, Venkat ;
Parrilo, Pablo A. ;
Willsky, Alan S. .
ANNALS OF STATISTICS, 2012, 40 (04) :1935-1967
[7]   The direct extension of ADMM for multi-block convex minimization problems is not necessarily convergent [J].
Chen, Caihua ;
He, Bingsheng ;
Ye, Yinyu ;
Yuan, Xiaoming .
MATHEMATICAL PROGRAMMING, 2016, 155 (1-2) :57-79
[8]   On the Convergence Analysis of the Alternating Direction Method of Multipliers with Three Blocks [J].
Chen, Caihua ;
Shen, Yuan ;
You, Yanfei .
ABSTRACT AND APPLIED ANALYSIS, 2013,
[9]   A GENERALIZED PROXIMAL POINT ALGORITHM AND ITS CONVERGENCE RATE [J].
Corman, Etienne ;
Yuan, Xiaoming .
SIAM JOURNAL ON OPTIMIZATION, 2014, 24 (04) :1614-1638
[10]  
Deng W., 2014, PARALLEL MULTI UNPUB