On the convergence of the direct extension of ADMM for three-block separable convex minimization models with one strongly convex function

被引:0
作者
Xingju Cai
Deren Han
Xiaoming Yuan
机构
[1] Nanjing Normal University,School of Mathematical Sciences, Key Laboratory for NSLSCS of Jiangsu Province
[2] Hong Kong Baptist University,Department of Mathematics
来源
Computational Optimization and Applications | 2017年 / 66卷
关键词
Alternating direction method of multipliers; Convergence analysis; Convex programming; Separable structure;
D O I
暂无
中图分类号
学科分类号
摘要
The alternating direction method of multipliers (ADMM) is a benchmark for solving a two-block linearly constrained convex minimization model whose objective function is the sum of two functions without coupled variables. Meanwhile, it is known that the convergence is not guaranteed if the ADMM is directly extended to a multiple-block convex minimization model whose objective function has more than two functions. Recently, some authors have actively studied the strong convexity condition on the objective function to sufficiently ensure the convergence of the direct extension of ADMM or the resulting convergence when the original scheme is appropriately twisted. We focus on the three-block case of such a model whose objective function is the sum of three functions, and discuss the convergence of the direct extension of ADMM. We show that when one function in the objective is strongly convex, the penalty parameter and the operators in the linear equality constraint are appropriately restricted, it is sufficient to guarantee the convergence of the direct extension of ADMM. We further estimate the worst-case convergence rate measured by the iteration complexity in both the ergodic and nonergodic senses, and derive the globally linear convergence in asymptotical sense under some additional conditions.
引用
收藏
页码:39 / 73
页数:34
相关论文
共 65 条
  • [1] Boley D(2013)Local linear convergence of ADMM on quadratic or linear programs SIAM J. Optim. 23 2183-2207
  • [2] Chamboulle A(2011)A first-order primal-dual algorithm for convex problems with applications to imaging J. Math. Imaging Vis. 40 120-145
  • [3] Pock T(2012)Latent variable graphical model selection via convex optimization Ann. Stat. 40 1935-1967
  • [4] Chandrasekaran V(2016)The direct extension of ADMM for multi-block convex minimization problems is not necessarily convergent Math. Program. 155 57-79
  • [5] Parrilo PA(2014)A generalized proximal point algorithm and its convergence rate SIAM J. Optim. 24 1614-1638
  • [6] Willsky AS(2016)On the global and linear convergence of the generalized alternating direction method of multipliers J. Sci. Comput. 66 889-916
  • [7] Chen CH(2015)Understanding the convergence of the alternating direction method of multipliers: theoretical and computational perspectives Pac. J. Optim. 11 619-644
  • [8] He BS(1975)Sur l’approximation paréléments finis d’ordre un et larésolution parpénalisation-dualité d’une classe de problèmes de Dirichlet non linéaires Revue Fr. Autom. Inf. Rech. Opér., Anal. Numér. 2 41-76
  • [9] Ye YY(2014)On alternating direction methods of multipliers: a historical perspective Model. Simul. Optim. Sci. Technol. Comput. Methods Appl. Sci. 34 59-82
  • [10] Yuan XM(2013)A note on the alternating direction method of multipliers J. Optim. Theory Appl. 155 227-238