An ADM-based splitting method for separable convex programming

被引:0
作者
Deren Han
Xiaoming Yuan
Wenxing Zhang
Xingju Cai
机构
[1] Nanjing Normal University,School of Mathematical Sciences and Jiangsu Key Laboratory for NSLSCS
[2] Hong Kong Baptist University,Department of Mathematics
[3] Nanjing University,Department of Mathematics
来源
Computational Optimization and Applications | 2013年 / 54卷
关键词
Convex minimization; Block-separable; Alternating direction method of multipliers; Operator splitting methods; Global convergence;
D O I
暂无
中图分类号
学科分类号
摘要
We consider the convex minimization problem with linear constraints and a block-separable objective function which is represented as the sum of three functions without coupled variables. To solve this model, it is empirically effective to extend straightforwardly the alternating direction method of multipliers (ADM for short). But, the convergence of this straightforward extension of ADM is still not proved theoretically. Based on ADM’s straightforward extension, this paper presents a new splitting method for the model under consideration, which is empirically competitive to the straightforward extension of ADM and meanwhile the global convergence can be proved under standard assumptions. At each iteration, the new method corrects the output of the straightforward extension of ADM by some slight correction computation to generate a new iterate. Thus, the implementation of the new method is almost as easy as that of ADM’s straightforward extension. We show the numerical efficiency of the new method by some applications in the areas of image processing and statistics.
引用
收藏
页码:343 / 369
页数:26
相关论文
共 74 条
  • [1] Boyd S.(2010)Distributed optimization and statistical learning via the alternating direction method of multipliers Found. Trends Mach. Learn. 3 1-122
  • [2] Parikh N.(2008)Two phase methods for deblurring images corrupted by impulse plus Gaussian noise Inverse Probl. Imaging 2 187-204
  • [3] Chu E.(2011)Robust principal component analysis J. ACM 58 1-37
  • [4] Peleato B.(2011)A first-order primal-dual algorithm for convex problems with applications to imaging J. Math. Imaging Vis. 40 120-145
  • [5] Eckstein J.(2011)Rank-sparsity incoherence for matrix decomposition SIAM J. Optim. 21 572-596
  • [6] Cai J.F.(1994)A proximal-based decomposition method for convex minimization problems Math. Program. 64 81-101
  • [7] Chan R.H.(2012)Matrix completion via alternating direction method IMA J. Numer. Anal. 32 227-245
  • [8] Nikolova M.(1992)Application of the alternating directions method of multipliers to separable convex programming problems Comput. Optim. Appl. 2 93-111
  • [9] Candés E.(1976)A dual algorithm for the solution of nonlinear variational problems via finite element approximations Comput. Math. Appl. 2 17-40
  • [10] Li X.(1975)Approximation par éléments finis d’ordre un et résolution par pénalisation-dualité d’une classe de problèmes non linéaires RAIRO. Anal. Numér. 9 41-76