GENERALIZED ADMM WITH OPTIMAL INDEFINITE PROXIMAL TERM FOR LINEARLY CONSTRAINED CONVEX OPTIMIZATION

被引:15
作者
Jiang, Fan [1 ]
Wu, Zhongming [2 ]
Cai, Xingju [1 ]
机构
[1] Nanjing Normal Univ, Sch Math Sci, Jiangsu Key Labratory NSLSCS, Nanjing 210023, Peoples R China
[2] Southeast Univ, Sch Econ & Management, Nanjing 210096, Peoples R China
关键词
Generalized alternating direction method of multipliers; convex programming; convergence rate; indefinite proximal term; optimal range; ALTERNATING DIRECTION METHOD; RACHFORD SPLITTING METHOD; MULTIPLIERS; CONVERGENCE; SHRINKAGE; ALGORITHM; RANK;
D O I
10.3934/jimo.2018181
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
We consider the generalized alternating direction method of multipliers (ADMM) for linearly constrained convex optimization. Many problems derived from practical applications have showed that usually one of the subproblems in the generalized ADMM is hard to solve, thus a special proximal term is added. In the literature, the proximal term can be indefinite which plays a vital role in accelerating numerical performance. In this paper, we are devoted to deriving the optimal lower bound of the proximal parameter and result in the generalized ADMM with optimal indefinite proximal term. The global convergence and the O(1/t) convergence rate measured by the iteration complexity of the proposed method are proved. Moreover, some preliminary numerical experiments on LASSO and total variation-based denoising problems are presented to demonstrate the efficiency of the proposed method and the advantage of the optimal lower bound.
引用
收藏
页码:835 / 856
页数:22
相关论文
共 38 条
[1]  
[Anonymous], FOUND TRENDS MACH LE
[2]   A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems [J].
Beck, Amir ;
Teboulle, Marc .
SIAM JOURNAL ON IMAGING SCIENCES, 2009, 2 (01) :183-202
[3]   Exact Matrix Completion via Convex Optimization [J].
Candes, Emmanuel J. ;
Recht, Benjamin .
FOUNDATIONS OF COMPUTATIONAL MATHEMATICS, 2009, 9 (06) :717-772
[4]   Atomic decomposition by basis pursuit [J].
Chen, SSB ;
Donoho, DL ;
Saunders, MA .
SIAM JOURNAL ON SCIENTIFIC COMPUTING, 1998, 20 (01) :33-61
[5]   Proximal Splitting Methods in Signal Processing [J].
Combettes, Patrick L. ;
Pesquet, Jean-Christophe .
FIXED-POINT ALGORITHMS FOR INVERSE PROBLEMS IN SCIENCE AND ENGINEERING, 2011, 49 :185-+
[6]   A Douglas-Rachford Splitting Approach to Nonsmooth Convex Variational Signal Recovery [J].
Combettes, Patrick L. ;
Pesquet, Jean-Christophe .
IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2007, 1 (04) :564-574
[7]   Signal recovery by proximal forward-backward splitting [J].
Combettes, PL ;
Wajs, VR .
MULTISCALE MODELING & SIMULATION, 2005, 4 (04) :1168-1200
[8]   ON THE DOUGLAS-RACHFORD SPLITTING METHOD AND THE PROXIMAL POINT ALGORITHM FOR MAXIMAL MONOTONE-OPERATORS [J].
ECKSTEIN, J ;
BERTSEKAS, DP .
MATHEMATICAL PROGRAMMING, 1992, 55 (03) :293-318
[9]  
Eckstein J, 2015, PAC J OPTIM, V11, P619
[10]   MONOTONE OPERATOR SPLITTING FOR OPTIMIZATION PROBLEMS IN SPARSE RECOVERY [J].
Fadili, M. J. ;
Starck, J. -L. .
2009 16TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-6, 2009, :1461-+