O(1/t) complexity analysis of the generalized alternating direction method of multipliers

被引:14
作者
Cai, Xingju [1 ,2 ]
Han, Deren [1 ,2 ]
机构
[1] Nanjing Normal Univ, Sch Math Sci, Nanjing 210023, Jiangsu, Peoples R China
[2] Nanjing Normal Univ, Key Lab Numer Simulat Large Scale Complex Syst Ji, Nanjing 210023, Jiangsu, Peoples R China
基金
中国国家自然科学基金; 美国国家科学基金会;
关键词
generalized alternating direction method of multipliers; separable convex optimization; iteration complexity; sublinear convergence rate;
D O I
10.1007/s11425-016-9184-4
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
Owing to its efficiency in solving some types of large-scale separable optimization problems with linear constraints, the convergence rate of the alternating direction method of multipliers (ADMM for short) has recently attracted significant attention. In this paper, we consider the generalized ADMM (G-ADMM), which incorporates an acceleration factor and is more efficient. Instead of using a solution measure that depends on a bounded set and cannot be easily estimated, we propose using the original E-optimal solution measure, under which we prove that the G-ADMM converges at a rate of O(1/t). The new bound depends on the penalty parameter and the distance between the initial point and solution set, which is more reasonable than the previous bound.
引用
收藏
页码:795 / 808
页数:14
相关论文
共 30 条
[1]  
[Anonymous], 2007, GRADIENT METHODS MIN
[2]  
[Anonymous], 1990, An alternating direction method for linear programming
[3]   LOCAL LINEAR CONVERGENCE OF THE ALTERNATING DIRECTION METHOD OF MULTIPLIERS ON QUADRATIC OR LINEAR PROGRAMS [J].
Boley, Daniel .
SIAM JOURNAL ON OPTIMIZATION, 2013, 23 (04) :2183-2207
[4]   A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging [J].
Chambolle, Antonin ;
Pock, Thomas .
JOURNAL OF MATHEMATICAL IMAGING AND VISION, 2011, 40 (01) :120-145
[5]   Matrix completion via an alternating direction method [J].
Chen, Caihua ;
He, Bingsheng ;
Yuan, Xiaoming .
IMA JOURNAL OF NUMERICAL ANALYSIS, 2012, 32 (01) :227-245
[6]  
Davis D, 2016, SCI COMPUT, P115, DOI 10.1007/978-3-319-41589-5_4
[7]   On the Global and Linear Convergence of the Generalized Alternating Direction Method of Multipliers [J].
Deng, Wei ;
Yin, Wotao .
JOURNAL OF SCIENTIFIC COMPUTING, 2016, 66 (03) :889-916
[8]   ON THE DOUGLAS-RACHFORD SPLITTING METHOD AND THE PROXIMAL POINT ALGORITHM FOR MAXIMAL MONOTONE-OPERATORS [J].
ECKSTEIN, J ;
BERTSEKAS, DP .
MATHEMATICAL PROGRAMMING, 1992, 55 (03) :293-318
[9]  
Gabay D., 1976, Computers & Mathematics with Applications, V2, P17, DOI 10.1016/0898-1221(76)90003-1
[10]  
GLOWINSKI R, 1975, REV FR AUTOMAT INFOR, V9, P41