A MAJORIZED ADMM WITH INDEFINITE PROXIMAL TERMS FOR LINEARLY CONSTRAINED CONVEX COMPOSITE OPTIMIZATION

被引:64
作者
Li, Min [1 ]
Sun, Defeng [2 ,3 ]
Toh, Kim-Chuan [2 ]
机构
[1] Southeast Univ, Sch Econ & Management, Nanjing 210096, Jiangsu, Peoples R China
[2] Natl Univ Singapore, Dept Math, 10 Lower Kent Ridge Rd, Singapore 119076, Singapore
[3] Natl Univ Singapore, Risk Management Inst, 10 Lower Kent Ridge Rd, Singapore 119076, Singapore
基金
中国国家自然科学基金;
关键词
alternating direction method of multipliers; convex composite optimization; indefinite proximal terms; majorization; iteration-complexity; ALTERNATING DIRECTION METHOD; CONVERGENCE RATE; MULTIPLIERS; COMPLEXITY; O(1/T);
D O I
10.1137/140999025
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
This paper presents a majorized alternating direction method of multipliers (ADMM) with indefinite proximal terms for solving linearly constrained 2-block convex composite optimization problems with each block in the objective being the sum of a nonsmooth convex function (p(x) or q(y)) and a smooth convex function (f(x) or g(y)), i.e., min(x is an element of X, y is an element of Y) {p(x) + f(x) + q(y) + g(y) vertical bar A*x + B*y - c}. By choosing the indefinite proximal terms properly, we establish the global convergence and the iteration-complexity in the nonergodic sense of the proposed method for the step-length tau is an element of(0, (1 + root 5)/2). The computational benefit of using indefinite proximal terms within the ADMM framework instead of the current requirement of positive semidefinite ones is also demonstrated numerically. This opens up a new way to improve the practical performance of the ADMM and related methods.
引用
收藏
页码:922 / 950
页数:29
相关论文
共 36 条
[1]  
[Anonymous], TATA I FUND RES LECT
[2]  
[Anonymous], 1990, CLASSICS APPL MATH
[3]  
[Anonymous], ARXIV14064834V3MATHO
[4]  
[Anonymous], ARXIV13123040V2MATHO
[5]  
[Anonymous], TECHNICAL REPORT
[6]  
[Anonymous], ARXIV12083922V3MATHO
[7]  
[Anonymous], 2014, PREPRINT
[8]  
[Anonymous], 2015, Thesis
[9]  
[Anonymous], 1983, AUGMENTED LAGRANGIAN, DOI DOI 10.1016/S0168-2024(08)70034-1
[10]   The direct extension of ADMM for multi-block convex minimization problems is not necessarily convergent [J].
Chen, Caihua ;
He, Bingsheng ;
Ye, Yinyu ;
Yuan, Xiaoming .
MATHEMATICAL PROGRAMMING, 2016, 155 (1-2) :57-79