GENERALIZED ADMM WITH OPTIMAL INDEFINITE PROXIMAL TERM FOR LINEARLY CONSTRAINED CONVEX OPTIMIZATION

被引:15
作者
Jiang, Fan [1 ]
Wu, Zhongming [2 ]
Cai, Xingju [1 ]
机构
[1] Nanjing Normal Univ, Sch Math Sci, Jiangsu Key Labratory NSLSCS, Nanjing 210023, Peoples R China
[2] Southeast Univ, Sch Econ & Management, Nanjing 210096, Peoples R China
关键词
Generalized alternating direction method of multipliers; convex programming; convergence rate; indefinite proximal term; optimal range; ALTERNATING DIRECTION METHOD; RACHFORD SPLITTING METHOD; MULTIPLIERS; CONVERGENCE; SHRINKAGE; ALGORITHM; RANK;
D O I
10.3934/jimo.2018181
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
We consider the generalized alternating direction method of multipliers (ADMM) for linearly constrained convex optimization. Many problems derived from practical applications have showed that usually one of the subproblems in the generalized ADMM is hard to solve, thus a special proximal term is added. In the literature, the proximal term can be indefinite which plays a vital role in accelerating numerical performance. In this paper, we are devoted to deriving the optimal lower bound of the proximal parameter and result in the generalized ADMM with optimal indefinite proximal term. The global convergence and the O(1/t) convergence rate measured by the iteration complexity of the proposed method are proved. Moreover, some preliminary numerical experiments on LASSO and total variation-based denoising problems are presented to demonstrate the efficiency of the proposed method and the advantage of the optimal lower bound.
引用
收藏
页码:835 / 856
页数:22
相关论文
共 38 条
[21]  
He B. S., 2016, IMPROVING ADMM LIKE
[22]   PPA-Like Contraction Methods for Convex Optimization: A Framework Using Variational Inequality Approach [J].
He, Bing-Sheng .
JOURNAL OF THE OPERATIONS RESEARCH SOCIETY OF CHINA, 2015, 3 (04) :391-420
[23]   On non-ergodic convergence rate of Douglas-Rachford alternating direction method of multipliers [J].
He, Bingsheng ;
Yuan, Xiaoming .
NUMERISCHE MATHEMATIK, 2015, 130 (03) :567-577
[24]   A STRICTLY CONTRACTIVE PEACEMAN-RACHFORD SPLITTING METHOD FOR CONVEX PROGRAMMING [J].
He, Bingsheng ;
Liu, Han ;
Wang, Zhaoran ;
Yuan, Xiaoming .
SIAM JOURNAL ON OPTIMIZATION, 2014, 24 (03) :1011-1040
[25]   Some convergence properties of a method of multipliers for linearly constrained monotone variational inequalities [J].
He, BS ;
Yang, H .
OPERATIONS RESEARCH LETTERS, 1998, 23 (3-5) :151-161
[26]   A NEW METHOD FOR A CLASS OF LINEAR VARIATIONAL-INEQUALITIES [J].
HE, BS .
MATHEMATICAL PROGRAMMING, 1994, 66 (02) :137-144
[27]   A MAJORIZED ADMM WITH INDEFINITE PROXIMAL TERMS FOR LINEARLY CONSTRAINED CONVEX COMPOSITE OPTIMIZATION [J].
Li, Min ;
Sun, Defeng ;
Toh, Kim-Chuan .
SIAM JOURNAL ON OPTIMIZATION, 2016, 26 (02) :922-950
[28]   Convergence Analysis of the Generalized Alternating Direction Method of Multipliers with Logarithmic-Quadratic Proximal Regularization [J].
Li, Min ;
Li, Xinxin ;
Yuan, Xiaoming .
JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2015, 164 (01) :218-233
[29]   A Proximal Strictly Contractive Peaceman-Rachford Splitting Method for Convex Programming with Applications to Imaging [J].
Li, Xinxin ;
Yuan, Xiaoming .
SIAM JOURNAL ON IMAGING SCIENCES, 2015, 8 (02) :1332-1365
[30]   Linearized alternating direction method of multipliers for sparse group and fused LASSO models [J].
Li, Xinxin ;
Mo, Lili ;
Yuan, Xiaoming ;
Zhang, Jianzhong .
COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2014, 79 :203-221