A generalized alternating direction method of multipliers with semi-proximal terms for convex composite conic programming

被引:23
作者
Xiao Y. [1 ]
Chen L. [2 ]
Li D. [3 ]
机构
[1] Institute of Applied Mathematics, College of Mathematics and Statistics, Henan University, Kaifeng
[2] College of Mathematics and Econometrics, Hunan University, Changsha
[3] School of Mathematical Sciences, South China Normal University, Guangzhou
基金
中国国家自然科学基金;
关键词
Alternating direction method of multipliers; Convex composite conic programming; Doubly non-negative semidefinite programming; Relaxation; Semi-proximal terms;
D O I
10.1007/s12532-018-0134-9
中图分类号
N94 [系统科学]; C94 [];
学科分类号
0711 ; 081103 ; 1201 ;
摘要
In this paper, we propose a generalized alternating direction method of multipliers (ADMM) with semi-proximal terms for solving a class of convex composite conic optimization problems, of which some are high-dimensional, to moderate accuracy. Our primary motivation is that this method, together with properly chosen semi-proximal terms, such as those generated by the recent advance of block symmetric Gauss–Seidel technique, is capable of tackling these problems. Moreover, the proposed method, which relaxes both the primal and the dual variables in a natural way with a common relaxation factor in the interval of (0, 2), has the potential of enhancing the performance of the classic ADMM. Extensive numerical experiments on various doubly non-negative semidefinite programming problems, with or without inequality constraints, are conducted. The corresponding results showed that all these multi-block problems can be successively solved, and the advantage of using the relaxation step is apparent. © 2018, Springer-Verlag GmbH Germany, part of Springer Nature and The Mathematical Programming Society.
引用
收藏
页码:533 / 555
页数:22
相关论文
共 35 条
[1]  
Chen C.H., Numerical Algorithms for a Class of Matrix Norm Approximation Problems, (2012)
[2]  
Chen L., Sun D.F., Toh K.-C., An efficient inexact symmetric Gauss–Seidel based majorized ADMM for high-dimensional convex composite conic programming, Math. Program., 161, 1, pp. 237-270, (2017)
[3]  
Chen L., Sun D.F., Toh K.-C., A note on the convergence of ADMM for linearly constrained convex optimization Problems, Comput. Optim. Appl., 66, 2, pp. 327-343, (2017)
[4]  
Cui Y., Li X.D., Sun D.F., Toh K.-C., On the convergence properties of a majorized ADMM for linearly constrained convex optimization problems with coupled objective functions, J. Optim. Theory Appl., 169, 3, pp. 1013-1041, (2016)
[5]  
Deng W., Lai M.-J., Peng Z., W, Yin: Parallel multi-block ADMM with o(1 / k) convergence, J. Sci. Comput., 71, 2, pp. 712-736, (2017)
[6]  
Eckstein J., Some saddle-function splitting methods for convex programming, Optim. Methods Softw., 4, pp. 75-83, (1994)
[7]  
Eckstein J., Bertsekas D.P., On the Douglas–Rachford splitting method and the proximal point algorithm for maximal monotone operators, Math. Program., 55, pp. 293-318, (1992)
[8]  
Eckstein J., Yao W., Understanding the convergence of the alternating direction method of multipliers: theoretical and computational perspectives, Pac. J. Optim., 11, 4, pp. 619-644, (2014)
[9]  
Fazel M., Pong T.K., Sun D.F., Tseng P., Hankel matrix rank minimization with applications in system identification and realization, SIAM J. Matrix Anal. Appl., 34, pp. 946-977, (2013)
[10]  
Fortin M., Glowinski R., Chapter 1 Augmented Lagrangian Methods in Quadratic Programming, Augmented Lagrangian Methods: Applications to the Numerical Solution of Boundary-Value Problems, pp. 1-46, (1983)