A proximal Peaceman-Rachford splitting method for solving the multi-block separable convex minimization problems

被引:12
作者
Wu, Zhongming [1 ]
Liu, Foxiang [2 ]
Li, Min [1 ,3 ]
机构
[1] Southeast Univ, Sch Econ & Management, Nanjing 210096, Jiangsu, Peoples R China
[2] Xiamen Univ, Inst Electromagnet & Acoust, Dept Elect Sci, Xiamen, Peoples R China
[3] Nanjing Univ, Sch Management & Engn, Nanjing 210093, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
Convex programming; multi-block; separable structure; Peaceman-Rachford splitting method; global convergence; RANK; ALGORITHM;
D O I
10.1080/00207160.2018.1435864
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
The Peaceman-Rachford splitting method (PRSM) is well studied for solving the two-block separable convex minimization problems with linear constraints recently. In this paper, we consider the separable convex minimization problem where its objective function is the sum of more than two functions without coupled variables, when applying the PRSM to this case directly, it is not necessarily convergent. To remedy this difficulty, we propose a proximal Peaceman-Rachford splitting method for solving this multi-block separable convex minimization problems, which updates the Lagrangian multiplier two times at each iteration and solves some subproblems parallelly. Under some mild conditions, we prove global convergence of the new method and analyse the worst-case convergence rate in both ergodic and nonergodic senses. In addition, we apply the new method to solve the robust principal component analysis problem and report some preliminary numerical results to indicate the feasibility and effectiveness of the proposed method.
引用
收藏
页码:708 / 728
页数:21
相关论文
共 24 条
[1]  
[Anonymous], 2003, SPRINGER SER OPER RE
[2]   Distributed optimization and statistical learning via the alternating direction method of multipliers [J].
Boyd S. ;
Parikh N. ;
Chu E. ;
Peleato B. ;
Eckstein J. .
Foundations and Trends in Machine Learning, 2010, 3 (01) :1-122
[3]   A SEQUENTIAL UPDATING SCHEME OF THE LAGRANGE MULTIPLIER FOR SEPARABLE CONVEX PROGRAMMING [J].
Dai, Yu-Hong ;
Han, Deren ;
Yuan, Xiaoming ;
Zhang, Wenxing .
MATHEMATICS OF COMPUTATION, 2017, 86 (303) :315-343
[4]   Parallel Multi-Block ADMM with o(1 / k) Convergence [J].
Deng, Wei ;
Lai, Ming-Jun ;
Peng, Zhimin ;
Yin, Wotao .
JOURNAL OF SCIENTIFIC COMPUTING, 2017, 71 (02) :712-736
[5]   ON THE DOUGLAS-RACHFORD SPLITTING METHOD AND THE PROXIMAL POINT ALGORITHM FOR MAXIMAL MONOTONE-OPERATORS [J].
ECKSTEIN, J ;
BERTSEKAS, DP .
MATHEMATICAL PROGRAMMING, 1992, 55 (03) :293-318
[6]  
Eckstein J, 2015, PAC J OPTIM, V11, P619
[7]  
Gabay D., 1983, Studies in Mathematics and its Applications, V15, P299
[8]  
GLOWINSKI R, 1975, REV FR AUTOMAT INFOR, V9, P41
[9]  
Han D.R., 2013, PREPRINT
[10]   A Partial Splitting Augmented Lagrangian Method for Low Patch-Rank Image Decomposition [J].
Han, Deren ;
Kong, Weiwei ;
Zhang, Wenxing .
JOURNAL OF MATHEMATICAL IMAGING AND VISION, 2015, 51 (01) :145-160