Customized proximal point algorithms for linearly constrained convex minimization and saddle-point problems: a unified approach

被引:53
作者
Gu, Guoyong [1 ]
He, Bingsheng [2 ,3 ]
Yuan, Xiaoming [4 ]
机构
[1] Nanjing Univ, Dept Math, Nanjing 210093, Jiangsu, Peoples R China
[2] Nanjing Univ, Int Ctr Management Sci & Engn, Nanjing 210093, Jiangsu, Peoples R China
[3] Nanjing Univ, Dept Math, Nanjing 210093, Jiangsu, Peoples R China
[4] Hong Kong Baptist Univ, Dept Math, Hong Kong, Hong Kong, Peoples R China
关键词
Convex minimization; Saddle-point problem; Proximal point algorithm; Convergence rate; Customized algorithms; Splitting algorithms; ALTERNATING DIRECTION METHOD; MIXED VARIATIONAL-INEQUALITIES; PRIMAL-DUAL ALGORITHMS; CONVERGENCE; DECOMPOSITION;
D O I
10.1007/s10589-013-9616-x
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
This paper focuses on some customized applications of the proximal point algorithm (PPA) to two classes of problems: the convex minimization problem with linear constraints and a generic or separable objective function, and a saddle-point problem. We treat these two classes of problems uniformly by a mixed variational inequality, and show how the application of PPA with customized metric proximal parameters can yield favorable algorithms which are able to make use of the models' structures effectively. Our customized PPA revisit turns out to unify some algorithms including some existing ones in the literature and some new ones to be proposed. From the PPA perspective, we establish the global convergence and a worst-case O(1/t) convergence rate for this series of algorithms in a unified way.
引用
收藏
页码:135 / 161
页数:27
相关论文
共 52 条
[1]  
[Anonymous], 1969, Optimization
[2]  
[Anonymous], 1975, MATH OPTIMIERUNG GRU
[3]  
Benzi M, 2005, ACTA NUMER, V14, P1, DOI 10.1017/S0962492904000212
[4]   A FAMILY OF VARIABLE-METRIC PROXIMAL METHODS [J].
BONNANS, JF ;
GILBERT, JC ;
LEMARECHAL, C ;
SAGASTIZABAL, CA .
MATHEMATICAL PROGRAMMING, 1995, 68 (01) :15-47
[5]  
Boyd S., 2011, FOUND TRENDS MACH LE, V3, P1, DOI [10.1561/2200000016, DOI 10.1561/2200000016]
[6]   A variable metric proximal point algorithm for monotone operators [J].
Burke, JV ;
Qian, M .
SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 1999, 37 (02) :353-375
[7]   On the superlinear convergence of the variable metric proximal point algorithm using Broyden and BFGS matrix secant updating [J].
Burke, JV ;
Qian, MJ .
MATHEMATICAL PROGRAMMING, 2000, 88 (01) :157-181
[8]   A proximal point algorithm revisit on the alternating direction method of multipliers [J].
Cai XingJu ;
Gu GuoYong ;
He BingSheng ;
Yuan XiaoMing .
SCIENCE CHINA-MATHEMATICS, 2013, 56 (10) :2179-2186
[9]   A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging [J].
Chambolle, Antonin ;
Pock, Thomas .
JOURNAL OF MATHEMATICAL IMAGING AND VISION, 2011, 40 (01) :120-145
[10]   Atomic decomposition by basis pursuit [J].
Chen, SSB ;
Donoho, DL ;
Saunders, MA .
SIAM JOURNAL ON SCIENTIFIC COMPUTING, 1998, 20 (01) :33-61