AN ACCELERATED HPE-TYPE ALGORITHM FOR A CLASS OF COMPOSITE CONVEX-CONCAVE SADDLE-POINT PROBLEMS

被引:51
作者
He, Yunlong [1 ]
Monteiro, Renato D. C. [2 ]
机构
[1] Georgia Inst Technol, Sch Math, Atlanta, GA 30332 USA
[2] Georgia Inst Technol, Sch Ind & Syst Engn, Atlanta, GA 30332 USA
基金
美国国家科学基金会;
关键词
saddle-point problem; composite convex optimization; monotone inclusion problem; inexact proximal point method; hybrid proximal extragradient; accelerated method; complexity; smoothing; MONOTONE-OPERATORS; VARIATIONAL-INEQUALITIES; COMPLEXITY; EXTRAGRADIENT; ENLARGEMENT; MAPPINGS;
D O I
10.1137/14096757X
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
This paper proposes a new algorithm for solving a class of composite convex-concave saddle-point problems. The new algorithm is a special instance of the hybrid proximal extragradient framework in which a Nesterov accelerated variant is used to approximately solve the prox subproblems. One of the advantages of the new method is that it works for any constant choice of proximal stepsize. Moreover, a suitable choice of the latter stepsize yields a method with the best known (accelerated inner) iteration complexity for the aforementioned class of saddle-point problems. In contrast to the smoothing technique of [Y. Nesterov, Math. Program., 103 (2005), pp. 127-152], our accelerated method does not assume that a feasible set is bounded due to its proximal point nature. Experiment results on three problem sets show that the new method outperforms Nesterov's smoothing technique of [Y. Nesterov, Math. Program., 103 (2005), pp. 127-152].
引用
收藏
页码:29 / 56
页数:28
相关论文
共 24 条
[1]  
[Anonymous], 1998, GRUNDLEHREN MATH WIS
[2]  
[Anonymous], 2013, ADV COMPUT MATH
[3]  
Auslender A., 2003, SPRINGER MONOGRAPHS
[4]   A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems [J].
Beck, Amir ;
Teboulle, Marc .
SIAM JOURNAL ON IMAGING SCIENCES, 2009, 2 (01) :183-202
[5]   Enlargement of monotone operators with applications to variational inequalities [J].
Burachik, RS ;
Iusem, AN ;
Svaiter, BF .
SET-VALUED ANALYSIS, 1997, 5 (02) :159-180
[6]   A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging [J].
Chambolle, Antonin ;
Pock, Thomas .
JOURNAL OF MATHEMATICAL IMAGING AND VISION, 2011, 40 (01) :120-145
[7]  
Chen Y., 2013, ARXIV13095548
[8]   Primal-Dual Splitting Algorithm for Solving Inclusions with Mixtures of Composite, Lipschitzian, and Parallel-Sum Type Monotone Operators [J].
Combettes, Patrick L. ;
Pesquet, Jean-Christophe .
SET-VALUED AND VARIATIONAL ANALYSIS, 2012, 20 (02) :307-330
[9]   A Primal-Dual Splitting Method for Convex Optimization Involving Lipschitzian, Proximable and Linear Composite Terms [J].
Condat, Laurent .
JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2013, 158 (02) :460-479
[10]  
HE Y., 2013, ACCELERATING BLOCK D