AN ACCELERATED HPE-TYPE ALGORITHM FOR A CLASS OF COMPOSITE CONVEX-CONCAVE SADDLE-POINT PROBLEMS

被引:49
|
作者
He, Yunlong [1 ]
Monteiro, Renato D. C. [2 ]
机构
[1] Georgia Inst Technol, Sch Math, Atlanta, GA 30332 USA
[2] Georgia Inst Technol, Sch Ind & Syst Engn, Atlanta, GA 30332 USA
基金
美国国家科学基金会;
关键词
saddle-point problem; composite convex optimization; monotone inclusion problem; inexact proximal point method; hybrid proximal extragradient; accelerated method; complexity; smoothing; MONOTONE-OPERATORS; VARIATIONAL-INEQUALITIES; COMPLEXITY; EXTRAGRADIENT; ENLARGEMENT; MAPPINGS;
D O I
10.1137/14096757X
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
This paper proposes a new algorithm for solving a class of composite convex-concave saddle-point problems. The new algorithm is a special instance of the hybrid proximal extragradient framework in which a Nesterov accelerated variant is used to approximately solve the prox subproblems. One of the advantages of the new method is that it works for any constant choice of proximal stepsize. Moreover, a suitable choice of the latter stepsize yields a method with the best known (accelerated inner) iteration complexity for the aforementioned class of saddle-point problems. In contrast to the smoothing technique of [Y. Nesterov, Math. Program., 103 (2005), pp. 127-152], our accelerated method does not assume that a feasible set is bounded due to its proximal point nature. Experiment results on three problem sets show that the new method outperforms Nesterov's smoothing technique of [Y. Nesterov, Math. Program., 103 (2005), pp. 127-152].
引用
收藏
页码:29 / 56
页数:28
相关论文
共 50 条
  • [1] A simple algorithm for a class of nonsmooth convex-concave saddle-point problems
    Drori, Yoel
    Sabach, Shoham
    Teboulle, Marc
    OPERATIONS RESEARCH LETTERS, 2015, 43 (02) : 209 - 214
  • [2] Accelerated Stochastic Algorithms for Convex-Concave Saddle-Point Problems
    Zhao, Renbo
    MATHEMATICS OF OPERATIONS RESEARCH, 2022, 47 (02) : 1443 - 1473
  • [3] An accelerated non-Euclidean hybrid proximal extragradient-type algorithm for convex-concave saddle-point problems
    Kolossoski, O.
    Monteiro, R. D. C.
    OPTIMIZATION METHODS & SOFTWARE, 2017, 32 (06): : 1244 - 1272
  • [4] An accelerated minimax algorithm for convex-concave saddle point problems with nonsmooth coupling function
    Bot, Radu Ioan
    Csetnek, Erno Robert
    Sedlmayer, Michael
    COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2023, 86 (03) : 925 - 966
  • [5] An accelerated minimax algorithm for convex-concave saddle point problems with nonsmooth coupling function
    Radu Ioan Boţ
    Ernö Robert Csetnek
    Michael Sedlmayer
    Computational Optimization and Applications, 2023, 86 : 925 - 966
  • [6] On the convergence of conditional ε-subgradient methods for convex programs and convex-concave saddle-point problems
    Larsson, T
    Patriksson, M
    Strömberg, AB
    EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2003, 151 (03) : 461 - 473
  • [7] Non-euclidean proximal methods for convex-concave saddle-point problems
    Cohen E.
    Sabach S.
    Teboulle M.
    Journal of Applied and Numerical Optimization, 2021, 3 (01): : 43 - 60
  • [8] Solving strongly convex-concave composite saddle-point problems with low dimension of one group of variables
    Alkousa, M. S.
    Gasnikov, A. V.
    Gladin, E. L.
    Kuruzov, I. A.
    Pasechnyuk, D. A.
    Stonyakin, F. S.
    SBORNIK MATHEMATICS, 2023, 214 (03) : 285 - 333
  • [9] Accelerated Primal-Dual Gradient Method for Smooth and Convex-Concave Saddle-Point Problems with Bilinear Coupling
    Kovalev, Dmitry
    Gasnikov, Alexander
    Richtarik, Peter
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35, NEURIPS 2022, 2022,
  • [10] PRECONDITIONED DOUGLAS-RACHFORD SPLITTING METHODS FOR CONVEX-CONCAVE SADDLE-POINT PROBLEMS
    Bredies, Kristian
    Sun, Hongpeng
    SIAM JOURNAL ON NUMERICAL ANALYSIS, 2015, 53 (01) : 421 - 444