Subgradient ellipsoid method for nonsmooth convex problems

被引:4
作者
Rodomanov, Anton [1 ]
Nesterov, Yurii [2 ]
机构
[1] Catholic Univ Louvain UCL, Inst Informat & Commun Technol Elect & Appl Math, Louvain La Neuve, Belgium
[2] Catholic Univ Louvain UCL, Ctr Operat Res & Econometr CORE, Louvain La Neuve, Belgium
基金
欧洲研究理事会;
关键词
Subgradient method; Ellipsoid method; Accuracy certificates; Separating oracle; Convex optimization; Nonsmooth optimization; Saddle-point problems; Variational inequalities; ALGORITHM;
D O I
10.1007/s10107-022-01833-4
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
In this paper, we present a new ellipsoid-type algorithm for solving nonsmooth problems with convex structure. Examples of such problems include nonsmooth convex minimization problems, convex-concave saddle-point problems and variational inequalities with monotone operator. Our algorithm can be seen as a combination of the standard Subgradient and Ellipsoid methods. However, in contrast to the latter one, the proposed method has a reasonable convergence rate even when the dimensionality of the problem is sufficiently large. For generating accuracy certificates in our algorithm, we propose an efficient technique, which ameliorates the previously known recipes (Nemirovski in Math Oper Res 35(1):52-78, 2010).
引用
收藏
页码:305 / 341
页数:37
相关论文
共 23 条
  • [1] AUSLENDE.A, 1973, REV FR AUTOMAT INFOR, V7, P67
  • [2] Ben-Tal A., 2001, LECT MODERN CONVEX O, P377, DOI 10.1137/1.9780898718829.ch6
  • [3] THE ELLIPSOID METHOD - A SURVEY
    BLAND, RG
    GOLDFARB, D
    TODD, MJ
    [J]. OPERATIONS RESEARCH, 1981, 29 (06) : 1039 - 1091
  • [4] Bubeck S, 2016, PR MACH LEARN RES, V48
  • [5] Bubeck Sebastien, 2015, ARXIV PREPRINT ARXIV
  • [6] Bulatov V.P., 1982, Methods Optim. Appl.
  • [7] Duchi J, 2011, J MACH LEARN RES, V12, P2121
  • [8] Stochastic Intermediate Gradient Method for Convex Problems with Stochastic Inexact Oracle
    Dvurechensky, Pavel
    Gasnikov, Alexander
    [J]. JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2016, 171 (01) : 121 - 145
  • [9] THE ELLIPSOID METHOD AND ITS CONSEQUENCES IN COMBINATORIAL OPTIMIZATION
    GROTSCHEL, M
    LOVASZ, L
    SCHRIJVER, A
    [J]. COMBINATORICA, 1981, 1 (02) : 169 - 197
  • [10] KHACHIIAN LG, 1979, DOKL AKAD NAUK SSSR+, V244, P1093