Extragradient-type methods with O1/k last-iterate convergence rates for co-hypomonotone inclusions

被引:0
作者
Tran-Dinh, Quoc [1 ]
机构
[1] Univ North Carolina Chapel Hill, Dept Stat & Operat Res, 318 Hanes Hall, Chapel Hill, NC 27599 USA
基金
美国国家科学基金会;
关键词
Accelerated extragradient method; Nesterov's acceleration; Co-hypomonotone inclusion; Halpern's fixed-point iteration; Last-iterate convergence; SOLVING VARIATIONAL-INEQUALITIES; BACKWARD SPLITTING METHOD; MONOTONE-OPERATORS; SADDLE-POINT; ALGORITHMS;
D O I
10.1007/s10898-023-01347-z
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
We develop two "Nesterov's accelerated" variants of the well-known extragradient method to approximate a solution of a co-hypomonotone inclusion constituted by the sum of two operators, where one is Lipschitz continuous and the other is possibly multivalued. The first scheme can be viewed as an accelerated variant of Tseng's forward-backward-forward splitting (FBFS) method, while the second one is a Nesterov's accelerated variant of the "past" FBFS scheme, which requires only one evaluation of the Lipschitz operator and one resolvent of the multivalued mapping. Under appropriate conditions on the parameters, we theoretically prove that both algorithms achieve O1/k last-iterate convergence rates on the residual norm, where k is the iteration counter. Our results can be viewed as alternatives of a recent class of Halpern-type methods for root-finding problems. For comparison, we also provide a new convergence analysis of the two recent extra-anchored gradient-type methods for solving co-hypomonotone inclusions.
引用
收藏
页码:197 / 221
页数:25
相关论文
共 78 条
  • [1] [Anonymous], 2003, SPRING S OPERAT RES
  • [2] Arjovsky M, 2017, PR MACH LEARN RES, V70
  • [3] Convergence of a relaxed inertial proximal algorithm for maximally monotone operators
    Attouch, Hedy
    Cabot, Alexandre
    [J]. MATHEMATICAL PROGRAMMING, 2020, 184 (1-2) : 243 - 287
  • [4] Convergence of inertial dynamics and proximal algorithms governed by maximally monotone operators
    Attouch, Hedy
    Peypouquet, Juan
    [J]. MATHEMATICAL PROGRAMMING, 2019, 174 (1-2) : 391 - 432
  • [5] Azar MG, 2017, PR MACH LEARN RES, V70
  • [6] Generalized monotone operators and their averaged resolvents
    Bauschke, Heinz H.
    Moursi, Walaa M.
    Wang, Xianfu
    [J]. MATHEMATICAL PROGRAMMING, 2021, 189 (1-2) : 55 - 74
  • [7] Bauschke HH., 2017, CONVEX ANAL MONOTONE, DOI DOI 10.1007/978-3-319-48311-5
  • [8] Bhatia K., 2020, Adv. Neural. Inf. Process. Syst, P15020
  • [9] Bohm A., 2022, T MACH LEARN RES, P2835
  • [10] FAST KRASNOSEL'SKI\u I--MANN ALGORITHM WITH A CONVERGENCE RATE OF THE FIXED POINT ITERATION OF o(1/k)
    Bot, Radu Ioan
    Nguyen, Dang-Khoa
    [J]. SIAM JOURNAL ON NUMERICAL ANALYSIS, 2023, 61 (06) : 2813 - 2843