Primal-Dual Extrapolation Methods for Monotone Inclusions Under Local Lipschitz Continuity

被引:0
作者
Lu, Zhaosong [1 ]
Mei, Sanyou [1 ]
机构
[1] Univ Minnesota, Dept Ind & Syst Engn, Minneapolis, MN 55455 USA
基金
美国国家科学基金会;
关键词
local Lipschitz continuity; primal-dual extrapolation; operator splitting; monotone inclusion; convex conic optimization; saddle point; variational inequality; iteration complexity; operation complexity; BACKWARD SPLITTING METHOD; SADDLE-POINT; VARIATIONAL-INEQUALITIES; CONVERGENCE; COMPLEXITY; OPERATORS; ALGORITHMS; SUM;
D O I
10.1287/moor.2024.0407
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
In this paper, we consider a class of monotone inclusion (MI) problems of finding a zero of the sum of two monotone operators, in which one operator is maximal monotone, whereas the other is locally Lipschitz continuous. We propose primal-dual (PD) extrapolation methods to solve them using a point and operator extrapolation technique, whose parameters are chosen by a backtracking line search scheme. The proposed methods enjoy an operation complexity of O(log epsilon-1) and O(epsilon-1log epsilon-1), measured by the number of fundamental operations consisting only of evaluations of one operator and resolvent of the other operator, for finding an epsilon-residual solution of strongly and nonstrongly MI problems, respectively. The latter complexity significantly improves the previously best operation complexity O(epsilon-2). As a byproduct, complexity results of the primal-dual extrapolation methods are also obtained for finding an epsilon-KKT or epsilon-residual solution of convex conic optimization, conic constrained saddle point, and variational inequality problems under local Lipschitz continuity. We provide preliminary numerical results to demonstrate the performance of the proposed methods.
引用
收藏
页数:23
相关论文
共 30 条
  • [1] An inertial forward-backward-forward primal-dual splitting algorithm for solving monotone inclusion problems
    Bot, Radu Ioan
    Csetnek, Ernoe Robert
    [J]. NUMERICAL ALGORITHMS, 2016, 71 (03) : 519 - 540
  • [2] Faechinei F, 2003, Finite-Dimensional Variational Inequalities and Complementarity Problems
  • [3] NEW FIRST-ORDER ALGORITHMS FOR STOCHASTIC VARIATIONAL INEQUALITIES
    Huang, K. E. V. I. N.
    Zhang, S. H. U. Z. H. O. N. G.
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2022, 32 (04) : 2745 - 2772
  • [4] Huang KV, 2021, Arxiv, DOI arXiv:2103.15270
  • [5] KORPELEVICH GM, 1977, MATEKON, V13, P35
  • [6] SIMPLE AND OPTIMAL METHODS FOR STOCHASTIC VARIATIONAL INEQUALITIES, I: OPERATOR EXTRAPOLATION
    Kotsalis, Georgios
    Lan, Guanghui
    Li, Tianjiao
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2022, 32 (03) : 2041 - 2073
  • [7] Kovalev D, 2022, Adv. Neural Inform. Processing Systems, V35, P14691
  • [8] Latafat P, 2023, Arxiv, DOI arXiv:2301.04431
  • [9] Lin T., 2020, C LEARN THEOR, P2738
  • [10] SPLITTING ALGORITHMS FOR THE SUM OF 2 NON-LINEAR OPERATORS
    LIONS, PL
    MERCIER, B
    [J]. SIAM JOURNAL ON NUMERICAL ANALYSIS, 1979, 16 (06) : 964 - 979