Customized proximal point algorithms for linearly constrained convex minimization and saddle-point problems: a unified approach

被引:49
作者
Gu, Guoyong [1 ]
He, Bingsheng [2 ,3 ]
Yuan, Xiaoming [4 ]
机构
[1] Nanjing Univ, Dept Math, Nanjing 210093, Jiangsu, Peoples R China
[2] Nanjing Univ, Int Ctr Management Sci & Engn, Nanjing 210093, Jiangsu, Peoples R China
[3] Nanjing Univ, Dept Math, Nanjing 210093, Jiangsu, Peoples R China
[4] Hong Kong Baptist Univ, Dept Math, Hong Kong, Hong Kong, Peoples R China
关键词
Convex minimization; Saddle-point problem; Proximal point algorithm; Convergence rate; Customized algorithms; Splitting algorithms; ALTERNATING DIRECTION METHOD; MIXED VARIATIONAL-INEQUALITIES; PRIMAL-DUAL ALGORITHMS; CONVERGENCE; DECOMPOSITION;
D O I
10.1007/s10589-013-9616-x
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
This paper focuses on some customized applications of the proximal point algorithm (PPA) to two classes of problems: the convex minimization problem with linear constraints and a generic or separable objective function, and a saddle-point problem. We treat these two classes of problems uniformly by a mixed variational inequality, and show how the application of PPA with customized metric proximal parameters can yield favorable algorithms which are able to make use of the models' structures effectively. Our customized PPA revisit turns out to unify some algorithms including some existing ones in the literature and some new ones to be proposed. From the PPA perspective, we establish the global convergence and a worst-case O(1/t) convergence rate for this series of algorithms in a unified way.
引用
收藏
页码:135 / 161
页数:27
相关论文
共 50 条
  • [41] AN ACCELERATED HPE-TYPE ALGORITHM FOR A CLASS OF COMPOSITE CONVEX-CONCAVE SADDLE-POINT PROBLEMS
    He, Yunlong
    Monteiro, Renato D. C.
    SIAM JOURNAL ON OPTIMIZATION, 2016, 26 (01) : 29 - 56
  • [42] On preconditioned Uzawa methods and SOR methods for saddle-point problems
    Chen, XJ
    JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, 1998, 100 (02) : 207 - 224
  • [43] Regularized HSS iteration methods for stabilized saddle-point problems
    Bai, Zhong-Zhi
    IMA JOURNAL OF NUMERICAL ANALYSIS, 2019, 39 (04) : 1888 - 1923
  • [44] On hybrid preconditioning methods for large sparse saddle-point problems
    Wang, Zeng-Qi
    LINEAR ALGEBRA AND ITS APPLICATIONS, 2011, 434 (11) : 2353 - 2366
  • [45] An Uzawa-DOS method for solving saddle-point problems
    Ebadi, Ghodrat
    Mehrabi, Khosro
    Stanimirovic, Predrag S.
    NUMERICAL ALGORITHMS, 2024, : 165 - 182
  • [46] Accelerated variance-reduced methods for saddle-point problems
    Borodich, Ekaterina
    Tominin, Vladislav
    Tominin, Yaroslav
    Kovalev, Dmitry
    Gasnikov, Alexander
    Dvurechensky, Pavel
    EURO JOURNAL ON COMPUTATIONAL OPTIMIZATION, 2022, 10
  • [47] Uzawa methods for a class of block three-by-three saddle-point problems
    Huang, Na
    Dai, Yu-Hong
    Hu, QiYa
    NUMERICAL LINEAR ALGEBRA WITH APPLICATIONS, 2019, 26 (06)
  • [48] A Modified Saddle-Point Dynamics for Distributed Convex Optimization on General Directed Graphs
    Touri, Behrouz
    Gharesifard, Bahman
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2020, 65 (07) : 3098 - 3103
  • [49] Proximal point algorithms for nonsmooth convex optimization with fixed point constraints
    Iiduka, Hideaki
    EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2016, 253 (02) : 503 - 513
  • [50] A VARIANT OF THE PROXIMAL GRADIENT METHOD FOR CONSTRAINED CONVEX MINIMIZATION PROBLEMS
    Kesornprom, Suparat
    Kankam, Kunrada
    Inkrong, Papatsara
    Pholasa, Nattawut
    Cholamjiak, Prasit
    JOURNAL OF NONLINEAR FUNCTIONAL ANALYSIS, 2024, 2024