Inexact primal-dual gradient projection methods for nonlinear optimization on convex set

被引:8
|
作者
Zhang, Fan [1 ,2 ,3 ]
Wang, Hao [1 ]
Wang, Jiashan [4 ]
Yang, Kai [5 ]
机构
[1] ShanghaiTech Univ, Sch Informat Sci & Technol, Shanghai, Peoples R China
[2] Chinese Acad Sci, Shanghai Inst Microsyst & Informat Technol, Shanghai, Peoples R China
[3] Univ Chinese Acad Sci, Beijing, Peoples R China
[4] Univ Washington, Dept Math, Washington, DC USA
[5] Tongji Univ, Dept Comp Sci, Shanghai, Peoples R China
基金
中国国家自然科学基金;
关键词
Inexact optimization; gradient projection methods; l(1)-ball projection; first-order methods; proximal methods; ALGORITHMS; SPARSITY; SIMPLEX; POINT;
D O I
10.1080/02331934.2019.1696338
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
In this paper, we propose a novel primal-dual inexact gradient projection method for nonlinear optimization problems with convex-set constraint. This method only needs inexact computation of the projections onto the convex set for each iteration, consequently reducing the computational cost for projections per iteration. This feature is attractive especially for solving problems where the projections are computationally not easy to calculate. Global convergence guarantee and ergodic convergence rate of the optimality residual are provided under loose assumptions. We apply our proposed strategy to -ball constrained problems. Numerical results exhibit that our inexact gradient projection methods for solving -ball constrained problems are more efficient than the exact methods.
引用
收藏
页码:2339 / 2365
页数:27
相关论文
共 50 条
  • [1] Primal-Dual Nonlinear Rescaling Method for Convex Optimization
    R. Polyak
    I. Griva
    Journal of Optimization Theory and Applications, 2004, 122 : 111 - 156
  • [2] Primal-dual nonlinear rescaling method for convex optimization
    Polyak, R
    Griva, I
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2004, 122 (01) : 111 - 156
  • [3] A primal-dual approach to inexact subgradient methods
    Au, KT
    MATHEMATICAL PROGRAMMING, 1996, 72 (03) : 259 - 272
  • [4] A primal-dual approach to inexact subgradient methods
    Au, Kelly T.
    Mathematical Programming, Series B, 1996, 72 (03): : 259 - 272
  • [5] Primal-dual approach to inexact subgradient methods
    Au, K.T.
    Mathematical Programming, Series A, 1996, 72 (03):
  • [6] Gradient Descent Averaging and Primal-dual Averaging for Strongly Convex Optimization
    Tao, Wei
    Li, Wei
    Pan, Zhisong
    Tao, Qing
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 9843 - 9850
  • [7] Primal-dual incremental gradient method for nonsmooth and convex optimization problems
    Jalilzadeh, Afrooz
    OPTIMIZATION LETTERS, 2021, 15 (08) : 2541 - 2554
  • [8] Primal-dual incremental gradient method for nonsmooth and convex optimization problems
    Afrooz Jalilzadeh
    Optimization Letters, 2021, 15 : 2541 - 2554
  • [9] GLOBALLY CONVERGENT PRIMAL-DUAL ACTIVE-SET METHODS WITH INEXACT SUBPROBLEM SOLVES
    Curtis, Frank E.
    Han, Zheng
    SIAM JOURNAL ON OPTIMIZATION, 2016, 26 (04) : 2261 - 2283
  • [10] Accelerated Primal-Dual Projection Neurodynamic Approach With Time Scaling for Linear and Set Constrained Convex Optimization Problems
    You Zhao
    Xing He
    Mingliang Zhou
    Tingwen Huang
    IEEE/CAA Journal of Automatica Sinica, 2024, 11 (06) : 1485 - 1498