Inexact primal-dual gradient projection methods for nonlinear optimization on convex set

被引:8
|
作者
Zhang, Fan [1 ,2 ,3 ]
Wang, Hao [1 ]
Wang, Jiashan [4 ]
Yang, Kai [5 ]
机构
[1] ShanghaiTech Univ, Sch Informat Sci & Technol, Shanghai, Peoples R China
[2] Chinese Acad Sci, Shanghai Inst Microsyst & Informat Technol, Shanghai, Peoples R China
[3] Univ Chinese Acad Sci, Beijing, Peoples R China
[4] Univ Washington, Dept Math, Washington, DC USA
[5] Tongji Univ, Dept Comp Sci, Shanghai, Peoples R China
基金
中国国家自然科学基金;
关键词
Inexact optimization; gradient projection methods; l(1)-ball projection; first-order methods; proximal methods; ALGORITHMS; SPARSITY; SIMPLEX; POINT;
D O I
10.1080/02331934.2019.1696338
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
In this paper, we propose a novel primal-dual inexact gradient projection method for nonlinear optimization problems with convex-set constraint. This method only needs inexact computation of the projections onto the convex set for each iteration, consequently reducing the computational cost for projections per iteration. This feature is attractive especially for solving problems where the projections are computationally not easy to calculate. Global convergence guarantee and ergodic convergence rate of the optimality residual are provided under loose assumptions. We apply our proposed strategy to -ball constrained problems. Numerical results exhibit that our inexact gradient projection methods for solving -ball constrained problems are more efficient than the exact methods.
引用
收藏
页码:2339 / 2365
页数:27
相关论文
共 50 条
  • [21] A primal-dual flow for affine constrained convex optimization
    Luo, Hao
    ESAIM-CONTROL OPTIMISATION AND CALCULUS OF VARIATIONS, 2022, 28
  • [22] Accelerated Primal-Dual Gradient Descent with Linesearch for Convex, Nonconvex, and Nonsmooth Optimization Problems
    S. V. Guminov
    Yu. E. Nesterov
    P. E. Dvurechensky
    A. V. Gasnikov
    Doklady Mathematics, 2019, 99 : 125 - 128
  • [23] Accelerated Primal-Dual Gradient Descent with Linesearch for Convex, Nonconvex, and Nonsmooth Optimization Problems
    Guminov, S. V.
    Nesterov, Yu. E.
    Dvurechensky, P. E.
    Gasnikov, A. V.
    DOKLADY MATHEMATICS, 2019, 99 (02) : 125 - 128
  • [24] Primal-dual exterior point method for convex optimization
    Polyak, Roman A.
    OPTIMIZATION METHODS & SOFTWARE, 2008, 23 (01): : 141 - 160
  • [25] Totally Asynchronous Primal-Dual Convex Optimization in Blocks
    Hendrickson, Katherine R.
    Hale, Matthew T.
    IEEE TRANSACTIONS ON CONTROL OF NETWORK SYSTEMS, 2023, 10 (01): : 454 - 466
  • [26] COMBINED PRIMAL-DUAL AND PENALTY METHODS FOR CONVEX PROGRAMMING
    KORT, BW
    BERTSEKAS, DP
    SIAM JOURNAL ON CONTROL, 1976, 14 (02): : 268 - 294
  • [27] General Inexact Primal-Dual Hybrid Gradient Methods for Saddle-Point Problems and Convergence Analysis
    Wu, Zhongming
    Li, Min
    ASIA-PACIFIC JOURNAL OF OPERATIONAL RESEARCH, 2022, 39 (05)
  • [28] A PRIMAL-DUAL EXTERIOR POINT METHOD WITH A PRIMAL-DUAL QUADRATIC PENALTY FUNCTION FOR NONLINEAR OPTIMIZATION
    Igarashi, Yu
    Yabe, Hiroshi
    PACIFIC JOURNAL OF OPTIMIZATION, 2015, 11 (04): : 721 - 736
  • [29] Primal-Dual Active-Set Methods for Large-Scale Optimization
    Robinson, Daniel P.
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2015, 166 (01) : 137 - 171
  • [30] Primal-Dual Active-Set Methods for Large-Scale Optimization
    Daniel P. Robinson
    Journal of Optimization Theory and Applications, 2015, 166 : 137 - 171