Inexact primal-dual gradient projection methods for nonlinear optimization on convex set

被引:8
作者
Zhang, Fan [1 ,2 ,3 ]
Wang, Hao [1 ]
Wang, Jiashan [4 ]
Yang, Kai [5 ]
机构
[1] ShanghaiTech Univ, Sch Informat Sci & Technol, Shanghai, Peoples R China
[2] Chinese Acad Sci, Shanghai Inst Microsyst & Informat Technol, Shanghai, Peoples R China
[3] Univ Chinese Acad Sci, Beijing, Peoples R China
[4] Univ Washington, Dept Math, Washington, DC USA
[5] Tongji Univ, Dept Comp Sci, Shanghai, Peoples R China
基金
中国国家自然科学基金;
关键词
Inexact optimization; gradient projection methods; l(1)-ball projection; first-order methods; proximal methods; ALGORITHMS; SPARSITY; SIMPLEX; POINT;
D O I
10.1080/02331934.2019.1696338
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
In this paper, we propose a novel primal-dual inexact gradient projection method for nonlinear optimization problems with convex-set constraint. This method only needs inexact computation of the projections onto the convex set for each iteration, consequently reducing the computational cost for projections per iteration. This feature is attractive especially for solving problems where the projections are computationally not easy to calculate. Global convergence guarantee and ergodic convergence rate of the optimality residual are provided under loose assumptions. We apply our proposed strategy to -ball constrained problems. Numerical results exhibit that our inexact gradient projection methods for solving -ball constrained problems are more efficient than the exact methods.
引用
收藏
页码:2339 / 2365
页数:27
相关论文
共 50 条
  • [41] Primal-dual convex optimization in large deformation diffeomorphic metric mapping: LDDMM meets robust regularizers
    Hernandez, Monica
    PHYSICS IN MEDICINE AND BIOLOGY, 2017, 62 (23) : 9067 - 9098
  • [42] A fast primal-dual algorithm via dynamical system with variable mass for linearly constrained convex optimization
    Jiang, Ziyi
    Wang, Dan
    Liu, Xinwei
    OPTIMIZATION LETTERS, 2024, 18 (08) : 1855 - 1880
  • [43] A primal-dual interior point method for nonlinear optimization over second-order cones
    Yamashita, Hiroshi
    Yabe, Hiroshi
    OPTIMIZATION METHODS & SOFTWARE, 2009, 24 (03) : 407 - 426
  • [44] On Stochastic Primal-Dual Hybrid Gradient Approach for Compositely Regularized Minimization
    Qiao, Linbo
    Lin, Tianyi
    Jiang, Yu-Gang
    Yang, Fan
    Liu, Wei
    Lu, Xicheng
    ECAI 2016: 22ND EUROPEAN CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2016, 285 : 167 - 174
  • [45] On the geometry and refined rate of primal-dual hybrid gradient for linear programming
    Lu, Haihao
    Yang, Jinwen
    MATHEMATICAL PROGRAMMING, 2024,
  • [46] A PRIMAL-DUAL OPTIMIZATION STRATEGY FOR ELLIPTIC PARTIAL DIFFERENTIAL EQUATIONS
    Zosso, Dominique
    Osting, Braxton
    QUARTERLY OF APPLIED MATHEMATICS, 2021, 79 (01) : 175 - 200
  • [47] ComPLx: A Competitive Primal-dual Lagrange Optimization for Global Placement
    Kim, Myung-Chul
    Markov, Igor L.
    2012 49TH ACM/EDAC/IEEE DESIGN AUTOMATION CONFERENCE (DAC), 2012, : 747 - 755
  • [48] Prediction Techniques for Dynamic Imaging with Online Primal-Dual Methods
    D. Dizon, Neil
    Jauhiainen, Jyrki
    Valkonen, Tuomo
    JOURNAL OF MATHEMATICAL IMAGING AND VISION, 2024, 66 (06) : 1109 - 1134
  • [49] Sharper Rates for Separable Minimax and Finite Sum Optimization via Primal-Dual Extragradient Methods
    Jin, Yujia
    Sidford, Aaron
    Tian, Kevin
    CONFERENCE ON LEARNING THEORY, VOL 178, 2022, 178
  • [50] Regularized Primal-Dual Subgradient Method for Distributed Constrained Optimization
    Yuan, Deming
    Ho, Daniel W. C.
    Xu, Shengyuan
    IEEE TRANSACTIONS ON CYBERNETICS, 2016, 46 (09) : 2109 - 2118