A Generalized Primal-dual Correction Method for Saddle-point Problems With a Nonlinear Coupling Operator

被引:0
|
作者
Wang, Sai [1 ]
Gong, Yi [1 ]
机构
[1] Southern Univ Sci & Technol, Dept Elect & Elect Engn, 1088 Xueyuan Ave, Shenzhen 518055, Peoples R China
基金
中国国家自然科学基金;
关键词
Nonlinear optimization; prediction-correction method; saddle-point problem; variational analysis; CONVERGENCE RATE;
D O I
10.1007/s12555-024-0453-8
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The saddle-point problems (SPPs) with nonlinear coupling operators frequently arise in various control systems, such as dynamic programming optimization, H-infinity control, and Lyapunov stability analysis. However, traditional primal-dual methods are constrained by fixed regularization factors. In this paper, a novel generalized primal-dual correction method (GPD-CM) is proposed to adjust the values of regularization factors dynamically. It turns out that this method can achieve the minimum theoretical lower bound of regularization factors, allowing for larger step sizes under the convergence condition being satisfied. The convergence of the GPD-CM is directly achieved through a unified variational framework. Theoretical analysis shows that the proposed method can achieve an ergodic convergence rate of O(1/t). Numerical results support our theoretical analysis for an SPP with an exponential coupling operator.
引用
收藏
页码:638 / 645
页数:8
相关论文
共 50 条
  • [21] Convergence Analysis of Primal-Dual Algorithms for a Saddle-Point Problem: From Contraction Perspective
    He, Bingsheng
    Yuan, Xiaoming
    SIAM JOURNAL ON IMAGING SCIENCES, 2012, 5 (01): : 119 - 149
  • [22] A PRIMAL-DUAL EXTERIOR POINT METHOD WITH A PRIMAL-DUAL QUADRATIC PENALTY FUNCTION FOR NONLINEAR OPTIMIZATION
    Igarashi, Yu
    Yabe, Hiroshi
    PACIFIC JOURNAL OF OPTIMIZATION, 2015, 11 (04): : 721 - 736
  • [23] A PRIMAL-DUAL EXTERIOR POINT METHOD FOR NONLINEAR OPTIMIZATION
    Yamashita, Hiroshi
    Tanabe, Takahito
    SIAM JOURNAL ON OPTIMIZATION, 2010, 20 (06) : 3335 - 3363
  • [24] Preconditioners for generalized saddle-point problems
    Siefert, Chris
    De Sturler, Eric
    SIAM JOURNAL ON NUMERICAL ANALYSIS, 2006, 44 (03) : 1275 - 1296
  • [25] Adaptive Stochastic Primal-Dual Coordinate Descent for Separable Saddle Point Problems
    Zhu, Zhanxing
    Storkey, Amos J.
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2015, PT I, 2015, 9284 : 645 - 658
  • [26] Solving saddle point problems: a landscape of primal-dual algorithm with larger stepsizes
    Fan Jiang
    Zhiyuan Zhang
    Hongjin He
    Journal of Global Optimization, 2023, 85 : 821 - 846
  • [27] Communication-Efficient Distributed Primal-Dual Algorithm for Saddle Point Problems
    Yu, Yaodong
    Liu, Sulin
    Pan, Sinno Jialin
    CONFERENCE ON UNCERTAINTY IN ARTIFICIAL INTELLIGENCE (UAI2017), 2017,
  • [28] APPROXIMATE FIRST-ORDER PRIMAL-DUAL ALGORITHMS FOR SADDLE POINT PROBLEMS
    Jiang, Fan
    Cai, Xingju
    Wu, Zhongming
    Han, Deren
    MATHEMATICS OF COMPUTATION, 2021, 90 (329) : 1227 - 1262
  • [29] Solving saddle point problems: a landscape of primal-dual algorithm with larger stepsizes
    Jiang, Fan
    Zhang, Zhiyuan
    He, Hongjin
    JOURNAL OF GLOBAL OPTIMIZATION, 2023, 85 (04) : 821 - 846
  • [30] Quadratic Convergence of a Primal-Dual Interior Point Method for Degenerate Nonlinear Optimization Problems
    Hiroshi Yamashita
    Hiroshi Yabe
    Computational Optimization and Applications, 2005, 31 : 123 - 143