A Generalized Primal-dual Correction Method for Saddle-point Problems With a Nonlinear Coupling Operator

被引:0
|
作者
Wang, Sai [1 ]
Gong, Yi [1 ]
机构
[1] Southern Univ Sci & Technol, Dept Elect & Elect Engn, 1088 Xueyuan Ave, Shenzhen 518055, Peoples R China
基金
中国国家自然科学基金;
关键词
Nonlinear optimization; prediction-correction method; saddle-point problem; variational analysis; CONVERGENCE RATE;
D O I
10.1007/s12555-024-0453-8
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The saddle-point problems (SPPs) with nonlinear coupling operators frequently arise in various control systems, such as dynamic programming optimization, H-infinity control, and Lyapunov stability analysis. However, traditional primal-dual methods are constrained by fixed regularization factors. In this paper, a novel generalized primal-dual correction method (GPD-CM) is proposed to adjust the values of regularization factors dynamically. It turns out that this method can achieve the minimum theoretical lower bound of regularization factors, allowing for larger step sizes under the convergence condition being satisfied. The convergence of the GPD-CM is directly achieved through a unified variational framework. Theoretical analysis shows that the proposed method can achieve an ergodic convergence rate of O(1/t). Numerical results support our theoretical analysis for an SPP with an exponential coupling operator.
引用
收藏
页码:638 / 645
页数:8
相关论文
共 50 条
  • [1] Accelerated Primal-Dual Gradient Method for Smooth and Convex-Concave Saddle-Point Problems with Bilinear Coupling
    Kovalev, Dmitry
    Gasnikov, Alexander
    Richtarik, Peter
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35, NEURIPS 2022, 2022,
  • [2] Saddle-Point Convergence of Constrained Primal-Dual Dynamics
    Adegbege, Ambrose A.
    Kim, Mun Y.
    IEEE CONTROL SYSTEMS LETTERS, 2021, 5 (04): : 1357 - 1362
  • [3] Adaptive Parallel Primal-Dual Method for Saddle Point Problems
    Zhang, Xiayang
    NUMERICAL MATHEMATICS-THEORY METHODS AND APPLICATIONS, 2018, 11 (01) : 187 - 210
  • [4] A primal-dual algorithm framework for convex saddle-point optimization
    Benxin Zhang
    Zhibin Zhu
    Journal of Inequalities and Applications, 2017
  • [5] A primal-dual algorithm framework for convex saddle-point optimization
    Zhang, Benxin
    Zhu, Zhibin
    JOURNAL OF INEQUALITIES AND APPLICATIONS, 2017,
  • [6] A Generalized Primal-Dual Algorithm with Improved Convergence Condition for Saddle Point Problems
    He, Bingsheng
    Ma, Feng
    Xu, Shengjie
    Yuan, Xiaoming
    SIAM JOURNAL ON IMAGING SCIENCES, 2022, 15 (03): : 1157 - 1183
  • [7] A RELAXED PARAMETER CONDITION FOR THE PRIMAL-DUAL HYBRID GRADIENT METHOD FOR SADDLE-POINT PROBLEM
    Zhang, Xiayang
    Kong, Yuqian
    Liu, Shanshan
    Shen, Yuan
    JOURNAL OF INDUSTRIAL AND MANAGEMENT OPTIMIZATION, 2023, 19 (03) : 1595 - 1610
  • [8] A stochastic variance-reduced accelerated primal-dual method for finite-sum saddle-point problems
    Hamedani, Erfan Yazdandoost
    Jalilzadeh, Afrooz
    COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2023, 85 (02) : 653 - 679
  • [9] A stochastic variance-reduced accelerated primal-dual method for finite-sum saddle-point problems
    Erfan Yazdandoost Hamedani
    Afrooz Jalilzadeh
    Computational Optimization and Applications, 2023, 85 : 653 - 679
  • [10] A REFINED PRIMAL-DUAL ALGORITHM FOR A SADDLE-POINT PROBLEM WITH APPLICATIONS TO IMAGING
    Li, Min
    Li, Xinxin
    Wu, Zhongming
    PACIFIC JOURNAL OF OPTIMIZATION, 2020, 16 (04): : 663 - 685