Saddle-Point Convergence of Constrained Primal-Dual Dynamics

被引:2
作者
Adegbege, Ambrose A. [1 ]
Kim, Mun Y. [1 ]
机构
[1] Coll New Jersey, Dept Elect & Comp Engn, Ewing, NJ 08628 USA
来源
IEEE CONTROL SYSTEMS LETTERS | 2021年 / 5卷 / 04期
关键词
Stability of nonlinear systems; optimization algorithms; neural networks; NEURAL-NETWORKS; STABILITY; SYSTEMS; CIRCUIT;
D O I
10.1109/LCSYS.2020.3037876
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this letter, we consider saddle-point convergence of primal-dual dynamics for inequality constrained convex optimization problems. By considering the primal-dual dynamics as the interconnection of (i) a gradient system and (ii) a nonlinear controller with incremental sector-bounded static nonlinearity, we establish asymptotic stability by invoking the classical notions of Lyapunov stability, the invariance principle, along with some regularity assumptions. For the special case of strongly convex problem with affine constraints, we prove global exponential convergence. As compared to existing techniques in the literature, the proposed approach offers simple and transparent tuning guideline for robust exponential stability of the saddle-point dynamics and allows for establishing an upper bound on the exponential decay rate.
引用
收藏
页码:1357 / 1362
页数:6
相关论文
共 24 条
  • [1] [Anonymous], 2014, CONSTRAINED OPTIMIZA
  • [2] Arrow K.J., 1958, Stanford Mathematical Studies in the Social Sciences, VII, pvii+229
  • [3] Boyd L., 2004, Convex Optimization, DOI DOI 10.1017/CBO9780511804441
  • [4] Asymptotic convergence of constrained primal-dual dynamics
    Cherukuri, Ashish
    Mallada, Enrique
    Cortes, Jorge
    [J]. SYSTEMS & CONTROL LETTERS, 2016, 87 : 10 - 15
  • [5] Currie J., 2012, Found. Comput.-Aided Process. Oper., V24, P32
  • [6] Desoer C. A., 1975, Feedback Systems: Input-Output Properties, V55
  • [7] Global exponential stability of primal-dual gradient flow dynamics based on the proximal augmented Lagrangian
    Ding, Dongsheng
    Jovanovic, Mihailo R.
    [J]. 2019 AMERICAN CONTROL CONFERENCE (ACC), 2019, : 3414 - 3419
  • [8] Stability of primal-dual gradient dynamics and applications to network optimization
    Feijer, Diego
    Paganini, Fernando
    [J]. AUTOMATICA, 2010, 46 (12) : 1974 - 1981
  • [9] NEW CONDITIONS FOR GLOBAL STABILITY OF NEURAL NETWORKS WITH APPLICATION TO LINEAR AND QUADRATIC-PROGRAMMING PROBLEMS
    FORTI, M
    TESI, A
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-FUNDAMENTAL THEORY AND APPLICATIONS, 1995, 42 (07): : 354 - 366
  • [10] Static anti-windup design for a class of nonlinear systems
    Gomes da Silva, J. M., Jr.
    Oliveira, M. Z.
    Coutinho, D.
    Tarbouriech, S.
    [J]. INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2014, 24 (05) : 793 - 810