Finite-Time Convergent Primal-Dual Gradient Dynamics With Applications to Distributed Optimization

被引:17
作者
Shi, Xinli [1 ,2 ]
Xu, Xiangping [3 ]
Cao, Jinde [4 ,5 ]
Yu, Xinghuo [6 ]
机构
[1] Southeast Univ, Minist Educ, Sch Cyber Sci & Engn, Nanjing 210096, Jiangsu, Peoples R China
[2] Southeast Univ, Key Lab Measurement & Control Complex Syst Engn, Minist Educ, Nanjing 210096, Jiangsu, Peoples R China
[3] Southeast Univ, Sch Math, Nanjing 210096, Peoples R China
[4] Southeast Univ, Frontiers Sci Ctr Mobile Informat Commun & Secur, Sch Math, Nanjing 210096, Peoples R China
[5] Yonsei Univ, Yonsei Frontier Lab, Seoul 03722, South Korea
[6] RMIT Univ, Sch Engn, Melbourne, Vic 3001, Australia
基金
中国国家自然科学基金; 澳大利亚研究理事会;
关键词
Optimization; Convergence; Heuristic algorithms; Cost function; Control theory; Switches; Asymptotic stability; Constrained optimization; distributed optimization; finite-time (FT) convergence; nonsmooth analysis; primal-dual gradient dynamics (PDGD); STABILITY; SYSTEMS; FLOWS;
D O I
10.1109/TCYB.2022.3179519
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This article studies the finite-time (FT) convergence of a fast primal-dual gradient dynamics (PDGD), called FT-PDGD, for solving constrained optimization with general constraints and cost functions. Based on the nonsmooth analysis and augmented Lagrangian function, sufficient conditions are established for FT-PDGD to enable the realization of primal-dual optimization in FT. A specific class of nonsmooth sign-preserving functions is defined and analyzed for ensuring FT stability. Particularly, the matrix of linear equations is not required to have a full-row rank and the cost function is not necessary to be strictly convex. By introducing auxiliary variables for general linear inequality constraints, reduced sufficient conditions are further derived for the optimization with linear equality and inequality constraints after transformation. In addition, by the nonsmooth analysis, the switching dynamics evolved in both primal and dual variables are carefully investigated and the upper bound on the convergence time is explicitly provided. Moreover, as applications of FT-PDGD, several FT convergent distributed algorithms are designed to solve distributed optimization with separated and coupled linear equations, respectively. Finally, two case studies are conducted to show the performance of the proposed algorithms.
引用
收藏
页码:3240 / 3252
页数:13
相关论文
共 40 条
[1]   Saddle-Point Convergence of Constrained Primal-Dual Dynamics [J].
Adegbege, Ambrose A. ;
Kim, Mun Y. .
IEEE CONTROL SYSTEMS LETTERS, 2021, 5 (04) :1357-1362
[2]   Linear convergence of primal-dual gradient methods and their performance in distributed optimization [J].
Alghunaim, Sulaiman A. ;
Sayed, Ali H. .
AUTOMATICA, 2020, 117
[3]  
Arrow K.J., 1958, Studies in Linear and Nonlinear Pprogramming
[4]  
Bertsekas D. P., 1999, Nonlinear Programming
[5]   Distributed economic dispatch via a predictive scheme: Heterogeneous delays and privacy preservation [J].
Chen, Fei ;
Chen, Xiaozheng ;
Xiang, Linying ;
Ren, Wei .
AUTOMATICA, 2021, 123
[6]   Sign projected gradient flow: A continuous-time approach to convex optimization with linear equality constraints [J].
Chen, Fei ;
Ren, Wei .
AUTOMATICA, 2020, 120
[7]   A fixed-time convergent algorithm for distributed convex optimization in multi-agent systems [J].
Chen, Gang ;
Li, Zhiyong .
AUTOMATICA, 2018, 95 :539-543
[8]   Convergence Analysis of Saddle Point Problems in Time Varying Wireless Systems-Control Theoretical Approach [J].
Chen, Junting ;
Lau, Vincent K. N. .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2012, 60 (01) :443-452
[9]  
Chen X, 2020, P AMER CONTR CONF, P1612, DOI [10.23919/acc45564.2020.9147393, 10.23919/ACC45564.2020.9147393]
[10]   The Role of Convexity in Saddle-Point Dynamics: Lyapunov Function and Robustness [J].
Cherukuri, Ashish ;
Mallada, Enrique ;
Low, Steven ;
Cortes, Jorge .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2018, 63 (08) :2449-2464