Tight lower bounds on the convergence rate of primal-dual dynamics for equality constrained convex problems

被引:2
作者
Ozaslan, Ibrahim K. [1 ]
Jovanovic, Mihailo R. [1 ]
机构
[1] Univ Southern Calif, Ming Hsieh Dept Elect & Comp Engn, Los Angeles, CA 90089 USA
来源
2023 62ND IEEE CONFERENCE ON DECISION AND CONTROL, CDC | 2023年
关键词
Convex optimization; exponential stability; gradient flow dynamics; primal-dual methods; SADDLE-POINT DYNAMICS; STABILITY; OPTIMIZATION;
D O I
10.1109/CDC49753.2023.10383202
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We study the exponential stability of continuoustime primal-dual gradient flow dynamics for convex optimization problems with linear equality constraints. Without making any assumptions on the rank of the constraint matrix, we obtain a tight lower bound on the worst-case convergence rate for smooth strongly convex objective functions. Our analysis identifies two different convergence regimes depending on the ratio between primal and dual time scales. When the primal time scale is inversely proportional to the Lipschitz parameter of the objective function and the dual time scale is large enough, the convergence rate is inversely proportional to the condition number of the problem. In contrast to the existing results, our lower bound on the convergence rate does not depend on the condition number of the constraint matrix.
引用
收藏
页码:7318 / 7323
页数:6
相关论文
共 29 条
[1]  
Arrow KJ, 1958, Studies in linear and non-linear programming
[2]   Fast Convergence of Dynamical ADMM via Time Scaling of Damped Inertial Dynamics [J].
Attouch, Hedy ;
Chbani, Zaki ;
Fadili, Jalal ;
Riahi, Hassan .
JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2022, 193 (1-3) :704-736
[3]  
Boyd SP., 2004, Convex Optimization, DOI [10.1017/CBO9780511804441, DOI 10.1017/CBO9780511804441]
[4]  
Chen X, 2020, P AMER CONTR CONF, P1612, DOI [10.23919/ACC45564.2020.9147393, 10.23919/acc45564.2020.9147393]
[5]   The Role of Convexity in Saddle-Point Dynamics: Lyapunov Function and Robustness [J].
Cherukuri, Ashish ;
Mallada, Enrique ;
Low, Steven ;
Cortes, Jorge .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2018, 63 (08) :2449-2464
[6]   SADDLE-POINT DYNAMICS: CONDITIONS FOR ASYMPTOTIC STABILITY OF SADDLE POINTS [J].
Cherukuri, Ashish ;
Gharesifard, Bahman ;
Cortes, Jorge .
SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2017, 55 (01) :486-511
[7]   Asymptotic convergence of constrained primal-dual dynamics [J].
Cherukuri, Ashish ;
Mallada, Enrique ;
Cortes, Jorge .
SYSTEMS & CONTROL LETTERS, 2016, 87 :10-15
[8]   Distributed Coordination for Nonsmooth Convex Optimization via Saddle-Point Dynamics [J].
Cortes, Jorge ;
Niederlaender, Simon K. .
JOURNAL OF NONLINEAR SCIENCE, 2019, 29 (04) :1247-1272
[9]   The Proximal Augmented Lagrangian Method for Nonsmooth Composite Optimization [J].
Dhingra, Neil K. ;
Khong, Sei Zhen ;
Jovanovic, Mihailo R. .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2019, 64 (07) :2861-2868
[10]  
Ding DS, 2020, IEEE DECIS CONTR P, P4836, DOI 10.1109/CDC42340.2020.9304313