Accelerated First-Order Continuous-Time Algorithm for Solving Convex-Concave Bilinear Saddle Point Problem

被引:4
|
作者
Zeng, Xianlin [1 ]
Dou, Lihua [1 ]
Chen, Jie [1 ,2 ]
机构
[1] Beijing Inst Technol, Beijing Adv Innovat Ctr Intelligent Robots & Syst, Key Lab Biomimet Robots Arid Syst, Minist Educ, Beijing, Peoples R China
[2] Tongji Univ, Shanghai Res Inst Intelligent Autonomous Syst, Dept Control Sci & Engn, Shanghai, Peoples R China
来源
IFAC PAPERSONLINE | 2020年 / 53卷 / 02期
关键词
Accelerated method; first-order algorithm; continuous-time algorithm; saddle-point problem; OPTIMIZATION;
D O I
10.1016/j.ifacol.2020.12.1257
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
First-order methods have simple structures and are of great importance to big data problems because first-order methods are easy to implement in a distributed or parallel way. However, in the worst cases, first-order methods often converge at a rate O(1/t), which is slow. This paper considers a class of convex-concave bilinear saddle point problems and proposes an accelerated first-order continuous-time algorithm. We design the accelerated algorithm by using both increasing and decreasing damping coefficients in the saddle point dynamics. If parameters of the proposed algorithm are proper, the algorithm owns O(1/t(2)) convergence without any strict or strong convexity requirement. Finally, we apply the algorithm to numerical examples to show the superior performance of the proposed algorithm over existing ones. Copyright (C) 2020 The Authors.
引用
收藏
页码:7362 / 7367
页数:6
相关论文
共 50 条