Accelerated First-Order Continuous-Time Algorithm for Solving Convex-Concave Bilinear Saddle Point Problem

被引:4
|
作者
Zeng, Xianlin [1 ]
Dou, Lihua [1 ]
Chen, Jie [1 ,2 ]
机构
[1] Beijing Inst Technol, Beijing Adv Innovat Ctr Intelligent Robots & Syst, Key Lab Biomimet Robots Arid Syst, Minist Educ, Beijing, Peoples R China
[2] Tongji Univ, Shanghai Res Inst Intelligent Autonomous Syst, Dept Control Sci & Engn, Shanghai, Peoples R China
来源
IFAC PAPERSONLINE | 2020年 / 53卷 / 02期
关键词
Accelerated method; first-order algorithm; continuous-time algorithm; saddle-point problem; OPTIMIZATION;
D O I
10.1016/j.ifacol.2020.12.1257
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
First-order methods have simple structures and are of great importance to big data problems because first-order methods are easy to implement in a distributed or parallel way. However, in the worst cases, first-order methods often converge at a rate O(1/t), which is slow. This paper considers a class of convex-concave bilinear saddle point problems and proposes an accelerated first-order continuous-time algorithm. We design the accelerated algorithm by using both increasing and decreasing damping coefficients in the saddle point dynamics. If parameters of the proposed algorithm are proper, the algorithm owns O(1/t(2)) convergence without any strict or strong convexity requirement. Finally, we apply the algorithm to numerical examples to show the superior performance of the proposed algorithm over existing ones. Copyright (C) 2020 The Authors.
引用
收藏
页码:7362 / 7367
页数:6
相关论文
共 50 条
  • [21] Parameter-Separable Prox-Lagrangian Method for Convex-Concave Saddle Point Problem
    Wu, Zhaolong
    Zhao, Xiaowei
    IEEE CONTROL SYSTEMS LETTERS, 2024, 8 : 253 - 258
  • [22] A PRIMAL-DUAL ALGORITHM WITH LINE SEARCH FOR GENERAL CONVEX-CONCAVE SADDLE POINT PROBLEMS
    Hamedani, Erfan Yazdandoost
    Aybat, Necdet Serhat
    SIAM JOURNAL ON OPTIMIZATION, 2021, 31 (02) : 1299 - 1329
  • [23] Generalized Asymmetric Forward-Backward-Adjoint Algorithms for Convex-Concave Saddle-Point Problem
    Bai, Jianchao
    Chen, Yang
    Yu, Xue
    Zhang, Hongchao
    JOURNAL OF SCIENTIFIC COMPUTING, 2025, 102 (03)
  • [24] A Study of the First-Order Continuous-Time Bilinear Processes Driven by Fractional Brownian Motion
    Bibi, Abdelouahab
    Merahi, Fateh
    JOURNAL OF STATISTICAL THEORY AND APPLICATIONS, 2018, 17 (04): : 606 - 615
  • [25] A Study of the First-Order Continuous-Time Bilinear Processes Driven by Fractional Brownian Motion
    Abdelouahab Bibi
    Fateh Merahi
    Journal of Statistical Theory and Applications, 2018, 17 (4): : 606 - 615
  • [26] Solving strongly convex-concave composite saddle-point problems with low dimension of one group of variables
    Alkousa, M. S.
    Gasnikov, A. V.
    Gladin, E. L.
    Kuruzov, I. A.
    Pasechnyuk, D. A.
    Stonyakin, F. S.
    SBORNIK MATHEMATICS, 2023, 214 (03) : 285 - 333
  • [27] Robust adaptive algorithm for linear first-order continuous-time plants
    Peng, Hua-Jye
    Chen, Bor-Sen
    Journal of the Chinese Institute of Engineers, Transactions of the Chinese Institute of Engineers,Series A/Chung-kuo Kung Ch'eng Hsuch K'an, 1994, 17 (04): : 585 - 592
  • [28] THE FIRST-ORDER APPROACH TO THE CONTINUOUS-TIME PRINCIPAL-AGENT PROBLEM WITH EXPONENTIAL UTILITY
    SCHATTLER, H
    SUNG, JY
    JOURNAL OF ECONOMIC THEORY, 1993, 61 (02) : 331 - 371
  • [29] Characterization and Compensation of Nonlinearities in a Continuous-time First-order ΣΔ ADC
    Schmidt, C.
    Cousseau, J. E.
    Figueroa, J. L.
    Wichman, R.
    Werner, S.
    2010 IEEE INTERNATIONAL MICROWAVE WORKSHOP SERIES ON RF FRONT-ENDS FOR SOFTWARE DEFINED AND COGNITIVE RADIO SOLUTIONS (IMWS 2010), 2010,
  • [30] First-order continuous-time sigma-delta modulator
    Li, Yamei
    He, Lili
    ISQED 2007: PROCEEDINGS OF THE EIGHTH INTERNATIONAL SYMPOSIUM ON QUALITY ELECTRONIC DESIGN, 2007, : 229 - +