Spectral-like gradient method for distributed optimization

被引：0
作者：
Jakovetic, Dusan [1 ]
Krejic, Natasa [1 ]
Jerinkic, Natasa Krklec [1 ]
机构：
[1] Univ Novi Sad, Fac Sci, Dept Math & Informat, Novi Sad, Serbia
来源：
PROCEEDINGS OF 18TH INTERNATIONAL CONFERENCE ON SMART TECHNOLOGIES (IEEE EUROCON 2019) | 2019年
关键词：
Distributed optimization; Consensus optimization; Spectral gradient method; Barzilai-Borwein method; BARZILAI; CONSENSUS;
D O I：
10.1109/eurocon.2019.8861761
中图分类号：
TM [电工技术]; TN [电子技术、通信技术];
学科分类号：
0808 ; 0809 ;
摘要：
We consider a standard distributed multi-agent optimization setting where n nodes (agents) in a network minimize the aggregate sum of their local convex cost functions. We present a distributed spectral-like gradient method, wherein step sizes are node- and iteration-varying, and they are inspired by classical spectral methods from centralized optimization. Simulation examples illustrate the performance of the presented method.
引用
收藏
页数：5
相关论文
共 50 条
  • [21] A Nesterov-Like Gradient Tracking Algorithm for Distributed Optimization Over Directed Networks
    Lu, Qingguo
    Liao, Xiaofeng
    Li, Huaqing
    Huang, Tingwen
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2021, 51 (10): : 6258 - 6270
  • [22] SUCAG: Stochastic Unbiased Curvature-aided Gradient Method for Distributed Optimization
    Wai, Hoi-To
    Freris, Nikolaos M.
    Nedic, Angelia
    Scaglione, Anna
    [J]. 2018 IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2018, : 1751 - 1756
  • [23] A family of spectral gradient methods for optimization
    Yu-Hong Dai
    Yakui Huang
    Xin-Wei Liu
    [J]. Computational Optimization and Applications, 2019, 74 : 43 - 65
  • [24] A Distributed Optimization Method with Unknown Cost Function in a Multi-Agent System via Randomized Gradient-Free Method
    Pang, Yipeng
    Hu, Guoqiang
    [J]. 2017 11TH ASIAN CONTROL CONFERENCE (ASCC), 2017, : 144 - 149
  • [25] Preconditioned spectral gradient method
    Luengo, F
    Raydan, M
    Glunt, W
    Hayden, TL
    [J]. NUMERICAL ALGORITHMS, 2002, 30 (3-4) : 241 - 258
  • [26] Preconditioned Spectral Gradient Method
    F. Luengo
    M. Raydan
    W. Glunt
    T.L. Hayden
    [J]. Numerical Algorithms, 2002, 30 : 241 - 258
  • [27] Scaling on the Spectral Gradient Method
    Biglari, Fahimeh
    Solimanpur, Maghsud
    [J]. JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2013, 158 (02) : 626 - 635
  • [28] An Accelerated Gradient Tracking Algorithm with Projection Error for Distributed Optimization
    Meng, Xiwang
    Liu, Qingshan
    Xiong, Jiang
    [J]. 2023 15TH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTATIONAL INTELLIGENCE, ICACI, 2023,
  • [29] Distributed Gradient Tracking for Unbalanced Optimization With Different Constraint Sets
    Cheng, Songsong
    Liang, Shu
    Fan, Yuan
    Hong, Yiguang
    [J]. IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2023, 68 (06) : 3633 - 3640
  • [30] Distributed constrained optimization over unbalanced graphs and delayed gradient
    Huang, Qing
    Fan, Yuan
    Cheng, Songsong
    [J]. JOURNAL OF THE FRANKLIN INSTITUTE, 2025, 362 (02)
12345