Triggered Gradient Tracking for asynchronous distributed optimization

被引:12
作者
Carnevale, Guido [1 ]
Notarnicola, Ivano [1 ]
Marconi, Lorenzo [1 ]
Notarstefano, Giuseppe [1 ]
机构
[1] Alma Mater Studiorum Univ Bologna, Dept Elect Elect & Informat Engn, Bologna, BO, Italy
基金
欧洲研究理事会;
关键词
Distributed optimization; Multi-agent systems; Large scale optimization problems and  methods; CONVEX-OPTIMIZATION; CONSENSUS; CONVERGENCE; ALGORITHMS;
D O I
10.1016/j.automatica.2022.110726
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper proposes ASYNCHRONOUS TRIGGERED GRADIENT TRACKING, i.e., a distributed optimization algorithm to solve consensus optimization over networks with asynchronous communication. As a building block, we devise the continuous-time counterpart of the recently proposed (discrete-time) distributed gradient tracking called CONTINUOUS GRADIENT TRACKING. By using a Lyapunov approach, we prove exponential stability of the equilibrium corresponding to agents' estimates being consensual to the optimal solution, with arbitrary initialization of the local estimates. Then, we propose two triggered versions of the algorithm. In the first one, the agents continuously integrate their local dynamics and exchange with neighbors their current local variables in a synchronous way. In ASYNCHRONOUS TRIGGERED GRADIENT TRACKING, we propose a totally asynchronous scheme in which each agent sends to neighbors its current local variables based on a triggering condition that depends on a locally verifiable condition. The triggering protocol preserves the linear convergence of the algorithm and avoids the Zeno behavior, i.e., an infinite number of triggering events over a finite interval of time is excluded. By using the stability analysis of CONTINUOUS GRADIENT TRACKING as a preparatory result, we show exponential stability of the equilibrium point holds for both triggered algorithms and any estimate initialization. Finally, the simulations validate the effectiveness of the proposed methods on a data analytics problem, showing also improved performance in terms of inter-agent communication. (c) 2022 Elsevier Ltd. All rights reserved.
引用
收藏
页数:12
相关论文
共 42 条
  • [1] Distributed gradient descent method with edge-based event-driven communication for non-convex optimization
    Adachi, T.
    Hayashi, N.
    Takai, S.
    [J]. IET CONTROL THEORY AND APPLICATIONS, 2021, 15 (12) : 1588 - 1598
  • [2] Bin M, 2019, IEEE DECIS CONTR P, P2994, DOI 10.1109/CDC40024.2019.9029824
  • [3] Carnevale G, 2023, Arxiv, DOI arXiv:2009.01745
  • [4] Enhanced Gradient Tracking Algorithms for Distributed Quadratic Optimization via Sparse Gain Design
    Carnevale, Guido
    Bin, Michelangelo
    Notarnicola, Ivano
    Marconi, Lorenzo
    Notarstefano, Giuseppe
    [J]. IFAC PAPERSONLINE, 2020, 53 (02): : 2696 - 2701
  • [5] Distributed optimisation design with triggers for disturbed continuous-time multi-agent systems
    Deng, Zhenhua
    Wang, Xinghu
    Hong, Yiguang
    [J]. IET CONTROL THEORY AND APPLICATIONS, 2017, 11 (02) : 282 - 290
  • [6] NEXT: In-Network Nonconvex Optimization
    Di Lorenzo, Paolo
    Scutari, Gesualdo
    [J]. IEEE TRANSACTIONS ON SIGNAL AND INFORMATION PROCESSING OVER NETWORKS, 2016, 2 (02): : 120 - 136
  • [7] THE APPROXIMATE DUALITY GAP TECHNIQUE: A UNIFIED THEORY OF FIRST-ORDER METHODS
    Diakonikolas, Jelena
    Orecchia, Lorenzo
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2019, 29 (01) : 660 - 689
  • [8] Distributed Continuous-Time Convex Optimization on Weight-Balanced Digraphs
    Gharesifard, Bahman
    Cortes, Jorge
    [J]. IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2014, 59 (03) : 781 - 786
  • [9] Passivity-Based Distributed Optimization With Communication Delays Using PI Consensus Algorithm
    Hatanaka, Takeshi
    Chopra, Nikhil
    Ishizaki, Takayuki
    Li, Na
    [J]. IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2018, 63 (12) : 4421 - 4428
  • [10] Distributed Subgradient Method With Edge-Based Event-Triggered Communication
    Kajiyama, Yuichi
    Hayashi, Naoki
    Takai, Shigemasa
    [J]. IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2018, 63 (07) : 2248 - 2255