Asynchronous Distributed Optimization Over Lossy Networks via Relaxed ADMM: Stability and Linear Convergence

被引:41
|
作者
Bastianello, Nicola [1 ]
Carli, Ruggero [1 ]
Schenato, Luca [1 ]
Todescato, Marco [2 ]
机构
[1] Univ Padua, Dept Informat Engn DEI, I-35131 Padua, Italy
[2] Bosch Ctr Artificial Intelligence, D-71272 Renningen, Germany
关键词
Convergence; Convex functions; Peer-to-peer computing; Computer architecture; Cost function; Upper bound; Alternating direction method of multipliers (ADMM); asynchronous update; distributed optimization; lossy communications; operator theory; Peaceman– Rachford splitting (PRS); ALTERNATING DIRECTION METHOD; ALGORITHM; CONSENSUS;
D O I
10.1109/TAC.2020.3011358
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this article, we focus on the problem of minimizing the sum of convex cost functions in a distributed fashion over a peer-to-peer network. In particular, we are interested in the case in which communications between nodes are prone to failures, and the agents are not synchronized among themselves. We address the problem proposing a modified version of the relaxed alternating direction method of multipliers, which corresponds to the Peaceman-Rachford splitting method applied to the dual. By exploiting results from operator theory, we are able to prove the almost sure convergence of the proposed algorithm under general assumptions on the distribution of communication loss and node activation events. By further assuming the cost functions to be strongly convex, we prove the linear convergence of the algorithm in mean to a neighborhood of the optimal solution and provide an upper bound to the convergence rate. Finally, we present numerical results testing the proposed method in different scenarios.
引用
收藏
页码:2620 / 2635
页数:16
相关论文
共 50 条
  • [1] Linear Convergence of ADMM Under Metric Subregularity for Distributed Optimization
    Pan, Xiaowei
    Liu, Zhongxin
    Chen, Zengqiang
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2023, 68 (04) : 2513 - 2520
  • [2] A Partition-Based Implementation of the Relaxed ADMM for Distributed Convex Optimization over Lossy Networks
    Bastianello, N.
    Carli, R.
    Schenato, L.
    Todescato, M.
    2018 IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2018, : 3379 - 3384
  • [3] Distributed Optimization over Lossy Networks via Relaxed Peaceman-Rachford Splitting: a Robust ADMM Approach
    Bastianello, N.
    Todescato, M.
    Carli, R.
    Schenato, L.
    2018 EUROPEAN CONTROL CONFERENCE (ECC), 2018, : 478 - 483
  • [4] Achieving Linear Convergence in Distributed Asynchronous Multiagent Optimization
    Tian, Ye
    Sun, Ying
    Scutari, Gesualdo
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2020, 65 (12) : 5264 - 5279
  • [5] Sublinear and Linear Convergence of Modified ADMM for Distributed Nonconvex Optimization
    Yi, Xinlei
    Zhang, Shengjun
    Yang, Tao
    Chai, Tianyou
    Johansson, Karl Henrik
    IEEE TRANSACTIONS ON CONTROL OF NETWORK SYSTEMS, 2023, 10 (01): : 75 - 86
  • [6] Asynchronous Optimization Over Heterogeneous Networks Via Consensus ADMM
    Kumar, Sandeep
    Jain, Rahul
    Rajawat, Ketan
    IEEE TRANSACTIONS ON SIGNAL AND INFORMATION PROCESSING OVER NETWORKS, 2017, 3 (01): : 114 - 129
  • [7] Linear Convergence of Asynchronous Gradient Push Algorithm for Distributed Optimization
    Li, Huaqing
    Cheng, Huqiang
    Lu, Qingguo
    Wang, Zheng
    Huang, Tingwen
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2025, 55 (03): : 2147 - 2159
  • [8] Asynchronous Distributed Optimization via ADMM with Efficient Communication
    Rikos, Apostolos, I
    Jiang, Wei
    Charalambous, Themistoklis
    Johansson, Karl H.
    2023 62ND IEEE CONFERENCE ON DECISION AND CONTROL, CDC, 2023, : 7002 - 7008
  • [9] Convergence of Asynchronous Distributed Gradient Methods Over Stochastic Networks
    Xu, Jinming
    Zhu, Shanying
    Soh, Yeng Chai
    Xie, Lihua
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2018, 63 (02) : 434 - 448
  • [10] Distributed ADMM With Linear Updates Over Directed Networks
    Rokade, Kiran
    Kalaimani, Rachel Kalpana
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2025, 12 (02): : 1396 - 1407