Distributed Optimization Over Dependent Random Networks

被引:1
|
作者
Aghajan, Adel [1 ]
Touri, Behrouz [2 ]
机构
[1] Univ Calif Santa Barbara, Dept Elect & Comp Engn, Santa Barbara, CA 93106 USA
[2] Univ Calif San Diego, Dept Elect & Comp Engn, San Diego, CA 92093 USA
关键词
Convex optimization; directed graph; distributed optimization; random networks; spanning tree; PROJECTION ALGORITHMS; PARAMETER-ESTIMATION; CONSENSUS; CONVERGENCE;
D O I
10.1109/TAC.2022.3216970
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We study the averaging-based distributed optimization solvers over random networks. We show a general result on the convergence of such schemes using weight matrices that are row-stochastic almost surely and column-stochastic in expectation for a broad class of dependent weight-matrix sequences. In addition to implying many of the previously known results on this domain, our work shows the robustness of distributed optimization results to link failure. Also, it provides a new tool for synthesizing distributed optimization algorithms. To prove our main theorem, we establish new results on the rate of convergence analysis of averaging dynamics over (dependent) random networks. These secondary results, along with the required martingale-type results to establish them, might be of interest to broader research endeavors in distributed computation over random networks.
引用
收藏
页码:4812 / 4826
页数:15
相关论文
共 50 条
  • [1] On Distributed Optimization Over Random Independent Networks
    Aghajan, Adel
    Touri, Behrouz
    2022 AMERICAN CONTROL CONFERENCE, ACC, 2022, : 4268 - 4273
  • [2] Distributed Random Reshuffling Over Networks
    Huang, Kun
    Li, Xiao
    Milzarek, Andre
    Pu, Shi
    Qiu, Junwen
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2023, 71 : 1143 - 1158
  • [3] Distributed Convex Optimization with State-Dependent Interactions over Random Networks
    Alaviani, S. Sh
    Kelkar, A. G.
    2021 60TH IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2021, : 3149 - 3153
  • [4] Distributed Subgradient Methods for Convex Optimization Over Random Networks
    Lobel, Ilan
    Ozdaglar, Asuman
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2011, 56 (06) : 1291 - 1306
  • [5] Distributed Optimization over General Directed Networks with Random Sleep Scheme
    Wang, Zheng
    Zheng, Lifeng
    Li, Huaqing
    INTERNATIONAL JOURNAL OF CONTROL AUTOMATION AND SYSTEMS, 2020, 18 (10) : 2534 - 2542
  • [6] Diffusion Adaptation Strategies for Distributed Optimization and Learning Over Networks
    Chen, Jianshu
    Sayed, Ali H.
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2012, 60 (08) : 4289 - 4305
  • [7] A Bregman Splitting Scheme for Distributed Optimization Over Networks
    Xu, Jinming
    Zhu, Shanying
    Soh, Yeng Chai
    Xie, Lihua
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2018, 63 (11) : 3809 - 3824
  • [8] Distributed Nonconvex Optimization over Networks
    Di Lorenzo, Paolo
    Scutari, Gesualdo
    2015 IEEE 6TH INTERNATIONAL WORKSHOP ON COMPUTATIONAL ADVANCES IN MULTI-SENSOR ADAPTIVE PROCESSING (CAMSAP), 2015, : 229 - 232
  • [9] Random Sleep Scheme-Based Distributed Optimization Algorithm Over Unbalanced Time-Varying Networks
    Li, Huaqing
    Wang, Zheng
    Xia, Dawen
    Han, Qi
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2021, 51 (08): : 5244 - 5253
  • [10] ASYMPTOTIC PROPERTIES OF PRIMAL-DUAL ALGORITHM FOR DISTRIBUTED STOCHASTIC OPTIMIZATION OVER RANDOM NETWORKS WITH IMPERFECT COMMUNICATIONS
    Lei, Jinlong
    Chen, Han-Fu
    Fang, Hai-Tao
    SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2018, 56 (03) : 2159 - 2188