Distributed Optimization Over Dependent Random Networks

被引:3
作者
Aghajan, Adel [1 ]
Touri, Behrouz [2 ]
机构
[1] Univ Calif Santa Barbara, Dept Elect & Comp Engn, Santa Barbara, CA 93106 USA
[2] Univ Calif San Diego, Dept Elect & Comp Engn, San Diego, CA 92093 USA
关键词
Convex optimization; directed graph; distributed optimization; random networks; spanning tree; PROJECTION ALGORITHMS; PARAMETER-ESTIMATION; CONSENSUS; CONVERGENCE;
D O I
10.1109/TAC.2022.3216970
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We study the averaging-based distributed optimization solvers over random networks. We show a general result on the convergence of such schemes using weight matrices that are row-stochastic almost surely and column-stochastic in expectation for a broad class of dependent weight-matrix sequences. In addition to implying many of the previously known results on this domain, our work shows the robustness of distributed optimization results to link failure. Also, it provides a new tool for synthesizing distributed optimization algorithms. To prove our main theorem, we establish new results on the rate of convergence analysis of averaging dynamics over (dependent) random networks. These secondary results, along with the required martingale-type results to establish them, might be of interest to broader research endeavors in distributed computation over random networks.
引用
收藏
页码:4812 / 4826
页数:15
相关论文
共 37 条
[1]  
Alon N., 2016, The Probabilistic Method
[2]  
[Anonymous], 1985, Herbert Robbins Selected Papers
[3]  
[Anonymous], 1958, MATH P CAMBRIDGE PHI, DOI DOI 10.1017/S0305004100033399
[4]   Broadcast Gossip Algorithms for Consensus [J].
Aysal, Tuncer Can ;
Yildiz, Mehmet Ercan ;
Sarwate, Anand D. ;
Scaglione, Anna .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2009, 57 (07) :2748-2761
[5]   Randomized gossip algorithms [J].
Boyd, Stephen ;
Ghosh, Arpita ;
Prabhakar, Balaji ;
Shah, Devavrat .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2006, 52 (06) :2508-2530
[6]   Diffusion LMS Strategies for Distributed Estimation [J].
Cattivelli, Federico S. ;
Sayed, Ali H. .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2010, 58 (03) :1035-1048
[7]  
Charron-Bost B, 2013, Arxiv, DOI arXiv:1303.2043
[8]   TOWARDS CONSENSUS - SOME CONVERGENCE THEOREMS ON REPEATED AVERAGING [J].
CHATTERJEE, S ;
SENETA, E .
JOURNAL OF APPLIED PROBABILITY, 1977, 14 (01) :89-97
[9]   Distributed Generator Coordination for Initialization and Anytime Optimization in Economic Dispatch [J].
Cherukuri, Ashish ;
Cortes, Jorge .
IEEE TRANSACTIONS ON CONTROL OF NETWORK SYSTEMS, 2015, 2 (03) :226-237
[10]  
Dobrushin Roland L., 1956, Theor. Probab. Appl., V1, P329, DOI DOI 10.1137/1101029