Fast Convergence Rates for Distributed Non-Bayesian Learning

被引:131
作者
Nedic, Angelia [1 ]
Olshevsky, Alex [2 ,3 ]
Uribe, Cesar A. [4 ,5 ]
机构
[1] Arizona State Univ, ECEE Dept, Tempe, AZ 85287 USA
[2] Boston Univ, ECE Dept, Boston, MA 02215 USA
[3] Boston Univ, Div Syst Engn, Boston, MA 02215 USA
[4] Univ Illinois, ECE Dept, Urbana, IL 61820 USA
[5] Univ Illinois, Coordinated Sci Lab, Urbana, IL 61820 USA
基金
美国国家科学基金会;
关键词
Algorithm design and analysis; Bayes methods; distributed algorithms; estimation; learning; SENSOR NETWORKS; ASYMPTOTIC AGREEMENT; LOCALIZATION; CONSENSUS;
D O I
10.1109/TAC.2017.2690401
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We consider the problem of distributed learning, where a network of agents collectively aim to agree on a hypothesis that best explains a set of distributed observations of conditionally independent random processes. We propose a distributed algorithm and establish consistency, as well as a nonasymptotic, explicit, and geometric convergence rate for the concentration of the beliefs around the set of optimal hypotheses. Additionally, if the agents interact over static networks, we provide an improved learning protocol with better scalability with respect to the number of nodes in the network.
引用
收藏
页码:5538 / 5553
页数:16
相关论文
共 60 条
[51]  
Su L., 2016, ARXIV PREPRINT ARXIV
[52]  
Su L., 2016, ARXIV160603418
[53]   Multi-sensor optimal information fusion Kalman filter* [J].
Sun, SL ;
Deng, ZL .
AUTOMATICA, 2004, 40 (06) :1017-1023
[54]  
Tsiligkaridis A., 2016, ARXIV160806007
[55]   CONVERGENCE AND ASYMPTOTIC AGREEMENT IN DISTRIBUTED DECISION-PROBLEMS [J].
TSITSIKLIS, JN ;
ATHANS, M .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1984, 29 (01) :42-50
[56]   Distributed detection with multiple sensors .1. Fundamentals [J].
Viswanathan, R ;
Varshney, PK .
PROCEEDINGS OF THE IEEE, 1997, 85 (01) :54-63
[57]  
Walker S.G., 2006, Sankhya: The Indian Journal of Statistics, V68, P542
[58]   Target Tracking in Wireless Sensor Networks Based on the Combination of KF and MLE Using Distance Measurements [J].
Wang, Xingbo ;
Fu, Minyue ;
Zhang, Huanshui .
IEEE TRANSACTIONS ON MOBILE COMPUTING, 2012, 11 (04) :567-576
[59]   OPTIMAL INFORMATION-PROCESSING AND BAYES THEOREM [J].
ZELLNER, A .
AMERICAN STATISTICIAN, 1988, 42 (04) :278-280
[60]   Optimal dimensionality reduction of sensor data in multisensor estimation fusion [J].
Zhu, YM ;
Song, EB ;
Zhou, J ;
You, ZS .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2005, 53 (05) :1631-1639