Fast Convergence Rates for Distributed Non-Bayesian Learning

被引：131

作者：

Nedic, Angelia ^{[1
]}

Olshevsky, Alex ^{[2
,3
]}

Uribe, Cesar A. ^{[4
,5
]}

机构：

[1] Arizona State Univ, ECEE Dept, Tempe, AZ 85287 USA

[2] Boston Univ, ECE Dept, Boston, MA 02215 USA

[3] Boston Univ, Div Syst Engn, Boston, MA 02215 USA

[4] Univ Illinois, ECE Dept, Urbana, IL 61820 USA

[5] Univ Illinois, Coordinated Sci Lab, Urbana, IL 61820 USA

来源：

IEEE TRANSACTIONS ON AUTOMATIC CONTROL | 2017年 / 62卷 / 11期

基金：

美国国家科学基金会;

关键词：

Algorithm design and analysis; Bayes methods; distributed algorithms; estimation; learning; SENSOR NETWORKS; ASYMPTOTIC AGREEMENT; LOCALIZATION; CONSENSUS;

D O I：

10.1109/TAC.2017.2690401

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

We consider the problem of distributed learning, where a network of agents collectively aim to agree on a hypothesis that best explains a set of distributed observations of conditionally independent random processes. We propose a distributed algorithm and establish consistency, as well as a nonasymptotic, explicit, and geometric convergence rate for the concentration of the beliefs around the set of optimal hypotheses. Additionally, if the agents interact over static networks, we provide an improved learning protocol with better scalability with respect to the number of nodes in the network.

引用

页码：5538 / 5553

页数：16

共 60 条

[1] Bayesian Learning in Social Networks [J].

Acemoglu, Daron ;

Dahleh, Munther A. ;

Lobel, Ilan ;

Ozdaglar, Asuman .

REVIEW OF ECONOMIC STUDIES, 2011, 78 (04) :1201-1236

[2]

Alanyali M, 2004, P AMER CONTR CONF, P5369

[3]

[Anonymous], 2013, Concentration Inequali-ties: A Nonasymptotic Theory of Independence, DOI DOI 10.1093/ACPROF:OSO/9780199535255.001.0001

[4]

[Anonymous], 2014, ARXIV14114186

[5] AGREEING TO DISAGREE [J].

AUMANN, RJ .

ANNALS OF STATISTICS, 1976, 4 (06) :1236-1239

[6]

Bandyopadhyay S, 2014, P AMER CONTR CONF, P634, DOI 10.1109/ACC.2014.6858896

[7]

Barbarossa S, 2014, ACADEMIC PRESS LIBRARY IN SIGNAL PROCESSING, VOL 2: COMMUNICATIONS AND RADAR SIGNAL PROCESSING, P329, DOI 10.1016/B978-0-12-396500-4.00007-7

[8] Kullback-Leibler average, consensus on probability densities, and distributed state estimation with guaranteed stability [J].

Battistelli, Giorgio ;

Chisci, Luigi .

AUTOMATICA, 2014, 50 (03) :707-718

[9] ASYMPTOTIC AGREEMENT IN DISTRIBUTED ESTIMATION [J].

BORKAR, V ;

VARAIYA, PP .

IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1982, 27 (03) :650-655

[10]

Cooke R., 1990, Statistics in Science, V122, P41

← 1 2 3 4 5 6 →