Consensus Based Distributed Sparse Bayesian Learning by Fast Marginal Likelihood Maximization

被引:6
作者
Manss, Christoph [1 ]
Shutin, Dmitriy [1 ]
Leus, Geert [2 ]
机构
[1] German Aerosp Ctr, Inst Commun & Nav, D-82234 Wessling, Germany
[2] Delft Univ Technol, NL-2628 CD Delft, Netherlands
关键词
Signal processing algorithms; Optimization; Bayes methods; Estimation; Robot sensing systems; Convergence; Convex functions; Consensus algorithms; distributed optimization; sparse bayesian learning; REGRESSION;
D O I
10.1109/LSP.2020.3039481
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
For swarm systems, distributed processing is of paramount importance and Bayesian methods are preferred for their robustness. Existing distributed sparse Bayesian learning (SBL) methods rely on the automatic relevance determination (ARD), which involves a computationally complex reweighted l1-norm optimization, or they use loopy belief propagation, which is not guaranteed to converge. Hence, this paper looks into the fast marginal likelihood maximization (FMLM) method to develop a faster distributed SBL version. The proposed method has a low communication overhead, and can be distributed by simple consensus methods. The performed simulations indicate a better performance compared with the distributed ARD version, yet the same performance as the FMLM.
引用
收藏
页码:2119 / 2123
页数:5
相关论文
共 25 条
[1]   Distributed optimization and statistical learning via the alternating direction method of multipliers [J].
Boyd S. ;
Parikh N. ;
Chu E. ;
Peleato B. ;
Eckstein J. .
Foundations and Trends in Machine Learning, 2010, 3 (01) :1-122
[2]  
Buchgraber T, 2011, INT CONF ACOUST SPEE, P2128
[3]  
Frassl M, 2012, COMM COM INF SC, V318, P475
[4]   Type I and Type II Bayesian Methods for Sparse Signal Recovery Using Scale Mixtures [J].
Giri, Ritwik ;
Rao, Bhaskar .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2016, 64 (13) :3418-3428
[5]   Linear Convergence and Metric Selection for Douglas-Rachford Splitting and ADMM [J].
Giselsson, Pontus ;
Boyd, Stephen .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2017, 62 (02) :532-544
[6]   Localized Linear Regression in Networked Data [J].
Jung, Alexander ;
Tran, Nguyen .
IEEE SIGNAL PROCESSING LETTERS, 2019, 26 (07) :1090-1094
[7]   INFORMATION-BASED OBJECTIVE FUNCTIONS FOR ACTIVE DATA SELECTION [J].
MACKAY, DJC .
NEURAL COMPUTATION, 1992, 4 (04) :590-604
[8]  
Manss C, 2019, 2019 IEEE 8TH INTERNATIONAL WORKSHOP ON COMPUTATIONAL ADVANCES IN MULTI-SENSOR ADAPTIVE PROCESSING (CAMSAP 2019), P490, DOI [10.1109/camsap45676.2019.9022453, 10.1109/CAMSAP45676.2019.9022453]
[9]  
Manss C, 2018, 2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), P3654, DOI 10.1109/ICASSP.2018.8462229
[10]   Distributed Sparse Linear Regression [J].
Mateos, Gonzalo ;
Bazerque, Juan Andres ;
Giannakis, Georgios B. .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2010, 58 (10) :5262-5276