Fast Inverse-Free Sparse Bayesian Learning via Relaxed Evidence Lower Bound Maximization

被引:65
作者
Duan, Huiping [1 ]
Yang, Linxiao [2 ]
Fang, Jun [2 ]
Li, Hongbin [3 ]
机构
[1] Univ Elect Sci & Technol China, Sch Elect Engn, Chengdu 611731, Peoples R China
[2] Univ Elect Sci & Technol China, Natl Key Lab Sci & Technol Commun, Chengdu 611731, Peoples R China
[3] Stevens Inst Technol, Dept Elect & Comp Engn, Hoboken, NJ 07030 USA
基金
美国国家科学基金会;
关键词
Compressed sensing; inverse-free sparse Bayesian learning (SBL); relaxed evidence lower bound (relaxed-ELBO);
D O I
10.1109/LSP.2017.2692217
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Sparse Beyesian learning is a popular approach for sparse signal recovery, and has demonstrated superior performance in a series of experiments. Nevertheless, the sparse Bayesian learning algorithm involves a matrix inverse at each iteration. Its associated computational complexity grows significantly with the problem size, which hinders its application to many practical problems even with moderately large datasets. To address this issue, in this letter, we develop a fast inverse-free sparse Bayesian learning method. Specifically, by invoking a fundamental property for smooth functions, we obtain a relaxed evidence lower bound (relaxed-ELBO) that is computationally more amiable than the conventional ELBO used by sparse Bayesian learning. A variational expectation-maximization (EM) scheme is then employed to maximize the relaxed-ELBO, which leads to a computationally efficient inverse-free sparse Bayesian learning algorithm. Simulation results show that the proposed algorithm has a fast convergence rate and achieves lower reconstruction errors than other state-of-the-art fast sparse recovery methods in the presence of noise.
引用
收藏
页码:774 / 778
页数:5
相关论文
共 16 条
  • [1] [Anonymous], 2003, P 9 INT WORKSH ART I
  • [2] [Anonymous], 2000, ACM C UNCERTAINTY AR
  • [3] [Anonymous], P INF THEOR WORKSH C
  • [4] A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems
    Beck, Amir
    Teboulle, Marc
    [J]. SIAM JOURNAL ON IMAGING SCIENCES, 2009, 2 (01): : 183 - 202
  • [5] Decoding by linear programming
    Candes, EJ
    Tao, T
    [J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 2005, 51 (12) : 4203 - 4215
  • [6] Two-Dimensional Pattern-Coupled Sparse Bayesian Learning via Generalized Approximate Message Passing
    Fang, Jun
    Zhang, Lizao
    Li, Hongbin
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (06) : 2920 - 2930
  • [7] Bayesian compressive sensing
    Ji, Shihao
    Xue, Ya
    Carin, Lawrence
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2008, 56 (06) : 2346 - 2356
  • [8] Rangan S, 2011, IEEE INT SYMP INFO
  • [9] Fast Variational Sparse Bayesian Learning With Automatic Relevance Determination for Superimposed Signals
    Shutin, Dmitriy
    Buchgraber, Thomas
    Kulkarni, Sanjeev R.
    Poor, H. Vincent
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2011, 59 (12) : 6257 - 6261
  • [10] Compressive Imaging Using Approximate Message Passing and a Markov-Tree Prior
    Som, Subhojit
    Schniter, Philip
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2012, 60 (07) : 3439 - 3448