Necessary and Sufficient Conditions for Sparsity Pattern Recovery

被引:124
作者
Fletcher, Alyson K. [1 ]
Rangan, Sundeep [2 ]
Goyal, Vivek K. [3 ,4 ]
机构
[1] Univ Calif Berkeley, Dept Elect Engn & Comp Sci, Berkeley, CA 94709 USA
[2] Qualcomm Technol, Bedminster, NJ 07302 USA
[3] MIT, Dept Elect Engn & Comp Sci, Cambridge, MA 02139 USA
[4] MIT, Elect Res Lab, Cambridge, MA 02139 USA
基金
美国国家科学基金会;
关键词
Compressed sensing; convex optimization; Lasso; maximum-likelihood (ML) estimation; orthogonal matching pursuit (OMP); random matrices; random projections; sparse approximation; subset selection; thresholding; SIGNAL RECONSTRUCTION;
D O I
10.1109/TIT.2009.2032726
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The paper considers the problem of detecting the sparsity pattern of a k-sparse vector in R-n from m random noisy measurements. A new necessary condition on the number of measurements for asymptotically reliable detection with maximum-likelihood (ML) estimation and Gaussian measurement matrices is derived. This necessary condition for ML detection is compared against a sufficient condition for simple maximum correlation (MC) or thresholding algorithms. The analysis shows that the gap between thresholding and ML can be described by a simple expression in terms of the total signal-to-noise ratio (SNR), with the gap growing with increasing SNR. Thresholding is also compared against the more sophisticated Lasso and orthogonal matching pursuit (OMP) methods. At high SNRs, it is shown that the gap between Lasso and OMP over thresholding is described by the range of powers of the nonzero component values of the unknown signals. Specifically, the key benefit of Lasso and OMP over thresholding is the ability of Lasso and OMP to detect signals with relatively small components.
引用
收藏
页码:5758 / 5772
页数:15
相关论文
共 41 条
[1]  
AERON S, 2008, ARXIV08043439V3CSIT
[2]  
AERON S, 2007, ARXIV07043434V3CSIT
[3]  
AKCAKAYA M, 2007, ARXIV07110366V1CSIT
[4]  
AKCAKAYA M, 2008, P C INF SCI SYST PRI, P1
[5]  
[Anonymous], ARXIVMATHST0605740V1
[6]   Robust uncertainty principles:: Exact signal reconstruction from highly incomplete frequency information [J].
Candès, EJ ;
Romberg, J ;
Tao, T .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2006, 52 (02) :489-509
[7]  
Candes E, 2007, ANN STAT, V35, P2313, DOI 10.1214/009053606000001523
[8]   Near-optimal signal recovery from random projections: Universal encoding strategies? [J].
Candes, Emmanuel J. ;
Tao, Terence .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2006, 52 (12) :5406-5425
[9]   ORTHOGONAL LEAST-SQUARES METHODS AND THEIR APPLICATION TO NON-LINEAR SYSTEM-IDENTIFICATION [J].
CHEN, S ;
BILLINGS, SA ;
LUO, W .
INTERNATIONAL JOURNAL OF CONTROL, 1989, 50 (05) :1873-1896
[10]   Atomic decomposition by basis pursuit [J].
Chen, SSB ;
Donoho, DL ;
Saunders, MA .
SIAM JOURNAL ON SCIENTIFIC COMPUTING, 1998, 20 (01) :33-61