Approximate Sparsity Pattern Recovery: Information-Theoretic Lower Bounds

被引:49
作者
Reeves, Galen [1 ]
Gastpar, Michael C. [1 ,2 ]
机构
[1] Univ Calif Berkeley, Dept Elect Engn & Comp Sci, Berkeley, CA 94720 USA
[2] Ecole Polytech Fed Lausanne, Sch Comp & Commun Sci, CH-1015 Lausanne, Switzerland
关键词
Compressed sensing; information-theoretic bounds; random matrix theory; sparsity; support recovery; SIGNAL RECOVERY; LIMITS; CDMA; SELECTION;
D O I
10.1109/TIT.2013.2253852
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recovery of the sparsity pattern (or support) of an unknown sparse vector from a small number of noisy linear measurements is an important problem in compressed sensing. In this paper, the high-dimensional setting is considered. It is shown that if the measurement rate and per-sample signal-to-noise ratio (SNR) are finite constants independent of the length of the vector, then the optimal sparsity pattern estimate will have a constant fraction of errors. Lower bounds on the measurement rate needed to attain a desired fraction of errors are given in terms of the SNR and various key parameters of the unknown vector. The tightness of the bounds in a scaling sense, as a function of the SNR and the fraction of errors, is established by comparison with existing achievable bounds. Near optimality is shown for a wide variety of practically motivated signal models.
引用
收藏
页码:3451 / 3465
页数:15
相关论文
共 36 条
[1]   Information Theoretic Bounds for Compressed Sensing [J].
Aeron, Shuchin ;
Saligrama, Venkatesh ;
Zhao, Manqi .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2010, 56 (10) :5111-5130
[2]   Shannon-Theoretic Limits on Noisy Compressive Sampling [J].
Akcakaya, Mehmet ;
Tarokh, Vahid .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2010, 56 (01) :492-504
[3]  
[Anonymous], 2006, ALL C COMM CONTR COM
[4]  
[Anonymous], 1990, SUBSET SELECTION REG, DOI DOI 10.1007/978-1-4899-2939-6
[5]   Robust uncertainty principles:: Exact signal reconstruction from highly incomplete frequency information [J].
Candès, EJ ;
Romberg, J ;
Tao, T .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2006, 52 (02) :489-509
[6]   Near-optimal signal recovery from random projections: Universal encoding strategies? [J].
Candes, Emmanuel J. ;
Tao, Terence .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2006, 52 (12) :5406-5425
[7]   Stable signal recovery from incomplete and inaccurate measurements [J].
Candes, Emmanuel J. ;
Romberg, Justin K. ;
Tao, Terence .
COMMUNICATIONS ON PURE AND APPLIED MATHEMATICS, 2006, 59 (08) :1207-1223
[8]   Atomic decomposition by basis pursuit [J].
Chen, SSB ;
Donoho, DL ;
Saunders, MA .
SIAM JOURNAL ON SCIENTIFIC COMPUTING, 1998, 20 (01) :33-61
[9]  
Cover T.M., 2006, ELEMENTS INFORM THEO, V2nd ed
[10]  
DeVore R. A., 1993, Constructive Approximation