For most large underdetermined systems of linear equations the minimal l1-norm solution is also the sparsest solution

被引:1773
作者
Donoho, DL [1 ]
机构
[1] Stanford Univ, Dept Stat, Stanford, CA 94305 USA
关键词
D O I
10.1002/cpa.20132
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
We consider linear equations y = phi x where y is a given vector in R-n and phi is a given n x m matrix with n < m <= tau n, and we wish to solve for x epsilon R-m. We suppose that the columns of phi are normalized to the unit l(2)-norm, and we place uniform measure on such phi. We prove the existence of rho = rho(tau) > 0 so that for large n and for all Vs except a negligible fraction, the following property holds: For every y having a representation y = phi x(0) by a coefficient vector x(0) epsilon R-m. with fewer than rho center dot n nonzeros, the solution x(1) of the l(1)-minimization problem min parallel to x parallel to(1) subject to phi x = y is unique and equal to x(0). In contrast, heuristic attempts to sparsely solve such systems-greedy algorithms and thresholding-perform poorly ill this challenging setting. The techniques include the use of random proportional embeddings and almost-spherical sections in Banach space theory, and deviation bounds for the eigenvalues of random Wishart matrices. (c) 2006 Wiley Periodicals, Inc.
引用
收藏
页码:797 / 829
页数:33
相关论文
共 30 条
[1]  
[Anonymous], LECT NOTES MATH
[2]  
[Anonymous], 1983, EXTREMES RELATED PRO
[3]   Projection algorithms for solving convex feasibility problems [J].
Bauschke, HH ;
Borwein, JM .
SIAM REVIEW, 1996, 38 (03) :367-426
[4]  
CANDES EJ, IN PRESS IEEE T INFO
[5]  
Chen Y, 1998, NONCON OPTIM ITS APP, V20, P1
[6]  
COIFMAN PR, 1993, PROGR WAVELET ANAL A, P77
[7]   ENTROPY-BASED ALGORITHMS FOR BEST BASIS SELECTION [J].
COIFMAN, RR ;
WICKERHAUSER, MV .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1992, 38 (02) :713-718
[8]  
Davidson KR, 2001, HANDBOOK OF THE GEOMETRY OF BANACH SPACES, VOL 1, P317, DOI 10.1016/S1874-5849(01)80010-3
[9]   Stable recovery of sparse overcomplete representations in the presence of noise [J].
Donoho, DL ;
Elad, M ;
Temlyakov, VN .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2006, 52 (01) :6-18
[10]  
DONOHO DL, 1992, J ROY STAT SOC B MET, V54, P41