For most large underdetermined systems of linear equations the minimal l1-norm solution is also the sparsest solution

被引:1753
作者
Donoho, DL [1 ]
机构
[1] Stanford Univ, Dept Stat, Stanford, CA 94305 USA
关键词
D O I
10.1002/cpa.20132
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
We consider linear equations y = phi x where y is a given vector in R-n and phi is a given n x m matrix with n < m <= tau n, and we wish to solve for x epsilon R-m. We suppose that the columns of phi are normalized to the unit l(2)-norm, and we place uniform measure on such phi. We prove the existence of rho = rho(tau) > 0 so that for large n and for all Vs except a negligible fraction, the following property holds: For every y having a representation y = phi x(0) by a coefficient vector x(0) epsilon R-m. with fewer than rho center dot n nonzeros, the solution x(1) of the l(1)-minimization problem min parallel to x parallel to(1) subject to phi x = y is unique and equal to x(0). In contrast, heuristic attempts to sparsely solve such systems-greedy algorithms and thresholding-perform poorly ill this challenging setting. The techniques include the use of random proportional embeddings and almost-spherical sections in Banach space theory, and deviation bounds for the eigenvalues of random Wishart matrices. (c) 2006 Wiley Periodicals, Inc.
引用
收藏
页码:797 / 829
页数:33
相关论文
共 30 条
  • [1] [Anonymous], LECT NOTES MATH
  • [2] [Anonymous], 1983, EXTREMES RELATED PRO
  • [3] Projection algorithms for solving convex feasibility problems
    Bauschke, HH
    Borwein, JM
    [J]. SIAM REVIEW, 1996, 38 (03) : 367 - 426
  • [4] CANDES EJ, IN PRESS IEEE T INFO
  • [5] Chen Y, 1998, NONCON OPTIM ITS APP, V20, P1
  • [6] COIFMAN PR, 1993, PROGR WAVELET ANAL A, P77
  • [7] ENTROPY-BASED ALGORITHMS FOR BEST BASIS SELECTION
    COIFMAN, RR
    WICKERHAUSER, MV
    [J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 1992, 38 (02) : 713 - 718
  • [8] Davidson KR, 2001, HANDBOOK OF THE GEOMETRY OF BANACH SPACES, VOL 1, P317, DOI 10.1016/S1874-5849(01)80010-3
  • [9] Stable recovery of sparse overcomplete representations in the presence of noise
    Donoho, DL
    Elad, M
    Temlyakov, VN
    [J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 2006, 52 (01) : 6 - 18
  • [10] DONOHO DL, 1992, J ROY STAT SOC B MET, V54, P41