Instance-optimality in probability with an l1-minimization decoder

被引:40
作者
DeVore, Ronald [1 ]
Petrova, Guergana [1 ]
Wojtaszczyk, Przemyslaw [2 ]
机构
[1] Texas A&M Univ, Dept Math, College Stn, TX 77843 USA
[2] Univ Warsaw, Inst Appl Math, PL-00325 Warsaw, Poland
基金
美国国家科学基金会;
关键词
Compressed sensing; Instance-optimality in probability; l(1)-minimization decoder; RESTRICTED ISOMETRY PROPERTY; RANDOM MATRICES;
D O I
10.1016/j.acha.2009.05.001
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
Let Phi(omega), omega is an element of Omega, be a family of n x N random matrices whose entries Phi(i,j) are independent realizations of a symmetric, real random variable eta with expectation E eta = 0 and variance E eta(2) = 1/n. Such matrices are used in compressed sensing to encode a vector x is an element of R-N by y = Phi x. The information y holds about x is extracted by using a decoder Delta : R-n -> R-N. The most prominent decoder is the l(1)-minimization decoder Delta which gives for a given y is an element of R-n the element Delta(y) is an element of R-N which has minimal l(1)nrm among all Z is an element of R-N with Phi z = y. This paper is interested in properties of the random family Phi(omega) which guarantee that the vector (x) over bar := Delta(Phi x) will with high probability approximate x in l(2)(N) to an accuracy comparable with the best k-term error of approximation in l(2)(N) for the range k <= an/log(2)(N/n). This means that for the above range of k, for each signal x is an element of R-N, the vector (x) over bar:= Delta(Phi x) satisfies parallel to x - (x) over bar parallel to(l2n) <= C inf(z is an element of Sigma k) parallel to x - z parallel to(l2N) with high probability on the draw of Phi. Here, Sigma(k) consists of all vectors with at most k nonzero coordinates. The first result of this type was proved by Wojtaszczyk [R Wojtaszczyk, Stability and instance optimality for Gaussian measurements in compressed sensing, Found. Comput. Math.. in press] who showed this property when eta is a normalized Gaussian random variable. We extend this property to more general random variables, including the particular case where eta is the Bernoulli random variable which takes the values +/- 1/root n with equal probability. The proofs of our results use geometric mapping properties of such random matrices some of which were recently obtained in [A. Litvak, A. Pajor, M. Rudelson, N. Tomczak-Jaegermann, Smallest singular value of random matrices and geometry of random polytopes, Adv. Math. 195 (2005) 491-523]. (C) 2009 Elsevier Inc. All rights reserved.
引用
收藏
页码:275 / 288
页数:14
相关论文
共 19 条
[1]  
ACHILIOPTAS D, 2001, P ACM S PRINC DAT SY, P274
[2]   A Simple Proof of the Restricted Isometry Property for Random Matrices [J].
Baraniuk, Richard ;
Davenport, Mark ;
DeVore, Ronald ;
Wakin, Michael .
CONSTRUCTIVE APPROXIMATION, 2008, 28 (03) :253-263
[3]   Robust uncertainty principles:: Exact signal reconstruction from highly incomplete frequency information [J].
Candès, EJ ;
Romberg, J ;
Tao, T .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2006, 52 (02) :489-509
[4]   Decoding by linear programming [J].
Candes, EJ ;
Tao, T .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2005, 51 (12) :4203-4215
[5]   The restricted isometry property and its implications for compressed sensing [J].
Candes, Emmanuel J. .
COMPTES RENDUS MATHEMATIQUE, 2008, 346 (9-10) :589-592
[6]   Stable signal recovery from incomplete and inaccurate measurements [J].
Candes, Emmanuel J. ;
Romberg, Justin K. ;
Tao, Terence .
COMMUNICATIONS ON PURE AND APPLIED MATHEMATICS, 2006, 59 (08) :1207-1223
[7]  
Cohen A, 2009, J AM MATH SOC, V22, P211
[8]   Deterministic constructions of compressed sensing matrices [J].
DeVore, Ronald A. .
JOURNAL OF COMPLEXITY, 2007, 23 (4-6) :918-925
[9]  
DONCHO D, 2006, IEEE T INFORM THEORY, V52, P1289
[10]  
GARNAEV AI, 1984, DOKL AKAD NAUK SSSR+, V277, P1048