One-Bit Compressed Sensing via One-Shot Hard Thresholding

被引:0
作者
Shen, Jie [1 ]
机构
[1] Stevens Inst Technol, Hoboken, NJ 07030 USA
来源
CONFERENCE ON UNCERTAINTY IN ARTIFICIAL INTELLIGENCE (UAI 2020) | 2020年 / 124卷
关键词
VARIABLE SELECTION; REGRESSION; RECOVERY;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper concerns the problem of 1-bit compressed sensing, where the goal is to estimate a sparse signal from a few of its binary measurements. We study a non-convex sparsity-constrained program and present a novel and concise analysis that moves away from the widely used notion of Gaussian width. We show that with high probability a simple algorithm is guaranteed to produce an accurate approximation to the normalized signal of interest under the l(2)-metric. On top of that, we establish an ensemble of new results that address norm estimation, support recovery, and model misspecification. On the computational side, it is shown that the non-convex program can be solved via one-step hard thresholding which is dramatically efficient in terms of time complexity and memory footprint. On the statistical side, it is shown that our estimator enjoys a near-optimal error rate under standard conditions. The theoretical results are further substantiated by numerical experiments.
引用
收藏
页码:510 / 519
页数:10
相关论文
共 46 条
  • [1] Acharya J, 2017, IEEE INT SYMP INFO, P2353, DOI 10.1109/ISIT.2017.8006950
  • [2] One-bit compressed sensing with non-Gaussian measurements
    Ai, Albert
    Lapanowski, Alex
    Plan, Yaniv
    Vershynin, Roman
    [J]. LINEAR ALGEBRA AND ITS APPLICATIONS, 2014, 441 : 222 - 239
  • [3] [Anonymous], 2016, ADV NEURAL INF PROCE
  • [4] On the Fundamental Limits of Adaptive Sensing
    Arias-Castro, Ery
    Candes, Emmanuel J.
    Davenport, Mark A.
    [J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 2013, 59 (01) : 472 - 481
  • [5] The Power of Localization for Efficiently Learning Linear Separators with Noise
    Awasthi, Pranjal
    Balcan, Maria Florina
    Long, Philip M.
    [J]. JOURNAL OF THE ACM, 2017, 63 (06)
  • [6] Exponential Decay of Reconstruction Error From Binary Measurements of Sparse Signals
    Baraniuk, Richard G.
    Foucart, Simon
    Needell, Deanna
    Plan, Yaniv
    Wootters, Mary
    [J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 2017, 63 (06) : 3368 - 3385
  • [7] Bhaskar SA, 2016, J MACH LEARN RES, V17
  • [8] Iterative hard thresholding for compressed sensing
    Blumensath, Thomas
    Davies, Mike E.
    [J]. APPLIED AND COMPUTATIONAL HARMONIC ANALYSIS, 2009, 27 (03) : 265 - 274
  • [9] 1-bit compressive sensing
    Boufounos, Petros T.
    Baraniuk, Richard G.
    [J]. 2008 42ND ANNUAL CONFERENCE ON INFORMATION SCIENCES AND SYSTEMS, VOLS 1-3, 2008, : 16 - 21
  • [10] A Constrained l1 Minimization Approach to Sparse Precision Matrix Estimation
    Cai, Tony
    Liu, Weidong
    Luo, Xi
    [J]. JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2011, 106 (494) : 594 - 607