Linear and conic programming estimators in high dimensional errors-in-variables models

被引:35
作者
Belloni, Alexandre [1 ]
Rosenbaum, Mathieu [2 ,3 ]
Tsybakov, Alexandre B. [3 ]
机构
[1] Duke Univ, Durham, NC 27706 USA
[2] Univ Paris 06, Paris, France
[3] Ctr Rech Econ & Stat, Paris, France
关键词
Conic programming; Dantzig selector; Linear regression model; Matrix uncertainty selector; Prediction sensitivity; LASSO;
D O I
10.1111/rssb.12196
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
We consider the linear regression model with observation error in the design. In this setting, we allow the number of covariates to be much larger than the sample size. Several new estimation methods have been recently introduced for this model. Indeed, the standard lasso estimator or Dantzig selector turns out to become unreliable when only noisy regressors are available, which is quite common in practice. In this work, we propose and analyse a new estimator for the errors-in-variables model. Under suitable sparsity assumptions, we show that this estimator attains the minimax efficiency bound. Importantly, this estimator can be written as a second-order cone programming minimization problem which can be solved numerically in polynomial time. Finally, we show that the procedure introduced by Rosenbaum and Tsybakov, which is almost optimal in a minimax sense, can be efficiently computed by a single linear programming problem despite non-convexities.
引用
收藏
页码:939 / 956
页数:18
相关论文
共 20 条
  • [1] [Anonymous], 1973, Inference and: Relationsship
  • [2] [Anonymous], 2012, COMPRESSED SENSING T
  • [3] [Anonymous], 2011, ARXIV11052454
  • [4] PIVOTAL ESTIMATION VIA SQUARE-ROOT LASSO IN NONPARAMETRIC REGRESSION
    Belloni, Alexandre
    Chernozhukov, Victor
    Wang, Lie
    [J]. ANNALS OF STATISTICS, 2014, 42 (02) : 757 - 788
  • [5] SIMULTANEOUS ANALYSIS OF LASSO AND DANTZIG SELECTOR
    Bickel, Peter J.
    Ritov, Ya'acov
    Tsybakov, Alexandre B.
    [J]. ANNALS OF STATISTICS, 2009, 37 (04) : 1705 - 1732
  • [6] Casella G., 2021, Statistical inference
  • [7] Chen Y., 2012, ARXIV12060823
  • [8] Chen Yuxin, 2013, International Conference on Machine Learning, P160
  • [9] Cheng CL., 1999, STAT REGRESSION MEAS
  • [10] GAUSSIAN APPROXIMATIONS AND MULTIPLIER BOOTSTRAP FOR MAXIMA OF SUMS OF HIGH-DIMENSIONAL RANDOM VECTORS
    Chernozhukov, Victor
    Chetverikov, Denis
    Kato, Kengo
    [J]. ANNALS OF STATISTICS, 2013, 41 (06) : 2786 - 2819