Sparse estimation in high-dimensional linear errors-in-variables regression via a covariate relaxation method

被引:0
|
作者
Li, Xin [1 ]
Wu, Dongya [2 ]
机构
[1] Northwest Univ, Sch Math, Xuefu Rd, Xian 710069, Shaanxi, Peoples R China
[2] Northwest Univ, Sch Informat Sci & Technol, Xuefu Rd, Xian 710069, Shaanxi, Peoples R China
基金
中国国家自然科学基金;
关键词
Sparse recovery; Errors-in-variables model; Covariate relaxation; Statistical consistency; MINIMAX RATES; SELECTION;
D O I
10.1007/s11222-023-10312-5
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Sparse signal recovery in high-dimensional settings via regularization techniques has been developed in the past two decades and produces fruitful results in various areas. Previous studies mainly focus on the idealized assumption where covariates are free of noise. However, in realistic scenarios, covariates are always corrupted by measurement errors, which may induce significant estimation bias when methods for clean data are naively applied. Recent studies begin to deal with the errors-in-variables models. Current method either depends on the distribution of covariate noise or does not depends on the distribution but is inconsistent in parameter estimation. A novel covariate relaxation method that does not depend on the distribution of covariate noise is proposed. Statistical consistency on parameter estimation is established. Numerical experiments are conducted and show that the covariate relaxation method achieves the same or even better estimation accuracy than that of the state of art nonconvex Lasso estimator. The advantage that the covariate relaxation method is independent of the distribution of covariate noise while produces a small estimation error suggests its prospect in practical applications.
引用
收藏
页数:11
相关论文
共 50 条
  • [21] ACCURACY ASSESSMENT FOR HIGH-DIMENSIONAL LINEAR REGRESSION
    Cai, T. Tony
    Guo, Zijian
    ANNALS OF STATISTICS, 2018, 46 (04) : 1807 - 1836
  • [22] Square-Root LASSO for High-Dimensional Sparse Linear Systems with Weakly Dependent Errors
    Xie, Fang
    Xiao, Zhijie
    JOURNAL OF TIME SERIES ANALYSIS, 2018, 39 (02) : 212 - 238
  • [23] Correcting for unknown errors in sparse high-dimensional function approximation
    Adcock, Ben
    Bao, Anyi
    Brugiapaglia, Simone
    NUMERISCHE MATHEMATIK, 2019, 142 (03) : 667 - 711
  • [24] Sparse Estimation Strategies in Linear Mixed Effect Models for High-Dimensional Data Application
    Opoku, Eugene A.
    Ahmed, Syed Ejaz
    Nathoo, Farouk S.
    ENTROPY, 2021, 23 (10)
  • [25] Empirical Likelihood Inference of the Partial Linear Isotonic Errors-in-variables Regression Models with Missing Data
    Sun, Zhimeng
    COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 2016, 45 (02) : 671 - 688
  • [26] IDENTIFICATION OF ERRORS-IN-VARIABLES MODEL VIA BIAS-COMPENSATED INSTRUMENTAL VARIABLES TYPE METHOD
    Ikenoue, Masato
    Kanae, Shunshoku
    Yang, Zi-Jiang
    Wada, Kiyoshi
    INTERNATIONAL JOURNAL OF INNOVATIVE COMPUTING INFORMATION AND CONTROL, 2009, 5 (01): : 29 - 40
  • [27] Sparse and debiased lasso estimation and inference for high-dimensional composite quantile regression with distributed data
    Hou, Zhaohan
    Ma, Wei
    Wang, Lei
    TEST, 2023, 32 (04) : 1230 - 1250
  • [28] High-dimensional linear models with many endogenous variables
    Belloni, Alexandre
    Hansen, Christian
    Newey, Whitney
    JOURNAL OF ECONOMETRICS, 2022, 228 (01) : 4 - 26
  • [29] Minimax Rates of Estimation for High-Dimensional Linear Regression Over lq-Balls
    Raskutti, Garvesh
    Wainwright, Martin J.
    Yu, Bin
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2011, 57 (10) : 6976 - 6994
  • [30] Inference in High-Dimensional Multivariate Response Regression with Hidden Variables
    Bing, Xin
    Cheng, Wei
    Feng, Huijie
    Ning, Yang
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2024, 119 (547) : 2066 - 2077