PROJECTION-BASED INFERENCE FOR HIGH-DIMENSIONAL LINEAR MODELS

被引:0
|
作者
Yi, Sangyoon [1 ]
Zhang, Xianyang [1 ]
机构
[1] Texas A&M Univ, Dept Stat, College Stn, TX 77843 USA
关键词
Confidence interval; high-dimensional linear models; Lasso; quadratic programming; POST-SELECTION INFERENCE; CONFIDENCE-INTERVALS; REGIONS; RATES; TESTS;
D O I
10.5705/ss.202019.0283
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
We develop a new method to estimate the projection direction in the debiased Lasso estimator. The basic idea is to decompose the overall bias into two terms, corresponding to strong and weak signals, respectively. We propose estimating the projection direction by balancing the squared biases associated with the strong and weak signals and the variance of the projection-based estimator. A standard quadratic programming solver can solve the resulting optimization problem efficiently. We show theoretically that the unknown set of strong signals can be estimated consistently, and that the projection-based estimator enjoys asymptotic normality under suitable assumptions. A slight modification of our procedure leads to an estimator with a potentially smaller order of bias than that of the original debiased Lasso. We further generalize our method to conduct an inference for a sparse linear combination of the regression coefficients. Numerical studies demonstrate the advantage of the proposed approach in terms of coverage accuracy over several existing alternatives.
引用
收藏
页码:915 / 937
页数:23
相关论文
共 50 条
  • [1] Simultaneous Inference for High-Dimensional Linear Models
    Zhang, Xianyang
    Cheng, Guang
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2017, 112 (518) : 757 - 768
  • [2] High-dimensional inference in misspecified linear models
    Buehlmann, Peter
    van de Geer, Sara
    ELECTRONIC JOURNAL OF STATISTICS, 2015, 9 (01): : 1449 - 1473
  • [3] Projection-based and cross-validated estimation in high-dimensional Cox model
    Zhang, Haixiang
    Huang, Jian
    Sun, Liuquan
    SCANDINAVIAN JOURNAL OF STATISTICS, 2022, 49 (01) : 353 - 372
  • [4] High-dimensional robust inference for censored linear models
    Huang, Jiayu
    Wu, Yuanshan
    SCIENCE CHINA-MATHEMATICS, 2024, 67 (04) : 891 - 918
  • [5] Spatially relaxed inference on high-dimensional linear models
    Chevalier, Jerome-Alexis
    Nguyen, Tuan-Binh
    Thirion, Bertrand
    Salmon, Joseph
    STATISTICS AND COMPUTING, 2022, 32 (05)
  • [6] Statistical Inference for High-Dimensional Generalized Linear Models With Binary Outcomes
    Cai, T. Tony
    Guo, Zijian
    Ma, Rong
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2023, 118 (542) : 1319 - 1332
  • [7] A projection-based conditional dependence measure with applications to high-dimensional undirected graphical models
    Fan, Jianqing
    Feng, Yang
    Xia, Lucy
    JOURNAL OF ECONOMETRICS, 2020, 218 (01) : 119 - 139
  • [8] AN ADAPTIVELY RESIZED PARAMETRIC BOOTSTRAP FOR INFERENCE IN HIGH-DIMENSIONAL GENERALIZED LINEAR MODELS
    Zhao, Qian
    Candes, Emmanuel J.
    STATISTICA SINICA, 2025, 35 (01) : 91 - 110
  • [9] Inference for high-dimensional linear models with locally stationary error processes
    Xia, Jiaqi
    Chen, Yu
    Guo, Xiao
    JOURNAL OF TIME SERIES ANALYSIS, 2024, 45 (01) : 78 - 102
  • [10] High-Dimensional Inference for Cluster-Based Graphical Models
    Eisenach, Carson
    Bunea, Florentina
    Ning, Yang
    Dinicu, Claudiu
    JOURNAL OF MACHINE LEARNING RESEARCH, 2020, 21