NEW TESTS FOR HIGH-DIMENSIONAL LINEAR REGRESSION BASED ON RANDOM PROJECTION

被引:0
作者
Liu, Changyu [1 ]
Zhao, Xingqiu [1 ,2 ]
Huang, Jian [1 ]
机构
[1] Hong Kong Polytech Univ, Hong Kong, Peoples R China
[2] Hong Kong Polytech Univ, Dept Appl Math, Hong Kong, Peoples R China
关键词
High-dimensional inference; hypothesis testing; linear model; random projection; relative efficiency; CONFIDENCE-INTERVALS; COEFFICIENTS; REGIONS;
D O I
10.5705/ss.202020.0405
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
We consider the problem of detecting significance in high-dimensional linear models, in which the dimension of the regression coefficient is greater than the sample size. We propose novel test statistics for hypothesis tests of the global significance of the linear model, as well as for the significance of part of the regression coefficients. The new tests are based on randomly projecting the high-dimensional data onto a low-dimensional space, and then working with the classical F-test using the projected data. An appealing feature of the proposed tests is that they have a simple form and are computationally easy to implement. We derive the asymptotic local power functions of the proposed tests and compare them with the existing methods for hypothesis testing in high-dimensional linear models. We also provide a sufficient condition under which our proposed tests have higher asymptotic relative efficiency. Simulation studies evaluate the finite-sample performance of the proposed tests and demonstrate that it outperforms existing tests in the models considered. Lastly, we illustrate the proposed tests by applying them to real high-dimensional gene expression data.
引用
收藏
页码:475 / 498
页数:24
相关论文
共 50 条
  • [1] Tests for high-dimensional partially linear regression models
    Shi, Hongwei
    Yang, Weichao
    Sun, Bowen
    Guo, Xu
    STATISTICAL PAPERS, 2025, 66 (03)
  • [2] A Random Projection Approach to Hypothesis Tests in High-Dimensional Single-Index Models
    Liu, Changyu
    Zhao, Xingqiu
    Huang, Jian
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2024, 119 (546) : 1008 - 1018
  • [3] PROJECTION-BASED INFERENCE FOR HIGH-DIMENSIONAL LINEAR MODELS
    Yi, Sangyoon
    Zhang, Xianyang
    STATISTICA SINICA, 2022, 32 (02) : 915 - 937
  • [4] TWO-SAMPLE TESTS FOR HIGH-DIMENSIONAL LINEAR REGRESSION WITH AN APPLICATION TO DETECTING INTERACTIONS
    Xia, Yin
    Cai, Tianxi
    Cai, T. Tony
    STATISTICA SINICA, 2018, 28 (01) : 63 - 92
  • [5] Honest Confidence Sets for High-Dimensional Regression by Projection and Shrinkage
    Zhou, Kun
    Li, Ker-Chau
    Zhou, Qing
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2023, 118 (541) : 469 - 488
  • [6] Rank-based score tests for high-dimensional regression coefficients
    Feng, Long
    Zou, Changliang
    Wang, Zhaojun
    Chen, Bin
    ELECTRONIC JOURNAL OF STATISTICS, 2013, 7 : 2131 - 2149
  • [7] ACCURACY ASSESSMENT FOR HIGH-DIMENSIONAL LINEAR REGRESSION
    Cai, T. Tony
    Guo, Zijian
    ANNALS OF STATISTICS, 2018, 46 (04) : 1807 - 1836
  • [8] Drawing inferences for high-dimensional linear models: A selection-assisted partial regression and smoothing approach
    Fei, Zhe
    Zhu, Ji
    Banerjee, Moulinath
    Li, Yi
    BIOMETRICS, 2019, 75 (02) : 551 - 561
  • [9] A Note on High-Dimensional Linear Regression With Interactions
    Hao, Ning
    Zhang, Hao Helen
    AMERICAN STATISTICIAN, 2017, 71 (04) : 291 - 297
  • [10] REGULARIZED PROJECTION SCORE ESTIMATION OF TREATMENT EFFECTS IN HIGH-DIMENSIONAL QUANTILE REGRESSION
    Cheng, Chao
    Feng, Xingdong
    Huang, Jian
    Liu, Xu
    STATISTICA SINICA, 2022, 32 (01) : 23 - 41