A convex formulation for high-dimensional sparse sliced inverse regression

被引:19
|
作者
Tan, Kean Ming [1 ]
Wang, Zhaoran [2 ]
Zhang, Tong [3 ]
Liu, Han [3 ]
Cook, R. Dennis [1 ]
机构
[1] Univ Minnesota, Sch Stat, 313 Ford Hall,224 Church St SE, Minneapolis, MN 55455 USA
[2] Northwestern Univ, Ind Engn & Management Sci, 2145 Sheridan Rd, Evanston, IL 60208 USA
[3] Tencent Technol, Tencent AI Lab, Netac Bldg,High Tech 6th South Rd, Shenzhen, Peoples R China
基金
美国国家科学基金会;
关键词
Convex optimization; Dimension reduction; Nonparametric regression; Principal fitted component; ALTERNATING DIRECTION METHOD; STRUCTURAL DIMENSION; REDUCTION; ASYMPTOTICS; MULTIPLIERS;
D O I
10.1093/biomet/asy049
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Sliced inverse regression is a popular tool for sufficient dimension reduction, which replaces covariates with a minimal set of their linear combinations without loss of information on the conditional distribution of the response given the covariates. The estimated linear combinations include all covariates, making results difficult to interpret and perhaps unnecessarily variable, particularly when the number of covariates is large. In this paper, we propose a convex formulation for fitting sparse sliced inverse regression in high dimensions. Our proposal estimates the subspace of the linear combinations of the covariates directly and performs variable selection simultaneously. We solve the resulting convex optimization problem via the linearized alternating direction methods of multiplier algorithm, and establish an upper bound on the subspace distance between the estimated and the true subspaces. Through numerical studies, we show that our proposal is able to identify the correct covariates in the high-dimensional setting.
引用
收藏
页码:769 / 782
页数:14
相关论文
共 50 条
  • [21] Testing Regression Coefficients in High-Dimensional and Sparse Settings
    Kai XU
    Yan TIAN
    Qing CHENG
    Acta Mathematica Sinica,English Series, 2021, (10) : 1513 - 1532
  • [22] ADAPTIVE LASSO FOR SPARSE HIGH-DIMENSIONAL REGRESSION MODELS
    Huang, Jian
    Ma, Shuangge
    Zhang, Cun-Hui
    STATISTICA SINICA, 2008, 18 (04) : 1603 - 1618
  • [23] Testing Regression Coefficients in High-Dimensional and Sparse Settings
    Kai Xu
    Yan Tian
    Qing Cheng
    Acta Mathematica Sinica, English Series, 2021, 37 : 1513 - 1532
  • [24] HYPOTHESIS TESTING FOR HIGH-DIMENSIONAL SPARSE BINARY REGRESSION
    Mukherjee, Rajarshi
    Pillai, Natesh S.
    Lin, Xihong
    ANNALS OF STATISTICS, 2015, 43 (01): : 352 - 381
  • [25] SPReM: Sparse Projection Regression Model For High-Dimensional Linear Regression
    Sun, Qiang
    Zhu, Hongtu
    Liu, Yufeng
    Ibrahim, Joseph G.
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2015, 110 (509) : 289 - 302
  • [26] SPARSE SLICED INVERSE REGRESSION VIA CHOLESKY MATRIX PENALIZATION
    Nghiem, Linh H.
    Hui, Francis K. C.
    Muller, Samuel
    Welsh, A. H.
    STATISTICA SINICA, 2022, 32 : 2431 - 2453
  • [27] Variational Bayes for High-Dimensional Linear Regression With Sparse Priors
    Ray, Kolyan
    Szabo, Botond
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2022, 117 (539) : 1270 - 1281
  • [28] Weaker Regularity Conditions and Sparse Recovery in High-Dimensional Regression
    Wang, Shiqing
    Shi, Yan
    Su, Limin
    JOURNAL OF APPLIED MATHEMATICS, 2014,
  • [29] Empirical Priors for Prediction in Sparse High-dimensional Linear Regression
    Martin, Ryan
    Tang, Yiqi
    JOURNAL OF MACHINE LEARNING RESEARCH, 2020, 21
  • [30] Empirical priors for prediction in sparse high-dimensional linear regression
    Martin, Ryan
    Tang, Yiqi
    Journal of Machine Learning Research, 2020, 21