A convex formulation for high-dimensional sparse sliced inverse regression

被引:19
|
作者
Tan, Kean Ming [1 ]
Wang, Zhaoran [2 ]
Zhang, Tong [3 ]
Liu, Han [3 ]
Cook, R. Dennis [1 ]
机构
[1] Univ Minnesota, Sch Stat, 313 Ford Hall,224 Church St SE, Minneapolis, MN 55455 USA
[2] Northwestern Univ, Ind Engn & Management Sci, 2145 Sheridan Rd, Evanston, IL 60208 USA
[3] Tencent Technol, Tencent AI Lab, Netac Bldg,High Tech 6th South Rd, Shenzhen, Peoples R China
基金
美国国家科学基金会;
关键词
Convex optimization; Dimension reduction; Nonparametric regression; Principal fitted component; ALTERNATING DIRECTION METHOD; STRUCTURAL DIMENSION; REDUCTION; ASYMPTOTICS; MULTIPLIERS;
D O I
10.1093/biomet/asy049
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Sliced inverse regression is a popular tool for sufficient dimension reduction, which replaces covariates with a minimal set of their linear combinations without loss of information on the conditional distribution of the response given the covariates. The estimated linear combinations include all covariates, making results difficult to interpret and perhaps unnecessarily variable, particularly when the number of covariates is large. In this paper, we propose a convex formulation for fitting sparse sliced inverse regression in high dimensions. Our proposal estimates the subspace of the linear combinations of the covariates directly and performs variable selection simultaneously. We solve the resulting convex optimization problem via the linearized alternating direction methods of multiplier algorithm, and establish an upper bound on the subspace distance between the estimated and the true subspaces. Through numerical studies, we show that our proposal is able to identify the correct covariates in the high-dimensional setting.
引用
收藏
页码:769 / 782
页数:14
相关论文
共 50 条
  • [31] A CONVEX OPTIMIZATION APPROACH TO HIGH-DIMENSIONAL SPARSE QUADRATIC DISCRIMINANT ANALYSIS
    Cai, T. Tony
    Zhang, Linjun
    ANNALS OF STATISTICS, 2021, 49 (03): : 1537 - 1568
  • [32] ON THE OPTIMALITY OF SLICED INVERSE REGRESSION IN HIGH DIMENSIONS
    Lin, Qian
    Li, Xinran
    Huang, Dongming
    Liu, Jun S.
    ANNALS OF STATISTICS, 2021, 49 (01): : 1 - 20
  • [33] Inverse Matrix Problem in Regression for High-Dimensional Data Sets
    Shakeel, Namra
    Mehmood, Tahir
    Mathematical Problems in Engineering, 2023, 2023
  • [34] High-dimensional local linear regression under sparsity and convex losses
    Cheung, Kin Yap
    Lee, Stephen M. S.
    ELECTRONIC JOURNAL OF STATISTICS, 2024, 18 (01): : 803 - 847
  • [35] High-dimensional regression and classification under a class of convex loss functions
    Jiang, Yuan
    Zhang, Chunming
    STATISTICS AND ITS INTERFACE, 2013, 6 (02) : 285 - U143
  • [36] Asymptotic properties of bridge estimators in sparse high-dimensional regression models
    Huang, Jian
    Horowitz, Joel L.
    Ma, Shuangge
    ANNALS OF STATISTICS, 2008, 36 (02): : 587 - 613
  • [37] Variable selection in high-dimensional sparse multiresponse linear regression models
    Luo, Shan
    STATISTICAL PAPERS, 2020, 61 (03) : 1245 - 1267
  • [38] NEARLY OPTIMAL MINIMAX ESTIMATOR FOR HIGH-DIMENSIONAL SPARSE LINEAR REGRESSION
    Zhang, Li
    ANNALS OF STATISTICS, 2013, 41 (04): : 2149 - 2175
  • [39] High-dimensional sparse vine copula regression with application to genomic prediction
    Sahin, Oezge
    Czado, Claudia
    BIOMETRICS, 2024, 80 (01)
  • [40] Robust and sparse estimation methods for high-dimensional linear and logistic regression
    Kurnaz, Fatma Sevinc
    Hoffmann, Irene
    Filzmoser, Peter
    CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS, 2018, 172 : 211 - 222