A convex formulation for high-dimensional sparse sliced inverse regression

被引:19
|
作者
Tan, Kean Ming [1 ]
Wang, Zhaoran [2 ]
Zhang, Tong [3 ]
Liu, Han [3 ]
Cook, R. Dennis [1 ]
机构
[1] Univ Minnesota, Sch Stat, 313 Ford Hall,224 Church St SE, Minneapolis, MN 55455 USA
[2] Northwestern Univ, Ind Engn & Management Sci, 2145 Sheridan Rd, Evanston, IL 60208 USA
[3] Tencent Technol, Tencent AI Lab, Netac Bldg,High Tech 6th South Rd, Shenzhen, Peoples R China
基金
美国国家科学基金会;
关键词
Convex optimization; Dimension reduction; Nonparametric regression; Principal fitted component; ALTERNATING DIRECTION METHOD; STRUCTURAL DIMENSION; REDUCTION; ASYMPTOTICS; MULTIPLIERS;
D O I
10.1093/biomet/asy049
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Sliced inverse regression is a popular tool for sufficient dimension reduction, which replaces covariates with a minimal set of their linear combinations without loss of information on the conditional distribution of the response given the covariates. The estimated linear combinations include all covariates, making results difficult to interpret and perhaps unnecessarily variable, particularly when the number of covariates is large. In this paper, we propose a convex formulation for fitting sparse sliced inverse regression in high dimensions. Our proposal estimates the subspace of the linear combinations of the covariates directly and performs variable selection simultaneously. We solve the resulting convex optimization problem via the linearized alternating direction methods of multiplier algorithm, and establish an upper bound on the subspace distance between the estimated and the true subspaces. Through numerical studies, we show that our proposal is able to identify the correct covariates in the high-dimensional setting.
引用
收藏
页码:769 / 782
页数:14
相关论文
共 50 条
  • [1] Online sparse sliced inverse regression for high-dimensional streaming data
    Xu, Jianjun
    Cui, Wenquan
    Cheng, Haoyang
    INTERNATIONAL JOURNAL OF WAVELETS MULTIRESOLUTION AND INFORMATION PROCESSING, 2023, 21 (02)
  • [2] On sliced inverse regression with high-dimensional covariates
    Zhu, LX
    Miao, BQ
    Peng, H
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2006, 101 (474) : 630 - 643
  • [3] Federated Sufficient Dimension Reduction Through High-Dimensional Sparse Sliced Inverse Regression
    Cui, Wenquan
    Zhao, Yue
    Xu, Jianjun
    Cheng, Haoyang
    COMMUNICATIONS IN MATHEMATICS AND STATISTICS, 2023,
  • [4] Sliced inverse regression for high-dimensional time series
    Becker, C
    Fried, R
    EXPLORATORY DATA ANALYSIS IN EMPIRICAL RESEARCH, PROCEEDINGS, 2003, : 3 - 11
  • [5] Sparse sliced inverse regression for high dimensional data analysis
    Haileab Hilafu
    Sandra E. Safo
    BMC Bioinformatics, 23
  • [6] Sparse sliced inverse regression for high dimensional data analysis
    Hilafu, Haileab
    Safo, Sandra E.
    BMC BIOINFORMATICS, 2022, 23 (01)
  • [7] Sparse sliced inverse regression
    Li, Lexin
    Nachtsheim, Christopher J.
    TECHNOMETRICS, 2006, 48 (04) : 503 - 510
  • [8] Active learning with generalized sliced inverse regression for high-dimensional reliability analysis
    Yin, Jianhua
    Du, Xiaoping
    STRUCTURAL SAFETY, 2022, 94
  • [9] High-Dimensional Elliptical Sliced Inverse Regression in Non-Gaussian Distributions
    Chen, Xin
    Zhang, Jia
    Zhou, Wang
    JOURNAL OF BUSINESS & ECONOMIC STATISTICS, 2022, 40 (03) : 1204 - 1215
  • [10] Sparse High-Dimensional Isotonic Regression
    Gamarnik, David
    Gaudio, Julia
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32