Penalized principal logistic regression for sparse sufficient dimension reduction

被引:15
作者
Shin, Seung Jun [1 ]
Artemiou, Andreas
机构
[1] Korea Univ, Seoul, South Korea
基金
新加坡国家研究基金会;
关键词
Max-SCAD penalty; Principal logistic regression; Sparse sufficient dimension reduction; Sufficient dimension reduction; VARIABLE SELECTION; INVERSE REGRESSION; ALGORITHMS; LIKELIHOOD; MODEL;
D O I
10.1016/j.csda.2016.12.003
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Sufficient dimension reduction (SDR) is a successive tool for reducing the dimensionality of predictors by finding the central subspace, a minimal subspace of predictors that preserves all the regression information. When predictor dimension is large, it is often assumed that only a small number of predictors is informative. In this regard, sparse SDR is desired to achieve variable selection and dimension reduction simultaneously. We propose a principal logistic regression (PLR) as a new SDR tool and further develop its penalized version for sparse SDR. Asymptotic analysis shows that the penalized PLR enjoys the oracle property. Numerical investigation supports the advantageous performance of the proposed methods. (C) 2016 Elsevier B.V. All rights reserved.
引用
收藏
页码:48 / 58
页数:11
相关论文
共 27 条
[1]  
An LTH, 1997, J GLOBAL OPTIM, V11, P253
[2]  
[Anonymous], 1989, GEN LINEAR MODELS
[3]  
[Anonymous], 2000, Cambridge Series on Statistical and Probablistic Mathematics
[4]   Shrinkage inverse regression estimation for model-free variable selection [J].
Bondell, Howard D. ;
Li, Lexin .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 2009, 71 :287-299
[5]   COORDINATE DESCENT ALGORITHMS FOR NONCONVEX PENALIZED REGRESSION, WITH APPLICATIONS TO BIOLOGICAL FEATURE SELECTION [J].
Breheny, Patrick ;
Huang, Jian .
ANNALS OF APPLIED STATISTICS, 2011, 5 (01) :232-253
[6]   Sparse partial least squares regression for simultaneous dimension reduction and variable selection [J].
Chun, Hyonho ;
Keles, Suenduez .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 2010, 72 :3-25
[7]  
COOK RD, 1991, J AM STAT ASSOC, V86, P328, DOI 10.2307/2290564
[8]   Graphics for regressions with a binary response [J].
Cook, RD .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1996, 91 (435) :983-992
[9]   Using intraslice covariances for improved estimation of the central subspace in regression [J].
Cook, RD ;
Ni, LQ .
BIOMETRIKA, 2006, 93 (01) :65-74
[10]   Testing predictor contributions in sufficient dimension reduction [J].
Cook, RD .
ANNALS OF STATISTICS, 2004, 32 (03) :1062-1092