Shrinkage inverse regression estimation for model-free variable selection

被引:41
作者
Bondell, Howard D. [1 ]
Li, Lexin [1 ]
机构
[1] N Carolina State Univ, Dept Stat, Raleigh, NC 27695 USA
关键词
Inverse regression estimation; Non-negative garrotte; Sliced inverse regression; Sufficient dimension reduction; Variable selection; DIMENSION REDUCTION; CENTRAL SUBSPACE;
D O I
10.1111/j.1467-9868.2008.00686.x
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
The family of inverse regression estimators that was recently proposed by Cook and Ni has proven effective in dimension reduction by transforming the high dimensional predictor vector to its low dimensional projections. We propose a general shrinkage estimation strategy for the entire inverse regression estimation family that is capable of simultaneous dimension reduction and variable selection. We demonstrate that the new estimators achieve consistency in variable selection without requiring any traditional model, meanwhile retaining the root n estimation consistency of the dimension reduction basis. We also show the effectiveness of the new estimators through both simulation and real data analysis.
引用
收藏
页码:287 / 299
页数:13
相关论文
共 18 条
[1]   BETTER SUBSET REGRESSION USING THE NONNEGATIVE GARROTE [J].
BREIMAN, L .
TECHNOMETRICS, 1995, 37 (04) :373-384
[2]  
Chen CH, 1998, STAT SINICA, V8, P289
[3]  
COOK RD, 1991, J AM STAT ASSOC, V86, P328, DOI 10.2307/2290564
[4]   Graphics for regressions with a binary response [J].
Cook, RD .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1996, 91 (435) :983-992
[5]   Using intraslice covariances for improved estimation of the central subspace in regression [J].
Cook, RD ;
Ni, LQ .
BIOMETRIKA, 2006, 93 (01) :65-74
[6]   Sufficient dimension reduction via inverse regression: A minimum discrepancy approach [J].
Cook, RD ;
Ni, LQ .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2005, 100 (470) :410-428
[7]   Testing predictor contributions in sufficient dimension reduction [J].
Cook, RD .
ANNALS OF STATISTICS, 2004, 32 (03) :1062-1092
[8]   Relations between two sets of variates [J].
Hotelling, H .
BIOMETRIKA, 1936, 28 :321-377
[10]   Sliced inverse regression with regularizations [J].
Li, Lexin ;
Yin, Xiangrong .
BIOMETRICS, 2008, 64 (01) :124-131