Variable selection in a class of single-index models

被引:19
作者
Zhu, Li-Ping [1 ]
Qian, Lin-Yi [1 ]
Lin, Jin-Guan [2 ]
机构
[1] E China Normal Univ, Sch Finance & Stat, Shanghai 200062, Peoples R China
[2] Southeast Univ, Dept Math, Nanjing, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
Adaptive lasso; Dimension reduction; Oracle; Sliced inverse regression; Sparsity; NONCONCAVE PENALIZED LIKELIHOOD; INVERSE REGRESSION; DIMENSION REDUCTION; ASYMPTOTICS; LASSO;
D O I
10.1007/s10463-010-0287-4
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
In this paper we discuss variable selection in a class of single-index models in which we do not assume the error term as additive. Following the idea of sufficient dimension reduction, we first propose a unified method to recover the direction, then reformulate it under the least square framework. Differing from many other existing results associated with nonparametric smoothing methods for density function, the bandwidth selection in our proposed kernel function essentially has no impact on its root-n consistency or asymptotic normality. To select the important predictors, we suggest using the adaptive lasso method which is computationally efficient. Under some regularity conditions, the adaptive lasso method enjoys the oracle property in a general class of single-index models. In addition, the resulting estimation is shown to be asymptotically normal, which enables us to construct a confidence region for the estimated direction. The asymptotic results are augmented through comprehensive simulations, and illustrated by an analysis of air pollution data.
引用
收藏
页码:1277 / 1293
页数:17
相关论文
共 35 条
[1]  
ALTHAM PME, 1984, J ROY STAT SOC B MET, V46, P118
[2]   Generalized partially linear single-index models [J].
Carroll, RJ ;
Fan, JQ ;
Gijbels, I ;
Wand, MP .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1997, 92 (438) :477-489
[3]  
Chen CH, 1998, STAT SINICA, V8, P289
[4]  
Cook R.D., 1998, WILEY PROB STAT
[5]  
COOK RD, 1991, J AM STAT ASSOC, V86, P328, DOI 10.2307/2290564
[6]   Sufficient dimension reduction via inverse regression: A minimum discrepancy approach [J].
Cook, RD ;
Ni, LQ .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2005, 100 (470) :410-428
[7]   Testing predictor contributions in sufficient dimension reduction [J].
Cook, RD .
ANNALS OF STATISTICS, 2004, 32 (03) :1062-1092
[8]   IDEAL SPATIAL ADAPTATION BY WAVELET SHRINKAGE [J].
DONOHO, DL ;
JOHNSTONE, IM .
BIOMETRIKA, 1994, 81 (03) :425-455
[9]   Least angle regression - Rejoinder [J].
Efron, B ;
Hastie, T ;
Johnstone, I ;
Tibshirani, R .
ANNALS OF STATISTICS, 2004, 32 (02) :494-499
[10]   Nonconcave penalized likelihood with a diverging number of parameters [J].
Fan, JQ ;
Peng, H .
ANNALS OF STATISTICS, 2004, 32 (03) :928-961