Profiled adaptive Elastic-Net procedure for partially linear models with high-dimensional covariates

被引:13
作者
Chen, Baicheng [2 ]
Yu, Yao [1 ]
Zou, Hui [3 ]
Liang, Hua [1 ]
机构
[1] Univ Rochester, Dept Biostat & Computat Biol, Rochester, NY 14642 USA
[2] Shanghai Univ Finance & Econ, Dept Stat, Shanghai, Peoples R China
[3] Univ Minnesota, Dept Stat, Minneapolis, MN 55455 USA
关键词
Adaptive regularization; Elastic-Net; High dimensionality; Model selection; Oracle property; Presmoothing; Semiparametric model; Shrinkage methods; NONCONCAVE PENALIZED LIKELIHOOD; VARIABLE SELECTION; DIVERGING NUMBER; REGRESSION; CONSISTENCY; SHRINKAGE;
D O I
10.1016/j.jspi.2012.02.035
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
We study variable selection for partially linear models when the dimension of covariates diverges with the sample size. We combine the ideas of profiling and adaptive Elastic-Net. The resulting procedure has oracle properties and can handle collinearity well. A by-product is the uniform bound for the absolute difference between the profiled and original predictors. We further examine finite sample performance of the proposed procedure by simulation studies and analysis of a labor-market dataset for an illustration. (C) 2012 Elsevier B.V. All rights reserved.
引用
收藏
页码:1733 / 1745
页数:13
相关论文
共 43 条
[1]  
[Anonymous], 1996, Local polynomial modelling and its applications
[2]  
[Anonymous], 1990, Gener. Addit. Models
[3]  
Bickel P. J., 1993, Efficient and adaptive estimation for semiparametric models
[4]  
DONOHO DL, 1995, J ROY STAT SOC B MET, V57, P301
[5]   SEMIPARAMETRIC ESTIMATES OF THE RELATION BETWEEN WEATHER AND ELECTRICITY SALES [J].
ENGLE, RF ;
GRANGER, CWJ ;
RICE, J ;
WEISS, A .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1986, 81 (394) :310-320
[6]   Profile likelihood inferences on semiparametric varying-coefficient partially linear models [J].
Fan, JQ ;
Huang, T .
BERNOULLI, 2005, 11 (06) :1031-1057
[7]   Nonconcave penalized likelihood with a diverging number of parameters [J].
Fan, JQ ;
Peng, H .
ANNALS OF STATISTICS, 2004, 32 (03) :928-961
[8]  
Fan JQ, 2002, ANN STAT, V30, P74
[9]   Variable selection via nonconcave penalized likelihood and its oracle properties [J].
Fan, JQ ;
Li, RZ .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2001, 96 (456) :1348-1360
[10]  
GSOEP, 1991, VIERTELJAHRESHEFTE W, P146