Penalized least squares for single index models

被引:81
作者
Peng, Heng [1 ]
Huang, Tao [2 ]
机构
[1] Hong Kong Baptist Univ, Dept Math, Kowloon Tong, Hong Kong, Peoples R China
[2] Univ Virginia, Dept Stat, Charlottesville, VA 22904 USA
基金
美国国家科学基金会;
关键词
Local polynomial regression; Nonconcave penalized least squares; SCAD penalty; Single index model; Variable selection; VARIABLE SELECTION; SEMIPARAMETRIC ESTIMATION; ORACLE PROPERTIES; REGRESSION; LIKELIHOOD; COEFFICIENTS; LASSO;
D O I
10.1016/j.jspi.2010.10.003
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
The single index model is a useful regression model. In this paper, we propose a nonconcave penalized least squares method to estimate both the parameters and the link function of the single index model. Compared to other variable selection and estimation methods, the proposed method can estimate parameters and select variables simultaneously. When the dimension of parameters in the single index model is a fixed constant, under some regularity conditions, we demonstrate that the proposed estimators for parameters have the so-called oracle property, and furthermore we establish the asymptotic normality and develop a sandwich formula to estimate the standard deviations of the proposed estimators. Simulation studies and a real data analysis are presented to illustrate the proposed methods. (C) 2010 Elsevier B.V. All rights reserved.
引用
收藏
页码:1362 / 1379
页数:18
相关论文
共 32 条
[1]  
[Anonymous], 1996, Local polynomial modelling and its applications
[2]   Model selection with data-oriented penalty [J].
Bai, ZD ;
Rao, CR ;
Wu, Y .
JOURNAL OF STATISTICAL PLANNING AND INFERENCE, 1999, 77 (01) :103-117
[3]   Generalized partially linear single-index models [J].
Carroll, RJ ;
Fan, JQ ;
Gijbels, I ;
Wand, MP .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1997, 92 (438) :477-489
[4]  
COOK DR, 1991, J AM STAT ASSOC, V86, P328
[5]   SLICING REGRESSION - A LINK-FREE REGRESSION METHOD [J].
DUAN, N ;
LI, KC .
ANNALS OF STATISTICS, 1991, 19 (02) :505-530
[6]  
Fan J., 2003, NONLINEAR TIME SERIE
[7]  
Fan J., 1997, J. Italian Stat. Soc, V6, P131, DOI [10.1007/BF03178906, DOI 10.1007/BF03178906]
[8]   Nonconcave penalized likelihood with a diverging number of parameters [J].
Fan, JQ ;
Peng, H .
ANNALS OF STATISTICS, 2004, 32 (03) :928-961
[9]  
Fan JQ, 2002, ANN STAT, V30, P74
[10]   Variable selection via nonconcave penalized likelihood and its oracle properties [J].
Fan, JQ ;
Li, RZ .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2001, 96 (456) :1348-1360