A UNIFIED VARIABLE SELECTION APPROACH FOR VARYING COEFFICIENT MODELS

被引:63
作者
Tang, Yanlin [1 ]
Wang, Huixia Judy [2 ]
Zhu, Zhongyi [1 ]
Song, Xinyuan [3 ]
机构
[1] Fudan Univ, Dept Stat, Shanghai 200433, Peoples R China
[2] N Carolina State Univ, Dept Stat, Raleigh, NC 27695 USA
[3] Chinese Univ Hong Kong, Dept Stat, Shatin, Hong Kong, Peoples R China
基金
美国国家科学基金会;
关键词
Adaptive LASSO; B-spline; least squares regression; quantile regression; separation of varying and constant effects; PARTIALLY LINEAR-MODELS; NONPARAMETRIC REGRESSION; EFFICIENT ESTIMATION; QUANTILE REGRESSION; ORACLE PROPERTIES; LONGITUDINAL DATA; INFERENCES; LIKELIHOOD; SHRINKAGE; LASSO;
D O I
10.5705/ss.2010.121
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
In varying coefficient models, three types of variable selection problems are of practical interests: separation of varying and constant effects, selection of variables with nonzero varying effects, and selection of variables with nonzero constant effects. Existing variable selection methods in the literature often focus on only one of the three types. In this paper, we develop a unified variable selection approach for both least squares regression and quantile regression models with possibly varying coefficients. The developed method is carried out by using a two-step iterative procedure based on basis expansion and a double adaptive-LASSO-type penalty. Under some regularity conditions, we show that the proposed procedure is consistent in both variable selection and the separation of varying and constant coefficients. In addition, the estimated varying coefficients possess the optimal convergence rate under the same smoothness assumption, and the estimated constant coefficients have the same asymptotic distribution as their counterparts obtained when the true model is known. Finally, we investigate the finite sample performance of the proposed method through a simulation study and the analysis of the Childhood Malnutrition Data in India.
引用
收藏
页码:601 / 628
页数:28
相关论文
共 30 条
[1]  
[Anonymous], 2006, Journal of the Royal Statistical Society, Series B
[2]   Efficient estimation and inferences for varying-coefficient models [J].
Cai, ZW ;
Fan, JQ ;
Li, RZ .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2000, 95 (451) :888-902
[3]  
Chen H., 1991, Journal of Nonparametric Statistics, V1, P143, DOI DOI 10.1080/10485259108832516
[4]   Profile likelihood inferences on semiparametric varying-coefficient partially linear models [J].
Fan, JQ ;
Huang, T .
BERNOULLI, 2005, 11 (06) :1031-1057
[5]   Variable selection via nonconcave penalized likelihood and its oracle properties [J].
Fan, JQ ;
Li, RZ .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2001, 96 (456) :1348-1360
[6]  
Fenske N., 2009, 052 U MUN DEP STAT
[7]  
HASTIE T, 1993, J ROY STAT SOC B MET, V55, P757
[8]  
He X., 1994, J NONPARAMETR STAT, V3, P299, DOI DOI 10.1080/10485259408832589
[9]  
Hu T., 2010, ADAPTIVE SEMIV UNPUB
[10]  
Huang JHZ, 2004, STAT SINICA, V14, P763