Semiparametric regression models with additive nonparametric components and high dimensional parametric components

被引:23
作者
Du, Pang [1 ]
Cheng, Guang [2 ]
Liang, Hua [3 ]
机构
[1] Virginia Tech, Dept Stat, Blacksburg, VA 24061 USA
[2] Purdue Univ, Dept Stat, W Lafayette, IN 47907 USA
[3] Univ Rochester, Dept Biostat & Computat Biol, Rochester, NY 14642 USA
基金
美国国家科学基金会;
关键词
Additive models; Backfitting; Model selection; Partial smoothing splines; SCAD; Sparsity; NONCONCAVE PENALIZED LIKELIHOOD; VARIABLE SELECTION;
D O I
10.1016/j.csda.2011.12.007
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
This paper concerns semiparametric regression models with additive nonparametric components and high dimensional parametric components under sparsity assumptions. To achieve simultaneous model selection for both nonparametric and parametric parts, we introduce a penalty that combines the adaptive empirical L-2-norms of the nonparametric component functions and the SCAD penalty on the coefficients in the parametric part. We use the additive partial smoothing spline estimate as the initial estimate and establish its convergence rate with diverging dimensions of parametric components. Our simulation studies reveal excellent model selection performance of the proposed method. An application to an economic study on Canadian household gasoline consumption reveals interesting results. Published by Elsevier B.V.
引用
收藏
页码:2006 / 2017
页数:12
相关论文
共 36 条
[1]  
[Anonymous], 2006, Journal of the Royal Statistical Society, Series B
[2]  
Birman M. S., 1967, Sbornik: Mathematics, V2, P295, DOI 10.1070/SM1967v002n03ABEH002343
[3]  
Candes E, 2007, ANN STAT, V35, P2313, DOI 10.1214/009053606000001523
[4]  
Cheng G., 2011, SCAND J STAT
[5]  
Cheng G., 2011, MANY ITERATION UNPUB
[6]   Least angle regression - Rejoinder [J].
Efron, B ;
Hastie, T ;
Johnstone, I ;
Tibshirani, R .
ANNALS OF STATISTICS, 2004, 32 (02) :494-499
[7]   Sure independence screening for ultrahigh dimensional feature space [J].
Fan, Jianqing ;
Lv, Jinchi .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 2008, 70 :849-883
[8]   Nonparametric Independence Screening in Sparse Ultra-High-Dimensional Additive Models [J].
Fan, Jianqing ;
Feng, Yang ;
Song, Rui .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2011, 106 (494) :544-557
[9]   Variable selection via nonconcave penalized likelihood and its oracle properties [J].
Fan, JQ ;
Li, RZ .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2001, 96 (456) :1348-1360
[10]  
Gu C., 2002, SPR S STAT