Automatic structure recovery for additive models

被引:19
作者
Wu, Yichao [1 ]
Stefanski, Leonard A. [1 ]
机构
[1] N Carolina State Univ, Dept Stat, Raleigh, NC 27519 USA
基金
美国国家科学基金会; 美国国家卫生研究院;
关键词
Backfitting; Bandwidth estimation; Kernel; Local polynomial; Measurement-error model selection likelihood; Model selection; Profiling; Smoothing; Variable selection; VARIABLE SELECTION; ADAPTIVE LASSO; LIKELIHOOD;
D O I
10.1093/biomet/asu070
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
We propose an automatic structure recovery method for additive models, based on a backfitting algorithm coupled with local polynomial smoothing, in conjunction with a new kernel-based variable selection strategy. Our method produces estimates of the set of noise predictors, the sets of predictors that contribute polynomially at different degrees up to a specified degree M, and the set of predictors that contribute beyond polynomially of degree M. We prove consistency of the proposed method, and describe an extension to partially linear models. Finite-sample performance of the method is illustrated via Monte Carlo studies and a real-data example.
引用
收藏
页码:381 / 395
页数:15
相关论文
共 30 条
[1]  
[Anonymous], 1996, Local polynomial modelling and its applications
[2]  
Cheng M.-Y., 2009, J CHIN STAT ASS, V47, P19
[3]   NONPARAMETRIC INDEPENDENCE SCREENING AND STRUCTURE IDENTIFICATION FOR ULTRA-HIGH DIMENSIONAL LONGITUDINAL DATA [J].
Cheng, Ming-Yen ;
Honda, Toshio ;
Li, Jialiang ;
Peng, Heng .
ANNALS OF STATISTICS, 2014, 42 (05) :1819-1849
[4]   An iterative thresholding algorithm for linear inverse problems with a sparsity constraint [J].
Daubechies, I ;
Defrise, M ;
De Mol, C .
COMMUNICATIONS ON PURE AND APPLIED MATHEMATICS, 2004, 57 (11) :1413-1457
[5]   SEMIPARAMETRIC ESTIMATES OF THE RELATION BETWEEN WEATHER AND ELECTRICITY SALES [J].
ENGLE, RF ;
GRANGER, CWJ ;
RICE, J ;
WEISS, A .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1986, 81 (394) :310-320
[6]   Nonparametric Independence Screening in Sparse Ultra-High-Dimensional Varying Coefficient Models [J].
Fan, Jianqing ;
Ma, Yunbei ;
Dai, Wei .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2014, 109 (507) :1270-1284
[7]   Nonparametric Independence Screening in Sparse Ultra-High-Dimensional Additive Models [J].
Fan, Jianqing ;
Feng, Yang ;
Song, Rui .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2011, 106 (494) :544-557
[8]  
Fan JQ, 2010, STAT SINICA, V20, P101
[9]   Nonparametric inferences for additive models [J].
Fan, JQ ;
Jiang, JC .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2005, 100 (471) :890-907
[10]   Variable selection via nonconcave penalized likelihood and its oracle properties [J].
Fan, JQ ;
Li, RZ .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2001, 96 (456) :1348-1360