Variable Selection in Additive Models Using P-Splines

被引:22
作者
Antoniadis, Anestis [1 ]
Gijbels, Irene [2 ,3 ]
Verhasselt, Anneleen [4 ]
机构
[1] Univ Grenoble 1, Lab Jean Kuntzmann, Grenoble, France
[2] Katholieke Univ Leuven, Dept Math, Louvain, Belgium
[3] Katholieke Univ Leuven, Leuven Stat Res Ctr LStat, Louvain, Belgium
[4] Univ Antwerp, Dept Math & Comp Sci, B-2020 Antwerp, Belgium
关键词
Additive modeling; Nonnegative garrote; Nonparametric smoothing; Penalized spline regression; Selection of variables; PENALIZED LIKELIHOOD; REGULARIZATION; REGRESSION; FLOW;
D O I
10.1080/00401706.2012.726000
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
This article extends the nonnegative garrote method to a component selection method in a nonparametric additive model in which each univariate function is estimated with P-splines. We also establish the consistency of the procedure. An advantage of P-splines is that the fitted function is represented in a rather small basis of B-splines. A numerical study illustrates the finite-sample performance of the method and includes a comparison with other methods. The nonnegative garrote method with P-splines has the advantage of being computationally fast and performs, with an appropriate parameter selection procedure implemented, overall very well. Real data analysis leads to interesting findings. Supplementary materials for this article (technical proofs, additional numerical results, R code) are available online.
引用
收藏
页码:425 / 438
页数:14
相关论文
共 27 条
[1]  
[Anonymous], 2003, Semiparametric Regression
[2]   Penalized likelihood regression for generalized linear models with non-quadratic penalties [J].
Antoniadis, Anestis ;
Gijbels, Irene ;
Nikolova, Mila .
ANNALS OF THE INSTITUTE OF STATISTICAL MATHEMATICS, 2011, 63 (03) :585-615
[3]   Efficient determination of multiple regularization parameters in a generalized L-curve framework [J].
Belge, M ;
Kilmer, ME ;
Miller, EL .
INVERSE PROBLEMS, 2002, 18 (04) :1161-1183
[4]   BETTER SUBSET REGRESSION USING THE NONNEGATIVE GARROTE [J].
BREIMAN, L .
TECHNOMETRICS, 1995, 37 (04) :373-384
[5]   Variable selection in additive models by non-negative garrote [J].
Cantoni, Eva ;
Flemming, Joanna Mills ;
Ronchetti, Elvezio .
STATISTICAL MODELLING, 2011, 11 (03) :237-252
[6]   Modeling Slump Flow of High-Performance Concrete Using a Back-Propagation Network [J].
Chien, Wen-Huan ;
Chen, Li ;
Wei, Chih-Chiang ;
Hsu, Hsun-Hsin ;
Wang, Tai-Sheng .
INFORMATION TECHNOLOGY FOR MANUFACTURING SYSTEMS, PTS 1 AND 2, 2010, :838-+
[7]   Asymptotic properties of penalized spline estimators [J].
Claeskens, Gerda ;
Krivobokova, Tatyana ;
Opsomer, Jean D. .
BIOMETRIKA, 2009, 96 (03) :529-544
[8]   Flexible smoothing with B-splines and penalties [J].
Eilers, PHC ;
Marx, BD .
STATISTICAL SCIENCE, 1996, 11 (02) :89-102
[9]  
EUBANK RL, 1990, BIOMETRIKA, V77, P1
[10]   Variable selection via nonconcave penalized likelihood and its oracle properties [J].
Fan, JQ ;
Li, RZ .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2001, 96 (456) :1348-1360