Variable Selection in Additive Models Using P-Splines

被引:22
|
作者
Antoniadis, Anestis [1 ]
Gijbels, Irene [2 ,3 ]
Verhasselt, Anneleen [4 ]
机构
[1] Univ Grenoble 1, Lab Jean Kuntzmann, Grenoble, France
[2] Katholieke Univ Leuven, Dept Math, Louvain, Belgium
[3] Katholieke Univ Leuven, Leuven Stat Res Ctr LStat, Louvain, Belgium
[4] Univ Antwerp, Dept Math & Comp Sci, B-2020 Antwerp, Belgium
关键词
Additive modeling; Nonnegative garrote; Nonparametric smoothing; Penalized spline regression; Selection of variables; PENALIZED LIKELIHOOD; REGULARIZATION; REGRESSION; FLOW;
D O I
10.1080/00401706.2012.726000
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
This article extends the nonnegative garrote method to a component selection method in a nonparametric additive model in which each univariate function is estimated with P-splines. We also establish the consistency of the procedure. An advantage of P-splines is that the fitted function is represented in a rather small basis of B-splines. A numerical study illustrates the finite-sample performance of the method and includes a comparison with other methods. The nonnegative garrote method with P-splines has the advantage of being computationally fast and performs, with an appropriate parameter selection procedure implemented, overall very well. Real data analysis leads to interesting findings. Supplementary materials for this article (technical proofs, additional numerical results, R code) are available online.
引用
收藏
页码:425 / 438
页数:14
相关论文
共 50 条
  • [1] Variable selection using P-splines
    Gijbels, Irene
    Verhasselt, Anneleen
    Vrinssen, Inge
    WILEY INTERDISCIPLINARY REVIEWS-COMPUTATIONAL STATISTICS, 2015, 7 (01): : 1 - 20
  • [2] Variable Selection in Varying-Coefficient Models Using P-Splines
    Antoniadis, Anestis
    Gijbels, Irene
    Verhasselt, Anneleen
    JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2012, 21 (03) : 638 - 661
  • [3] Boosting additive models using component-wise P-Splines
    Schmid, Matthias
    Hothorn, Torsten
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2008, 53 (02) : 298 - 311
  • [4] Semiparametric Latent Variable Models With Bayesian P-Splines
    Song, Xin-Yuan
    Lu, Zhao-Hua
    JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2010, 19 (03) : 590 - 608
  • [5] Bayesian Estimation of Partially Linear Additive Spatial Autoregressive Models with P-Splines
    Chen, Zhiyong
    Chen, Minghui
    Xing, Guodong
    Mathematical Problems in Engineering, 2021, 2021
  • [6] Bayesian Estimation of Partially Linear Additive Spatial Autoregressive Models with P-Splines
    Chen, Zhiyong
    Chen, Minghui
    Xing, Guodong
    MATHEMATICAL PROBLEMS IN ENGINEERING, 2021, 2021
  • [7] Nonparametric inference in hidden Markov models using P-splines
    Langrock, Roland
    Kneib, Thomas
    Sohn, Alexander
    DeRuiter, Stacy L.
    BIOMETRICS, 2015, 71 (02) : 520 - 528
  • [8] Regularisation and P-splines in generalised linear models
    Gijbels, Irene
    Verhasselt, Anneleen
    JOURNAL OF NONPARAMETRIC STATISTICS, 2010, 22 (03) : 271 - 295
  • [9] Estimation by polynomial splines with variable selection in additive Cox models
    Zhang, Shangli
    Wang, Lichun
    Lian, Heng
    STATISTICS, 2014, 48 (01) : 67 - 80
  • [10] P-SPLINES USING DERIVATIVE INFORMATION
    Calderon, Christopher P.
    Martinez, Josue G.
    Carroll, Raymond J.
    Sorensen, Danny C.
    MULTISCALE MODELING & SIMULATION, 2010, 8 (04): : 1562 - 1580