LASSO-type penalization in the framework of generalized additive models for location, scale and shape

被引:21
|
作者
Groll, Andreas [1 ]
Hambuckers, Julien [2 ,3 ]
Kneib, Thomas [2 ]
Umlauf, Nikolaus [4 ]
机构
[1] Tech Univ Dortmund, Fac Stat, D-44221 Dortmund, Germany
[2] Univ Gottingen, Chairs Stat, Humboldtallee 3, D-37073 Gottingen, Germany
[3] Univ Liege, HEC Management Sch, Dept Finance, Rue Louvrex 14, B-4000 Liege, Belgium
[4] Univ Innsbruck, Fac Econ & Stat, Dept Stat, Univ Str 15, A-6020 Innsbruck, Austria
关键词
GAMLSS; Distributional regression; Model selection; LASSO; Fused LASSO; VARIABLE SELECTION; OPERATIONAL RISK; REGRESSION; DETERMINANTS;
D O I
10.1016/j.csda.2019.06.005
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
For numerous applications, it is of interest to provide full probabilistic forecasts, which are able to assign plausibilities to each predicted outcome. Therefore, attention is shifting constantly from conditional mean models to probabilistic distributional models capturing location, scale, shape and other aspects of the response distribution. One of the most established models for distributional regression is the generalized additive model for location, scale and shape (GAMLSS). In high-dimensional data set-ups, classical fitting procedures for GAMLSS often become rather unstable and methods for variable selection are desirable. Therefore, a regularization approach for high-dimensional data set-ups in the framework of GAMLSS is proposed. It is designed for linear covariate effects and is based on L-1-type penalties. The following three penalization options are provided: the conventional least absolute shrinkage and selection operator (LASSO) for metric covariates, and both group and fused LASSO for categorical predictors. The methods are investigated both for simulated data and for two real data examples, namely Munich rent data and data on extreme operational losses from the Italian bank UniCredit. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页码:59 / 73
页数:15
相关论文
共 27 条
  • [1] Robust gradient boosting for generalized additive models for location, scale and shape
    Speller, Jan
    Staerk, Christian
    Gude, Francisco
    Mayr, Andreas
    ADVANCES IN DATA ANALYSIS AND CLASSIFICATION, 2023,
  • [2] Implicit differentiation of Lasso-type models for hyperparameter optimization
    Bertrand, Quentin
    Klopfenstein, Quentin
    Blondel, Mathieu
    Vaiter, Samuel
    Gramfort, Alexandre
    Salmon, Joseph
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 119, 2020, 119
  • [3] BAMLSS: Bayesian Additive Models for Location, Scale, and Shape (and Beyond)
    Umlauf, Nikolaus
    Klein, Nadja
    Zeileis, Achim
    JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2018, 27 (03) : 612 - 627
  • [4] Gradient boosting in Markov-switching generalized additive models for location, scale, and shape
    Adam, Timo
    Mayr, Andreas
    Kneib, Thomas
    ECONOMETRICS AND STATISTICS, 2022, 22 : 3 - 16
  • [5] Bootstrapping LASSO-type estimators in regression models
    Giurcanu, Mihai
    Presnell, Brett
    JOURNAL OF STATISTICAL PLANNING AND INFERENCE, 2019, 199 : 114 - 125
  • [6] Generalized additive models for location, scale and shape for high dimensional dataua flexible approach based on boosting
    Mayr, Andreas
    Fenske, Nora
    Hofner, Benjamin
    Kneib, Thomas
    Schmid, Matthias
    JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES C-APPLIED STATISTICS, 2012, 61 : 403 - 427
  • [7] Bivariate copula additive models for location, scale and shape
    Marra, Giampiero
    Radice, Rosalba
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2017, 112 : 99 - 113
  • [8] LASSO-type estimators for semiparametric nonlinear mixed-effects models estimation
    Arribas-Gil, Ana
    Bertin, Karine
    Meza, Cristian
    Rivoirard, Vincent
    STATISTICS AND COMPUTING, 2014, 24 (03) : 443 - 460
  • [9] A scaling model for severity of operational losses using generalized additive models for location scale and shape (GAMLSS)
    Ganegoda, Amandha
    Evans, John
    ANNALS OF ACTUARIAL SCIENCE, 2013, 7 (01) : 61 - 100
  • [10] LASSO-type estimators for semiparametric nonlinear mixed-effects models estimation
    Ana Arribas-Gil
    Karine Bertin
    Cristian Meza
    Vincent Rivoirard
    Statistics and Computing, 2014, 24 : 443 - 460