Oracle Inequalities for a Group Lasso Procedure Applied to Generalized Linear Models in High Dimension

被引:20
作者
Blazere, Melanie [1 ]
Loubes, Jean-Michel [1 ]
Gamboa, Fabrice [1 ]
机构
[1] Univ Toulouse 3, Inst Math Toulouse, F-31400 Toulouse, France
关键词
Generalized linear model; group lasso; oracle inequalities; high dimension; sparse model; groups of variables; SELECTION; REGULARIZATION;
D O I
10.1109/TIT.2014.2303121
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We present a group lasso procedure for generalized linear models (GLMs) and we study the properties of this estimator applied to sparse high-dimensional GLMs. Under general conditions on the covariates and on the joint distribution of the pair covariates, we provide oracle inequalities promoting group sparsity of the covariables. We get convergence rates for the prediction and estimation error and we show the ability of this estimator to recover good sparse approximation of the true model. Then, we extend this procedure to the case of an elastic net penalty. At last, we apply these results to the so-called Poisson regression model (the output is modeled as a Poisson process whose intensity relies on a linear combination of the covariables). The group lasso method enables to select few groups of meaningful variables among the set of inputs.
引用
收藏
页码:2303 / 2318
页数:16
相关论文
共 32 条
  • [1] [Anonymous], 1989, Binary Data. Generalized Linear Models
  • [2] [Anonymous], 2006, Journal of the Royal Statistical Society, Series B
  • [3] [Anonymous], P C LEARN THEOR DEC
  • [5] SIMULTANEOUS ANALYSIS OF LASSO AND DANTZIG SELECTOR
    Bickel, Peter J.
    Ritov, Ya'acov
    Tsybakov, Alexandre B.
    [J]. ANNALS OF STATISTICS, 2009, 37 (04) : 1705 - 1732
  • [6] Exploring the new world of the genome with DNA microarrays
    Brown, PO
    Botstein, D
    [J]. NATURE GENETICS, 1999, 21 (Suppl 1) : 33 - 37
  • [7] Bühlmann P, 2011, SPRINGER SER STAT, P1, DOI 10.1007/978-3-642-20192-9
  • [8] Bunea F., ELECT J STAT, V2
  • [9] Aggregation for gaussian regression
    Bunea, Florentina
    Tsybakov, Alexandre B.
    Wegkamp, Marten H.
    [J]. ANNALS OF STATISTICS, 2007, 35 (04) : 1674 - 1697
  • [10] Expression profiling using cDNA microarrays
    Duggan, DJ
    Bittner, M
    Chen, YD
    Meltzer, P
    Trent, JM
    [J]. NATURE GENETICS, 1999, 21 (Suppl 1) : 10 - 14