Joint estimation and variable selection for mean and dispersion in proper dispersion models

被引:9
作者
Antoniadis, Anestis [1 ,2 ]
Gijbels, Irene [3 ,4 ]
Lambert-Lacroix, Sophie [5 ]
Poggi, Jean-Michel [6 ,7 ]
机构
[1] Univ Grenoble, Lab Jean Kuntzmann, F-38041 Grenoble, France
[2] Univ Cape Town, Dept Stat Sci, ZA-7700 Rondebosch, South Africa
[3] Katholieke Univ Leuven, Dept Math, Celestijnenlaan 200B,Box 2400, B-3001 Heverlee, Belgium
[4] Katholieke Univ Leuven, Leuven Stat Res Ctr LStat, Celestijnenlaan 200B,Box 2400, B-3001 Heverlee, Belgium
[5] Univ Grenoble, UMR 5525, Lab TIMC IMAG, F-38041 Grenoble, France
[6] Univ Paris Saclay, Univ Paris Sud, CNRS, Lab Math Orsay, F-91405 Orsay, France
[7] Univ Paris 05, Paris, France
来源
ELECTRONIC JOURNAL OF STATISTICS | 2016年 / 10卷 / 01期
关键词
Bregman divergence; Fisher-orthogonality; penalization; proper dispersion models; variable selection; SCAD; GENERALIZED LINEAR-MODELS; NONCONCAVE PENALIZED LIKELIHOOD; PARAMETER ORTHOGONALITY; BREGMAN DIVERGENCE; MARGINAL MODELS; REGRESSION; HETEROSCEDASTICITY; ALGORITHM; ROBUST;
D O I
10.1214/16-EJS1152
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
When describing adequately complex data structures one is often confronted with the fact that mean as well as variance (or more generally dispersion) is highly influenced by some covariates. Drawbacks of the available methods is that they are often based on approximations and hence a theoretical study should deal with also studying these approximations. This however is often ignored, making the statistical inference incomplete. In the proposed framework of double generalized modelling based on proper dispersion models we avoid this drawback and as such are in a good position to use recent results on Bregman divergence for establishing theoretical results for the proposed estimators in fairly general settings. We also study variable selection when there is a large number of covariates, with this number possibly tending to infinity with the sample size. The proposed estimation and selection procedure is investigated via a simulation study, that includes also a comparative study with competitors. The use of the methods is illustrated via some real data applications.
引用
收藏
页码:1630 / 1676
页数:47
相关论文
共 84 条
  • [1] [Anonymous], 1990, STATISTICS-ABINGDON, DOI DOI 10.1080/02331889008802259
  • [2] Penalized estimation in additive varying coefficient models using grouped regularization
    Antoniadis, A.
    Gijbels, I.
    Lambert-Lacroix, S.
    [J]. STATISTICAL PAPERS, 2014, 55 (03) : 727 - 750
  • [3] Regularization of wavelet approximations - Rejoinder
    Antoniadis, A
    Fan, J
    [J]. JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2001, 96 (455) : 964 - 967
  • [4] Antoniadis A., 2010, TEST, V19, P209
  • [5] Variable Selection in Additive Models Using P-Splines
    Antoniadis, Anestis
    Gijbels, Irene
    Verhasselt, Anneleen
    [J]. TECHNOMETRICS, 2012, 54 (04) : 425 - 438
  • [6] Penalized likelihood regression for generalized linear models with non-quadratic penalties
    Antoniadis, Anestis
    Gijbels, Irene
    Nikolova, Mila
    [J]. ANNALS OF THE INSTITUTE OF STATISTICAL MATHEMATICS, 2011, 63 (03) : 585 - 615
  • [7] Antoniadis A, 2010, TEST-SPAIN, V19, P257, DOI 10.1007/s11749-010-0198-y
  • [8] Wavelet methods in statistics: Some recent developments and their applications
    Antoniadis, Anestis
    [J]. STATISTICS SURVEYS, 2007, 1 : 16 - 55
  • [9] Longitudinal data estimating equations for dispersion models
    Artes, R
    Jorgensen, B
    [J]. SCANDINAVIAN JOURNAL OF STATISTICS, 2000, 27 (02) : 321 - 334
  • [10] Banerjee A, 2005, J MACH LEARN RES, V6, P1705