Bridge estimation for generalized linear models with a diverging number of parameters

被引:21
作者
Wang, Mingqiu [1 ]
Song, Lixin [1 ]
Wang, Xiaoguang [1 ]
机构
[1] Dalian Univ Technol, Sch Math Sci, Dalian 116023, Peoples R China
关键词
Generalized linear models; Variable selection; Bridge estimator; Oracle; Bayesian information criterion (BIC); NONCONCAVE PENALIZED LIKELIHOOD; VARIABLE SELECTION; ORACLE PROPERTIES; REGRESSION; LASSO;
D O I
10.1016/j.spl.2010.06.012
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Variable selection is fundamental to high dimensional generalized linear models. A number of variable selection approaches have been proposed in the literature. This paper considers the problem of variable selection and estimation in generalized linear models via a bridge penalty in the situation where the number of parameters diverges with the sample size. Under reasonable conditions the consistency of the bridge estimator can be achieved. Furthermore, it can select the nonzero coefficients with a probability converging to 1 and the estimators of nonzero coefficients have the asymptotic normality, namely the oracle property. Our simulations indicate that the bridge penalty is an effective consistent model selection technique and is comparable to the smoothly clipped absolute deviation procedure. A real example analysis is presented. (C) 2010 Elsevier B.V. All rights reserved.
引用
收藏
页码:1584 / 1596
页数:13
相关论文
共 16 条
[1]  
[Anonymous], TECHNOMETRICS
[2]  
Candes E, 2007, ANN STAT, V35, P2313, DOI 10.1214/009053606000001523
[3]  
Fan J. Q., 2009, NONCONCAVE PENALIZED
[4]  
Fan JQ, 2010, STAT SINICA, V20, P101
[5]   Nonconcave penalized likelihood with a diverging number of parameters [J].
Fan, JQ ;
Peng, H .
ANNALS OF STATISTICS, 2004, 32 (03) :928-961
[6]   Variable selection via nonconcave penalized likelihood and its oracle properties [J].
Fan, JQ ;
Li, RZ .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2001, 96 (456) :1348-1360
[7]   A STATISTICAL VIEW OF SOME CHEMOMETRICS REGRESSION TOOLS [J].
FRANK, IE ;
FRIEDMAN, JH .
TECHNOMETRICS, 1993, 35 (02) :109-135
[8]   Asymptotic properties of bridge estimators in sparse high-dimensional regression models [J].
Huang, Jian ;
Horowitz, Joel L. ;
Ma, Shuangge .
ANNALS OF STATISTICS, 2008, 36 (02) :587-613
[9]  
Knight K, 2000, ANN STAT, V28, P1356
[10]   A UNIFIED APPROACH TO MODEL SELECTION AND SPARSE RECOVERY USING REGULARIZED LEAST SQUARES [J].
Lv, Jinchi ;
Fan, Yingying .
ANNALS OF STATISTICS, 2009, 37 (6A) :3498-3528