Variable selection for ultra-high-dimensional logistic models

被引:0
作者
Du, Pang [1 ]
Wu, Pan [2 ]
Liang, Hua [3 ]
机构
[1] Virginia Polytech Inst & State Univ, Dept Stat, Blacksburg, VA 24061 USA
[2] Univ Rochester, Dept Biostat & Computat Biol, Rochester, NY 14642 USA
[3] George Washington Univ, Dept Stat, Washington, DC 20052 USA
来源
PERSPECTIVES ON BIG DATA ANALYSIS: METHODOLOGIES AND APPLICATIONS | 2014年 / 622卷
关键词
Concave convex procedure; coordinate ascent; coordinate descent; LASSO; local linear approximation; local quadratic approximation; oracle property; penalized variable selection; SCAD; GENERALIZED LINEAR-MODELS; NONCONCAVE PENALIZED LIKELIHOOD; DIVERGING NUMBER; ADAPTIVE LASSO; REGULARIZATION; CONSISTENCY;
D O I
10.1090/conm/622/12436
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
We propose a variable selection procedure through the optimization of a nonconcave penalized likelihood for logistic regression models with the dimension of covariates p diverging in an exponential rate of n. We first establish the oracle property of the procedure under such ultra-high-dimensional setting. Our optimization algorithm combines some recent developments, including the concave convex procedure and the coordinate descent algorithm, in solving regularization problems. Through extensive simulations, we show the promise of the proposed procedure in various high-dimensional logistic regression settings. An application to gene expression data from a breast cancer study illustrates the use of the method.
引用
收藏
页码:141 / 158
页数:18
相关论文
共 37 条
[1]  
An LTH, 1997, J GLOBAL OPTIM, V11, P253
[2]  
[Anonymous], 2008, 392 U IOW DEP STAT A
[3]  
[Anonymous], 1983, Monographs on Statistics and Applied Probability
[4]  
Bertsekas D. P, 1999, Nonlinear Programming, V2nd
[5]   REGULARIZATION FOR COX'S PROPORTIONAL HAZARDS MODEL WITH NP-DIMENSIONALITY [J].
Bradic, Jelena ;
Fan, Jianqing ;
Jiang, Jiancheng .
ANNALS OF STATISTICS, 2011, 39 (06) :3092-3120
[6]  
Breiman L, 1996, ANN STAT, V24, P2350
[7]  
Chen KN, 1999, ANN STAT, V27, P1155
[8]  
Fan J., 2006, P INT C MATH
[9]   Sure independence screening for ultrahigh dimensional feature space [J].
Fan, Jianqing ;
Lv, Jinchi .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 2008, 70 :849-883
[10]   SURE INDEPENDENCE SCREENING IN GENERALIZED LINEAR MODELS WITH NP-DIMENSIONALITY [J].
Fan, Jianqing ;
Song, Rui .
ANNALS OF STATISTICS, 2010, 38 (06) :3567-3604