Estimation for High-Dimensional Linear Mixed-Effects Models Using l1-Penalization

被引:115
作者
Schelldorfer, Juerg [1 ]
Buehlmann, Peter [1 ]
Van De Geer, Sara [1 ]
机构
[1] ETH, Dept Math, CH-8092 Zurich, Switzerland
基金
瑞士国家科学基金会;
关键词
adaptive Lasso; coordinate gradient descent; coordinatewise optimization; Lasso; random-effects model; variable selection; variance components; VARIABLE SELECTION; COORDINATE DESCENT; REGRESSION-MODELS; DANTZIG SELECTOR; ADAPTIVE LASSO; SPARSITY;
D O I
10.1111/j.1467-9469.2011.00740.x
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
We propose an l(1)-penalized estimation procedure for high-dimensional linear mixed-effects models. The models are useful whenever there is a grouping structure among high-dimensional observations, that is, for clustered data. We prove a consistency and an oracle optimality result and we develop an algorithm with provable numerical convergence. Furthermore, we demonstrate the performance of the method on simulated and a real high-dimensional data set.
引用
收藏
页码:197 / 214
页数:18
相关论文
共 33 条
[1]  
Bates D., 2009, Mixed-Effects Models in S and S-PLUS
[2]   SIMULTANEOUS ANALYSIS OF LASSO AND DANTZIG SELECTOR [J].
Bickel, Peter J. ;
Ritov, Ya'acov ;
Tsybakov, Alexandre B. .
ANNALS OF STATISTICS, 2009, 37 (04) :1705-1732
[3]   Joint Variable Selection for Fixed and Random Effects in Linear Mixed-Effects Models [J].
Bondell, Howard D. ;
Krishna, Arun ;
Ghosh, Sujit K. .
BIOMETRICS, 2010, 66 (04) :1069-1077
[4]  
Bühlmann P, 2011, SPRINGER SER STAT, P1, DOI 10.1007/978-3-642-20192-9
[5]   Sparsity oracle inequalities for the Lasso [J].
Bunea, Florentina ;
Tsybakov, Alexandre ;
Wegkamp, Marten .
ELECTRONIC JOURNAL OF STATISTICS, 2007, 1 :169-194
[6]  
Candes E, 2007, ANN STAT, V35, P2313, DOI 10.1214/009053606000001523
[7]  
Demidenko E., 2004, MIXED MODELS THEORY
[8]   Least angle regression - Rejoinder [J].
Efron, B ;
Hastie, T ;
Johnstone, I ;
Tibshirani, R .
ANNALS OF STATISTICS, 2004, 32 (02) :494-499
[9]   Regularization Paths for Generalized Linear Models via Coordinate Descent [J].
Friedman, Jerome ;
Hastie, Trevor ;
Tibshirani, Rob .
JOURNAL OF STATISTICAL SOFTWARE, 2010, 33 (01) :1-22
[10]   Persistence in high-dimensional linear predictor selection and the virtue of overparametrization [J].
Greenshtein, E ;
Ritov, Y .
BERNOULLI, 2004, 10 (06) :971-988