EXACT POST-SELECTION INFERENCE, WITH APPLICATION TO THE LASSO

被引:446
作者
Lee, Jason D. [1 ]
Sun, Dennis L. [2 ]
Sun, Yuekai [3 ]
Taylor, Jonathan E. [4 ]
机构
[1] Univ Calif Berkeley, 465 Soda Hall, Berkeley, CA 94720 USA
[2] Calif Polytech State Univ San Luis Obispo, Bldg 25,Room 107D, San Luis Obispo, CA USA
[3] Univ Calif Berkeley, 367 Evans Hall, Berkeley, CA 94720 USA
[4] Stanford Univ, 390 Serra Mall, Stanford, CA USA
基金
美国国家科学基金会;
关键词
Lasso; confidence interval; hypothesis test; model selection; FALSE DISCOVERY RATE; THE-LOSERS DESIGN; CONFIDENCE-INTERVALS; MODEL-SELECTION; PARAMETERS; ESTIMATORS;
D O I
10.1214/15-AOS1371
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
We develop a general approach to valid inference after model selection. At the core of our framework is a result that characterizes. the distribution of a post-selection estimator conditioned on the selection event. We specialize the approach to model selection by the lasso to form valid confidence intervals for the selected coefficients and test whether all relevant variables have been included in the model.
引用
收藏
页码:907 / 927
页数:21
相关论文
共 32 条
[1]  
[Anonymous], 2014, PREPRINT
[2]   False discovery rate-adjusted multiple confidence intervals for selected parameters [J].
Benjamini, Y ;
Yekutieli, D .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2005, 100 (469) :71-81
[3]   Selective inference in complex research [J].
Benjamini, Yoav ;
Heller, Ruth ;
Yekutieli, Daniel .
PHILOSOPHICAL TRANSACTIONS OF THE ROYAL SOCIETY A-MATHEMATICAL PHYSICAL AND ENGINEERING SCIENCES, 2009, 367 (1906) :4255-4271
[4]   VALID POST-SELECTION INFERENCE [J].
Berk, Richard ;
Brown, Lawrence ;
Buja, Andreas ;
Zhang, Kai ;
Zhao, Linda .
ANNALS OF STATISTICS, 2013, 41 (02) :802-837
[5]  
COX DR, 1975, BIOMETRIKA, V62, P441, DOI 10.2307/2335385
[6]   Least angle regression - Rejoinder [J].
Efron, B ;
Hastie, T ;
Johnstone, I ;
Tibshirani, R .
ANNALS OF STATISTICS, 2004, 32 (02) :494-499
[7]  
FISHER R, 1956, J ROY STAT SOC B, V18, P56
[8]  
Javanmard A., 2013, PREPRINT
[9]  
Knight K, 2000, ANN STAT, V28, P1356
[10]   Model selection and inference:: Facts and fiction [J].
Leeb, H ;
Pötscher, BM .
ECONOMETRIC THEORY, 2005, 21 (01) :21-59