Can one estimate the conditional distribution of post-model-selection estimators?

被引:131
作者
Leeb, Hannes
Poetscher, Benedikt M.
机构
[1] Yale Univ, Dept Stat, New Haven, CT 06511 USA
[2] Univ Vienna, Dept Stat, A-1010 Vienna, Austria
关键词
inference after model selection; post-model-selection estimator; pre-test estimator; selection of regressors; Akaike's information criterion AIC; thresholding; model uncertainty; consistency; uniform consistency; lower risk bound;
D O I
10.1214/009053606000000821
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
We consider the problem of estimating the conditional distribution of a post-model-selection estimator where the conditioning is on the selected model. The notion of a post-model-selection estimator here refers to the combined procedure resulting from first selecting a model (e.g., by a model selection criterion such as AIC or by a hypothesis testing procedure) and then estimating the parameters in the selected model (e.g., by least-squares or maximum likelihood), all based on the same data set. We show that it is impossible to estimate this distribution with reasonable accuracy even asymptotically. In particular, we show that no estimator for this distribution can be uniformly consistent (not even locally). This follows as a corollary to (local) minimax lower bounds on the performance of estimators for this distribution. Similar impossibility results are also obtained for the conditional distribution of linear functions (e.g., predictors) of the post-model-selection estimator.
引用
收藏
页码:2554 / 2591
页数:38
相关论文
共 23 条
[1]   Least squares, preliminary test and Stein-type estimation in general vector AR(p) models [J].
Ahmed, SE ;
Basu, AK .
STATISTICA NEERLANDICA, 2000, 54 (01) :47-66
[2]  
[Anonymous], 1988, MODEL UNCERTAINTY IT, DOI DOI 10.1007/978-3-642-61564-1_1
[3]  
Bauer P., 1988, STATISTICS-ABINGDON, V19, P39, DOI [10.1080/02331888808802068, 10.1080/]
[4]   On the harm that ignoring pretesting can cause [J].
Danilov, D ;
Magnus, JR .
JOURNAL OF ECONOMETRICS, 2004, 122 (01) :27-46
[5]  
Dijkstra T., 1988, On Model Uncertainty and Its Statistical Implications, P17
[6]   Variance estimation in a model with Gaussian submodels [J].
Dukic, VM ;
Peña, EA .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2005, 100 (469) :296-309
[7]   Frequentist model average estimators [J].
Hjort, NL ;
Claeskens, G .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2003, 98 (464) :879-899
[8]   THE EFFECT OF MODEL SELECTION ON CONFIDENCE-REGIONS AND PREDICTION REGIONS [J].
KABAILA, P .
ECONOMETRIC THEORY, 1995, 11 (03) :537-549
[9]   Incorporating lag order selection uncertainty in parameter inference for AR models [J].
Kapetanios, G .
ECONOMICS LETTERS, 2001, 72 (02) :137-144
[10]   Performance limits for estimators of the risk or distribution of shrinkage-type estimators, and some general lower risk-bound results [J].
Leeb, H ;
Pötscher, BM .
ECONOMETRIC THEORY, 2006, 22 (01) :69-97