INFERENCE AFTER MODEL AVERAGING IN LINEAR REGRESSION MODELS

被引:50
作者
Zhang, Xinyu [1 ,2 ]
Liu, Chu-An [3 ]
机构
[1] Chinese Acad Sci, Beijing, Peoples R China
[2] Qingdao Univ, Qingdao, Shandong, Peoples R China
[3] Acad Sinica, Taipei, Taiwan
基金
中国国家自然科学基金;
关键词
GENERALIZED CROSS-VALIDATION; ASYMPTOTIC OPTIMALITY; ADAPTIVE LASSO; SELECTION; ESTIMATORS; PERFORMANCE; CRITERION; CL;
D O I
10.1017/S0266466618000269
中图分类号
F [经济];
学科分类号
02 ;
摘要
This article considers the problem of inference for nested least squares averaging estimators. We study the asymptotic behavior of the Mallows model averaging estimator (MMA; Hansen, 2007) and the jackknife model averaging estimator (JMA; Hansen and Racine, 2012) under the standard asymptotics with fixed parameters setup. We find that both MMA and JMA estimators asymptotically assign zero weight to the under-fitted models, and MMA and JMA weights of just-fitted and over-fitted models are asymptotically random. Building on the asymptotic behavior of model weights, we derive the asymptotic distributions of MMA and JMA estimators and propose a simulation-based confidence interval for the least squares averaging estimator. Monte Carlo simulations show that the coverage probabilities of proposed confidence intervals achieve the nominal level.
引用
收藏
页码:816 / 841
页数:26
相关论文
共 49 条
[1]   ASYMPTOTIC OPTIMALITY OF GENERALIZED CL, CROSS-VALIDATION, AND GENERALIZED CROSS-VALIDATION IN REGRESSION WITH HETEROSKEDASTIC ERRORS [J].
ANDREWS, DWK .
JOURNAL OF ECONOMETRICS, 1991, 47 (2-3) :359-377
[2]  
[Anonymous], 2008, Cambridge Books
[3]  
Breiman L, 1996, MACH LEARN, V24, P123, DOI 10.1023/A:1018054314350
[4]   Model selection: An integral part of inference [J].
Buckland, ST ;
Burnham, KP ;
Augustin, NH .
BIOMETRICS, 1997, 53 (02) :603-618
[5]   On the validity of the pairs bootstrap for lasso estimators [J].
Camponovo, L. .
BIOMETRIKA, 2015, 102 (04) :981-987
[6]   RATES OF CONVERGENCE OF THE ADAPTIVE LASSO ESTIMATORS TO THE ORACLE DISTRIBUTION AND HIGHER ORDER REFINEMENTS BY THE BOOTSTRAP [J].
Chatterjee, A. ;
Lahiri, S. N. .
ANNALS OF STATISTICS, 2013, 41 (03) :1232-1259
[7]   Bootstrapping Lasso Estimators [J].
Chatterjee, A. ;
Lahiri, S. N. .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2011, 106 (494) :608-625
[8]   Using invalid instruments on purpose: Focused moment selection and averaging for GMM [J].
DiTraglia, Francis J. .
JOURNAL OF ECONOMETRICS, 2016, 195 (02) :187-208
[9]  
Hansen B. E., 2018, UNPUB
[10]   Least-squares forecast averaging [J].
Hansen, Bruce E. .
JOURNAL OF ECONOMETRICS, 2008, 146 (02) :342-350