Efficient Penalized Estimation for Linear Regression Model

被引:0
作者
Mao, Guangyu [1 ]
机构
[1] Beijing Jiaotong Univ, Sch Econ & Management, Beijing, Peoples R China
关键词
GMM; LASSO; Oracle Property; Penalized Least Squares; SCAD; Shrinkage; VARIABLE SELECTION; HETEROSKEDASTICITY; LIKELIHOOD; REGULARIZATION; LASSO;
D O I
10.1080/03610926.2012.763094
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
This paper develops new penalized estimation for linear regression model. We prove that the new method, which is referred to as efficient penalized estimation, is selection consistent, and more asymptotically efficient than the original one. Besides, we construct a new selector called efficient BIC Selector to tune the regularization parameter in the new estimation, which is shown to be consistent. Our simulation results suggest that the new method may bring significant improvement relative to the original penalized estimation. In addition, we employ a real data set to illustrate the application of the efficient penalized estimation.
引用
收藏
页码:1436 / 1449
页数:14
相关论文
共 50 条
[41]   Hierarchically penalized Cox regression with grouped variables [J].
Wang, S. ;
Nan, B. ;
Zhu, N. ;
Zhu, J. .
BIOMETRIKA, 2009, 96 (02) :307-322
[42]   Penalized regression via the restricted bridge estimator [J].
Yuzbasi, Bahadir ;
Arashi, Mohammad ;
Akdeniz, Fikri .
SOFT COMPUTING, 2021, 25 (13) :8401-8416
[43]   PENALIZED INTERACTION ESTIMATION FOR ULTRAHIGH DIMENSIONAL QUADRATIC REGRESSION [J].
Wang, Cheng ;
Jiang, Binyan ;
Zhu, Liping .
STATISTICA SINICA, 2021, 31 (03) :1549-1570
[44]   Efficient adaptive estimation strategies in high-dimensional partially linear regression models [J].
Gao, Xiaoli ;
Ahmed, S. Ejaz .
PERSPECTIVES ON BIG DATA ANALYSIS: METHODOLOGIES AND APPLICATIONS, 2014, 622 :61-80
[45]   The L1 penalized LAD estimator for high dimensional linear regression [J].
Wang, Lie .
JOURNAL OF MULTIVARIATE ANALYSIS, 2013, 120 :135-151
[46]   Penalized least-squares estimation for regression coefficients in high-dimensional partially linear models [J].
Ni, Huey-Fan .
JOURNAL OF STATISTICAL PLANNING AND INFERENCE, 2012, 142 (02) :379-389
[47]   Variable selection via generalized SELO-penalized linear regression models [J].
Shi Yue-yong ;
Cao Yong-xiu ;
Yu Ji-chang ;
Jiao Yu-ling .
APPLIED MATHEMATICS-A JOURNAL OF CHINESE UNIVERSITIES SERIES B, 2018, 33 (02) :145-162
[48]   Robust estimation and variable selection for semiparametric partially linear varying coefficient model based on modal regression [J].
Zhang, Riquan ;
Zhao, Weihua ;
Liu, Jicai .
JOURNAL OF NONPARAMETRIC STATISTICS, 2013, 25 (02) :523-544
[49]   Efficient Implementation of Penalized Regression for Genetic Risk Prediction [J].
Prive, Florian ;
Aschard, Hugues ;
Blum, Michael G. B. .
GENETICS, 2019, 212 (01) :65-74
[50]   A penalized estimation for the Cox model with ordinal multinomial covariates [J].
Yue, Chao ;
Xuejun, Ma ;
Yaguang, Li ;
Lei, Huang .
JOURNAL OF STATISTICAL COMPUTATION AND SIMULATION, 2022, 92 (06) :1194-1223