Model selection in quantile regression models

被引:17
作者
Alhamzawi, Rahim [1 ]
机构
[1] Al Qadisiyah Univ, Coll Arts, Al Diwaniyah, Iraq
关键词
VARIABLE SELECTION; BAYESIAN LASSO; SHRINKAGE; LIKELIHOOD; INFERENCE; BINARY;
D O I
10.1080/02664763.2014.959905
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Lasso methods are regularisation and shrinkage methods widely used for subset selection and estimation in regression problems. From a Bayesian perspective, the Lasso-type estimate can be viewed as a Bayesian posterior mode when specifying independent Laplace prior distributions for the coefficients of independent variables [32]. A scale mixture of normal priors can also provide an adaptive regularisation method and represents an alternative model to the Bayesian Lasso-type model. In this paper, we assign a normal prior with mean zero and unknown variance for each quantile coefficient of independent variable. Then, a simple Markov Chain Monte Carlo-based computation technique is developed for quantile regression (QReg) models, including continuous, binary and left-censored outcomes. Based on the proposed prior, we propose a criterion for model selection in QReg models. The proposed criterion can be applied to classical least-squares, classical QReg, classical Tobit QReg and many others. For example, the proposed criterion can be applied to rq(), lm() and crq() which is available in an R package called Brq. Through simulation studies and analysis of a prostate cancer data set, we assess the performance of the proposed methods. The simulation studies and the prostate cancer data set analysis confirm that our methods perform well, compared with other approaches. © 2014, © 2014 Taylor & Francis.
引用
收藏
页码:445 / 458
页数:14
相关论文
共 43 条
[1]   Bayesian adaptive Lasso quantile regression [J].
Alhamzawi, Rahim ;
Yu, Keming ;
Benoit, Dries F. .
STATISTICAL MODELLING, 2012, 12 (03) :279-297
[2]   Variable selection in quantile regression via Gibbs sampling [J].
Alhamzawi, Rahim ;
Yu, Keming .
JOURNAL OF APPLIED STATISTICS, 2012, 39 (04) :799-813
[3]  
ANDREWS DF, 1974, J ROY STAT SOC B MET, V36, P99
[4]   Gene selection using a two-level hierarchical Bayesian model [J].
Bae, K ;
Mallick, BK .
BIOINFORMATICS, 2004, 20 (18) :3423-3430
[5]   Bayesian lasso binary quantile regression [J].
Benoit, Dries F. ;
Alhamzawi, Rahim ;
Yu, Keming .
COMPUTATIONAL STATISTICS, 2013, 28 (06) :2861-2873
[6]   Binary quantile regression: a Bayesian approach based on the asymmetric Laplace distribution [J].
Benoit, Dries F. ;
Van den Poel, Dirk .
JOURNAL OF APPLIED ECONOMETRICS, 2012, 27 (07) :1174-1188
[7]   Penalized composite quasi-likelihood for ultrahigh dimensional variable selection [J].
Bradic, Jelena ;
Fan, Jianqing ;
Wang, Weiwei .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 2011, 73 :325-349
[8]   Estimating fish body condition with quantile regression [J].
Cade, Brian S. ;
Terrell, James W. ;
Porath, Mark T. .
NORTH AMERICAN JOURNAL OF FISHERIES MANAGEMENT, 2008, 28 (02) :349-359
[9]   Random effects selection in linear mixed models [J].
Chen, Z ;
Dunson, DB .
BIOMETRICS, 2003, 59 (04) :762-769
[10]   Bayesian regularisation in structured additive regression: a unifying perspective on shrinkage, smoothing and predictor selection [J].
Fahrmeir, Ludwig ;
Kneib, Thomas ;
Konrath, Susanne .
STATISTICS AND COMPUTING, 2010, 20 (02) :203-219