Simultaneous variable selection and parametric estimation for quantile regression

被引:2
作者
Xiong, Wei [1 ]
Tian, Maozai [1 ]
机构
[1] Renmin Univ China, Sch Stat, Ctr Appl Stat, Beijing 100872, Peoples R China
基金
高等学校博士学科点专项科研基金; 中国国家自然科学基金;
关键词
Variable selection; Quantile regression; One-step estimator; Oracle property; BIC-like criterion; NONCONCAVE PENALIZED LIKELIHOOD;
D O I
10.1016/j.jkss.2014.06.003
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
In this paper, variable selection techniques in the linear quantile regression model are mainly considered. Based on the penalized quantile regression model, a one-step procedure that can simultaneously perform variable selection and coefficient estimation is proposed. The proposed procedure has three distinctive features: (1) By considering quantile regression, the set of relevant variables can vary across quantiles, thus making it more flexible to model heterogeneous data; (2) The one-step estimator has nice properties in both theory and practice. By applying SCAD penalty (Fan and Li, 2001) and Adaptive-LASSO penalty (Zou, 2006), we establish the oracle property for the sparse quantile regression under mild conditions. Computationally, the one-step estimator is fast, dramatically reducing the computation cost; (3) We suggest a BIC-like tuning parameter selector for the penalized quantile regression and demonstrate the consistency of this criterion. That is to say the true model can be identified consistently based on the BIC-like criterion, making our one-step estimator more reliable practically. Monte Carlo simulation studies are conducted to examine the finite-sample performance of this procedure. Finally, we conclude with a real data analysis. The results are promising. (C) 2014 The Korean Statistical Society. Published by Elsevier B.V. All rights reserved.
引用
收藏
页码:134 / 149
页数:16
相关论文
共 18 条
[1]   FITTING AUTOREGRESSIVE MODELS FOR PREDICTION [J].
AKAIKE, H .
ANNALS OF THE INSTITUTE OF STATISTICAL MATHEMATICS, 1969, 21 (02) :243-&
[2]  
Akaike H., 1973, Selected Papers of Hirotugu Akaike, P199, DOI 10.1007/978-1-4612-1694-0_15
[3]   RELATIONSHIP BETWEEN VARIABLE SELECTION AND DATA AUGMENTATION AND A METHOD FOR PREDICTION [J].
ALLEN, DM .
TECHNOMETRICS, 1974, 16 (01) :125-127
[4]  
Breiman L, 1996, ANN STAT, V24, P2350
[5]  
Craven P., 1979, Numerische Mathematik, V31, P377, DOI 10.1007/BF01404567
[6]   1977 RIETZ LECTURE - BOOTSTRAP METHODS - ANOTHER LOOK AT THE JACKKNIFE [J].
EFRON, B .
ANNALS OF STATISTICS, 1979, 7 (01) :1-26
[7]   Variable selection via nonconcave penalized likelihood and its oracle properties [J].
Fan, JQ ;
Li, RZ .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2001, 96 (456) :1348-1360
[8]   THE RISK INFLATION CRITERION FOR MULTIPLE-REGRESSION [J].
FOSTER, DP ;
GEORGE, EI .
ANNALS OF STATISTICS, 1994, 22 (04) :1947-1975
[9]   REGRESSION QUANTILES [J].
KOENKER, R ;
BASSETT, G .
ECONOMETRICA, 1978, 46 (01) :33-50
[10]  
Koenker R., 2005, Quantile Regression