Simultaneous estimation and factor selection in quantile regression via adaptive sup-norm regularization

被引:16
作者
Bang, Sungwan [1 ]
Jhun, Myoungshic [1 ]
机构
[1] Korea Univ, Dept Stat, Seoul 136701, South Korea
基金
新加坡国家研究基金会;
关键词
Factor selection; Linear programming; Quantile regression; Regularization; Sup-norm; NONCONCAVE PENALIZED LIKELIHOOD; VARIABLE SELECTION; MODEL SELECTION; ASYMPTOTICS; SHRINKAGE; SURVIVAL; LASSO;
D O I
10.1016/j.csda.2011.01.026
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Some regularization methods, including the group lasso and the adaptive group lasso, have been developed for the automatic selection of grouped variables (factors) in conditional mean regression. In many practical situations, such a problem arises naturally when a set of dummy variables is used to represent a categorical factor and/or when a set of basis functions of a continuous variable is included in the predictor set. Complementary to these earlier works, the simultaneous and automatic factor selection is examined in quantile regression. To incorporate the factor information into regularized model fitting, the adaptive sup-norm regularized quantile regression is proposed, which penalizes the empirical check loss function by the sum of factor-wise adaptive sup-norm penalties. It is shown that the proposed method possesses the oracle property. A simulation study demonstrates that the proposed method is a more appropriate tool for factor selection than the adaptive lasso regularized quantile regression. (C) 2011 Elsevier B.V. All rights reserved.
引用
收藏
页码:813 / 826
页数:14
相关论文
共 40 条
[1]  
[Anonymous], 2006, Journal of the Royal Statistical Society, Series B
[2]   Variable selection via nonconcave penalized likelihood and its oracle properties [J].
Fan, JQ ;
Li, RZ .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2001, 96 (456) :1348-1360
[3]   HIERARCHICAL SPLINE MODELS FOR CONDITIONAL QUANTILES AND THE DEMAND FOR ELECTRICITY [J].
HENDRICKS, W ;
KOENKER, R .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1992, 87 (417) :58-68
[4]  
Hosmer DW., 2000, Applied logistic regression, DOI DOI 10.1002/0471722146.CH4
[5]  
Kim Y, 2006, STAT SINICA, V16, P375
[6]  
Knight K, 1998, ANN STAT, V26, P755
[7]   Asymptotics for L1-estimators of regression parameters under heteroscedasticity [J].
Knight, K .
CANADIAN JOURNAL OF STATISTICS-REVUE CANADIENNE DE STATISTIQUE, 1999, 27 (03) :497-507
[8]   Reappraising medfly longevity: A quantile regression survival analysis [J].
Koenker, R ;
Geling, O .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2001, 96 (454) :458-468
[9]   Quantile regression for longitudinal data [J].
Koenker, R .
JOURNAL OF MULTIVARIATE ANALYSIS, 2004, 91 (01) :74-89
[10]  
KOENKER R, 1994, BIOMETRIKA, V81, P673