Quantile regression feature selection and estimation with grouped variables using Huber approximation

被引:0
|
作者
Ben Sherwood
Shaobo Li
机构
[1] University of Kansas,School of Business
来源
Statistics and Computing | 2022年 / 32卷
关键词
Quantile regression; Group lasso; Huber regression;
D O I
暂无
中图分类号
学科分类号
摘要
This paper considers model selection and estimation for quantile regression with a known group structure in the predictors. For the median case the model is estimated by minimizing a penalized objective function with Huber loss and the group lasso penalty. While, for other quantiles an M-quantile approach, an asymmetric version of Huber loss, is used which approximates the standard quantile loss function. This approximation allows for efficient implementation of algorithms which rely on a differentiable loss function. Rates of convergence are provided which demonstrate the potential advantages of using the group penalty and that bias from the Huber-type approximation vanishes asymptotically. An efficient algorithm is discussed, which provides fast and accurate estimation for quantile regression models. Simulation and empirical results are provided to demonstrate the effectiveness of the proposed algorithm and support the theoretical results.
引用
收藏
相关论文
共 50 条
  • [21] Optimal portfolio selection using quantile and composite quantile regression models
    Aghamohammadi, A.
    Dadashi, H.
    Sojoudi, Mahdi
    Sojoudi, Meysam
    Tavoosi, M.
    COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 2024, 53 (07) : 3047 - 3057
  • [22] Upper and lower approximation models in interval regression using regression quantile techniques
    Lee, H
    Tanaka, H
    EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 1999, 116 (03) : 653 - 666
  • [23] A novel Bayesian method for variable selection and estimation in binary quantile regression
    Dao, Mai
    Wang, Min
    Ghosh, Souparno
    STATISTICAL ANALYSIS AND DATA MINING, 2022, 15 (06) : 766 - 780
  • [24] Estimation and variable selection for a class of quantile regression models with multiple index
    Han, Cun
    Sun, Xiaofei
    Gao, Wenliang
    COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2021, 50 (01) : 180 - 202
  • [25] Feature selection for probabilistic load forecasting via sparse penalized quantile regression
    Wang, Yi
    Gan, Dahua
    Zhang, Ning
    Xie, Le
    Kang, Chongqing
    JOURNAL OF MODERN POWER SYSTEMS AND CLEAN ENERGY, 2019, 7 (05) : 1200 - 1209
  • [26] Estimation and variable selection in single-index composite quantile regression
    Liu, Huilan
    Yang, Hu
    COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 2017, 46 (09) : 7022 - 7039
  • [27] Feature selection for probabilistic load forecasting via sparse penalized quantile regression
    Yi WANG
    Dahua GAN
    Ning ZHANG
    Le XIE
    Chongqing KANG
    Journal of Modern Power Systems and Clean Energy, 2019, 7 (05) : 1200 - 1209
  • [28] Using Nonlinear Quantile Regression for the Estimation of Software Cost
    De Andres, J.
    Landajo, M.
    Lorca, P.
    HYBRID ARTIFICIAL INTELLIGENT SYSTEMS (HAIS 2018), 2018, 10870 : 422 - 432
  • [29] Fitness approximation in estimation of distribution algorithms for feature selection
    Chen, HX
    Yuan, SM
    Kai, JA
    AI 2005: ADVANCES IN ARTIFICIAL INTELLIGENCE, 2005, 3809 : 904 - 909
  • [30] Iterative feature selection in least square regression estimation
    Alquier, Pierre
    ANNALES DE L INSTITUT HENRI POINCARE-PROBABILITES ET STATISTIQUES, 2008, 44 (01): : 47 - 88