Screening and selection for quantile regression using an alternative measure of variable importance

被引:4
|
作者
Kong, Yinfei [1 ]
Li, Yujie [2 ]
Zerom, Dawit [1 ]
机构
[1] Calif State Univ Fullerton, Dept Informat Syst & Decis Sci, Fullerton, CA 92634 USA
[2] Shandong Univ Finance & Econ, Jinan, Shandong, Peoples R China
关键词
Categorical data; Continuous data; Partial quantile utility; Quantile regression; Screening; Selection; MODEL SELECTION;
D O I
10.1016/j.jmva.2019.04.007
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
We propose a variable importance measure called partial quantile utility (PQU). We then introduce a quantile forward regression algorithm (QFR) that uses PQU-based ranking to screen important variables from a potential set whose dimension can be substantially larger than the sample size. We prove that QFR-based screening can identify all the important variables in a small number of steps. To remove noise variables from the screening step, we further implement variable selection by adopting a modified Bayesian information criterion. We show that the smaller selected set also contains all the important variables with overwhelming probability. Using simulation designs that are intentionally chosen to show its capability in identifying jointly but not marginally important variables and detecting heterogeneous associations, we extensively investigate its finite-sample performance with regard to screening, selection and out-of-sample prediction. To further illustrate the merit of our proposal, we provide an application to the problem of identifying risk factors that are associated with childhood malnutrition in India. Published by Elsevier Inc.
引用
收藏
页码:435 / 455
页数:21
相关论文
共 50 条
  • [1] VARIABLE SELECTION IN QUANTILE REGRESSION
    Wu, Yichao
    Liu, Yufeng
    STATISTICA SINICA, 2009, 19 (02) : 801 - 817
  • [2] Bayesian variable selection in quantile regression
    Yu, Keming
    Chen, Cathy W. S.
    Reed, Craig
    Dunson, David B.
    STATISTICS AND ITS INTERFACE, 2013, 6 (02) : 261 - 274
  • [3] Variable selection in additive quantile regression using nonconcave penalty
    Zhao, Kaifeng
    Lian, Heng
    STATISTICS, 2016, 50 (06) : 1276 - 1289
  • [4] Bayesian variable selection and estimation in quantile regression using a quantile-specific prior
    Mai Dao
    Min Wang
    Souparno Ghosh
    Keying Ye
    Computational Statistics, 2022, 37 : 1339 - 1368
  • [5] Bayesian variable selection and estimation in quantile regression using a quantile-specific prior
    Dao, Mai
    Wang, Min
    Ghosh, Souparno
    Ye, Keying
    COMPUTATIONAL STATISTICS, 2022, 37 (03) : 1339 - 1368
  • [6] Group Identification and Variable Selection in Quantile Regression
    Alkenani, Ali
    Msallam, Basim Shlaibah
    JOURNAL OF PROBABILITY AND STATISTICS, 2019, 2019
  • [7] Bayesian variable selection in binary quantile regression
    Oh, Man-Suk
    Park, Eun Sug
    So, Beong-Soo
    STATISTICS & PROBABILITY LETTERS, 2016, 118 : 177 - 181
  • [8] Interquantile shrinkage and variable selection in quantile regression
    Jiang, Liewen
    Bondell, Howard D.
    Wang, Huixia Judy
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2014, 69 : 208 - 219
  • [9] Variable selection of varying coefficient models in quantile regression
    Noh, Hohsuk
    Chung, Kwanghun
    Van Keilegom, Ingrid
    ELECTRONIC JOURNAL OF STATISTICS, 2012, 6 : 1220 - 1238
  • [10] Variable selection of the quantile varying coefficient regression models
    Weihua Zhao
    Riquan Zhang
    Yazhao Lv
    Jicai Liu
    Journal of the Korean Statistical Society, 2013, 42 : 343 - 358