GRADIENT-INDUCED MODEL-FREE VARIABLE SELECTION WITH COMPOSITE QUANTILE REGRESSION

被引:2
作者
He, Xin [1 ]
Wang, Junhui [1 ]
Lv, Shaogao [2 ]
机构
[1] City Univ Hong Kong, Dept Math, Hong Kong, Hong Kong, Peoples R China
[2] Nanjing Audit Univ, Coll Sci, Nanjing, Jiangsu, Peoples R China
关键词
Lasso; learning gradients; quantile regression; reproducing kernel Hilbert space (RKHS); sparsity; variable selection; DERIVATIVES; LIKELIHOOD; SHRINKAGE;
D O I
10.5705/ss.202016.0222
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Variable selection is central to sparse modeling, and many methods have been proposed under various model assumptions. Most existing methods are based on an explicit functional relationship, while we are concerned with a model-free variable selection method that attempts to identify informative variables that are related to the response by simultaneously examining the sparsity in multiple conditional quantile functions. It does not require specification of the underlying model for the response. The proposed method is implemented via an efficient computing algorithm that couples the majorize-minimization algorithm and the proximal gradient descent algorithm. Its asymptotic estimation and variable selection consistencies are established, without explicit model assumptions, that assure the truly informative variables are correctly identified with high probability. The effectiveness of the proposed method is supported by a variety of simulated and real-life examples.
引用
收藏
页码:1521 / 1538
页数:18
相关论文
共 40 条
[1]  
[Anonymous], 2009, COMPUTATION
[2]  
[Anonymous], 2006, Journal of the Royal Statistical Society, Series B
[3]   A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems [J].
Beck, Amir ;
Teboulle, Marc .
SIAM JOURNAL ON IMAGING SCIENCES, 2009, 2 (01) :183-202
[4]   l1-PENALIZED QUANTILE REGRESSION IN HIGH-DIMENSIONAL SPARSE MODELS [J].
Belloni, Alexandre ;
Chernozhukov, Victor .
ANNALS OF STATISTICS, 2011, 39 (01) :82-130
[5]  
Braun ML, 2006, J MACH LEARN RES, V7, P2303
[6]   Random forests [J].
Breiman, L .
MACHINE LEARNING, 2001, 45 (01) :5-32
[7]   Signal recovery by proximal forward-backward splitting [J].
Combettes, PL ;
Wajs, VR .
MULTISCALE MODELING & SIMULATION, 2005, 4 (04) :1168-1200
[8]  
De Brabanter K, 2013, J MACH LEARN RES, V14, P281
[9]   Sure independence screening for ultrahigh dimensional feature space [J].
Fan, Jianqing ;
Lv, Jinchi .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 2008, 70 :849-883
[10]   Variable selection via nonconcave penalized likelihood and its oracle properties [J].
Fan, JQ ;
Li, RZ .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2001, 96 (456) :1348-1360