Adaptive sparse group LASSO in quantile regression

被引:0
作者
Alvaro Mendez-Civieta
M. Carmen Aguilera-Morillo
Rosa E. Lillo
机构
[1] University Carlos III of Madrid,Department of Statistics
[2] uc3m-Santander Big Data Institute,Department of Applied Statistics and Operational Research, and Quality
[3] Universitat Politecnica de Valencia,undefined
来源
Advances in Data Analysis and Classification | 2021年 / 15卷
关键词
High-dimension; Penalization; Regularization; Prediction; Weight calculation; 62J07;
D O I
暂无
中图分类号
学科分类号
摘要
This paper studies the introduction of sparse group LASSO (SGL) to the quantile regression framework. Additionally, a more flexible version, an adaptive SGL is proposed based on the adaptive idea, this is, the usage of adaptive weights in the penalization. Adaptive estimators are usually focused on the study of the oracle property under asymptotic and double asymptotic frameworks. A key step on the demonstration of this property is to consider adaptive weights based on a initial n\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\sqrt{n}$$\end{document}-consistent estimator. In practice this implies the usage of a non penalized estimator that limits the adaptive solutions to low dimensional scenarios. In this work, several solutions, based on dimension reduction techniques PCA and PLS, are studied for the calculation of these weights in high dimensional frameworks. The benefits of this proposal are studied both in synthetic and real datasets.
引用
收藏
页码:547 / 573
页数:26
相关论文
共 97 条
[1]  
Chiang AP(2006)Homozygosity mapping with SNP arrays identifies TRIM32, an E3 ubiquitin ligase, as a Bardet-Biedl syndrome gene (BBS11) Proc Natl Acad Sci 103 6287-6292
[2]  
Beck JS(2010)Sparse partial least squares regression for simultaneous dimension reduction and variable selection J R Stat Soc Ser B Stat Methodol 72 3-25
[3]  
Yen H-J(2017)Adaptive fused LASSO in grouped quantile regression J Stat Theory Pract 11 107-125
[4]  
Tayeh MK(2019)Adaptive group LASSO selection in quantile models Stat Pap 60 173-197
[5]  
Scheetz TE(2001)Variable selection via nonconcave penalized likelihood and its oracle properties J Am Stat Assoc 96 1348-1360
[6]  
Swiderski RE(2004)Nonconcave penalized likelihood with a diverging number of parameters Ann Stat 32 928-961
[7]  
Nishimura DY(2011)On the grouped selection and model complexity of the adaptive elastic net Stat Comput 21 451-462
[8]  
Braun TA(2008)Asymptotic properties of bridge estimators in sparse high-dimensional regression models Ann Stat 36 587-613
[9]  
Kim K-YA(2008)Adaptive Lasso for sparse high-dimensional regression Stat Sin 1 1-28
[10]  
Huang J(2008)Smoothly clipped absolute deviation on high dimensions J Am Stat Assoc 103 1665-1673