Asymptotic properties of Lasso in high-dimensional partially linear models

被引:16
作者
Ma Chi [1 ,2 ]
Huang Jian [3 ]
机构
[1] Anhui Univ Sci & Technol, Dept Appl Math, Huainan 232001, Peoples R China
[2] Shanghai Univ Finance & Econ, Sch Stat & Management, Shanghai 200433, Peoples R China
[3] Univ Iowa, Dept Stat & Actuarial Sci & Biostat, Iowa City, IA 52242 USA
关键词
Lasso; irrepresentable condition; restricted eigenvalue; semiparametric models; sparsity; VARIABLE SELECTION; SEMIPARAMETRIC REGRESSION; PENALIZED REGRESSION; ALGORITHMS;
D O I
10.1007/s11425-015-5093-2
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
We study the properties of the Lasso in the high-dimensional partially linear model where the number of variables in the linear part can be greater than the sample size. We use truncated series expansion based on polynomial splines to approximate the nonparametric component in this model. Under a sparsity assumption on the regression coefficients of the linear component and some regularity conditions, we derive the oracle inequalities for the prediction risk and the estimation error. We also provide sufficient conditions under which the Lasso estimator is selection consistent for the variables in the linear part of the model. In addition, we derive the rate of convergence of the estimator of the nonparametric function. We conduct simulation studies to evaluate the finite sample performance of variable selection and nonparametric function estimation.
引用
收藏
页码:769 / 788
页数:20
相关论文
共 50 条
[21]   Confidence intervals for high-dimensional partially linear single-index models [J].
Gueuning, Thomas ;
Claeskens, Gerda .
JOURNAL OF MULTIVARIATE ANALYSIS, 2016, 149 :13-29
[22]   Asymptotic properties of bridge estimators in sparse high-dimensional regression models [J].
Huang, Jian ;
Horowitz, Joel L. ;
Ma, Shuangge .
ANNALS OF STATISTICS, 2008, 36 (02) :587-613
[23]   High-dimensional linear discriminant analysis with moderately clipped LASSO [J].
Chang, Jaeho ;
Moon, Haeseong ;
Kwon, Sunghoon .
COMMUNICATIONS FOR STATISTICAL APPLICATIONS AND METHODS, 2021, 28 (01) :21-37
[24]   Hi-LASSO: High-Dimensional LASSO [J].
Kim, Youngsoon ;
Hao, Jie ;
Mallavarapu, Tejaswini ;
Park, Joongyang ;
Kang, Mingon .
IEEE ACCESS, 2019, 7 :44562-44573
[25]   The sparsity and bias of the lasso selection in high-dimensional linear regression [J].
Zhang, Cun-Hui ;
Huang, Jian .
ANNALS OF STATISTICS, 2008, 36 (04) :1567-1594
[26]   On the asymptotic properties of the group lasso estimator for linear models [J].
Nardi, Yuval ;
Rinaldo, Alessandro .
ELECTRONIC JOURNAL OF STATISTICS, 2008, 2 :605-633
[27]   Variable Selection in High-Dimensional Partially Linear Models with Longitudinal Data [J].
Yang Yiping ;
Xue Liugen .
RECENT ADVANCE IN STATISTICS APPLICATION AND RELATED AREAS, VOLS I AND II, 2009, :661-667
[28]   Robust group non-convex estimations for high-dimensional partially linear models [J].
Wang, Mingqiu ;
Tian, Guo-Liang .
JOURNAL OF NONPARAMETRIC STATISTICS, 2016, 28 (01) :49-67
[29]   Spline-Lasso in High-Dimensional Linear Regression [J].
Guo, Jianhua ;
Hu, Jianchang ;
Jing, Bing-Yi ;
Zhang, Zhen .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2016, 111 (513) :288-297
[30]   High-Dimensional LASSO-Based Computational Regression Models: Regularization, Shrinkage, and Selection [J].
Emmert-Streib, Frank ;
Dehmer, Matthias .
MACHINE LEARNING AND KNOWLEDGE EXTRACTION, 2019, 1 (01) :359-383