Asymptotic properties of Lasso in high-dimensional partially linear models

被引:16
作者
Ma Chi [1 ,2 ]
Huang Jian [3 ]
机构
[1] Anhui Univ Sci & Technol, Dept Appl Math, Huainan 232001, Peoples R China
[2] Shanghai Univ Finance & Econ, Sch Stat & Management, Shanghai 200433, Peoples R China
[3] Univ Iowa, Dept Stat & Actuarial Sci & Biostat, Iowa City, IA 52242 USA
关键词
Lasso; irrepresentable condition; restricted eigenvalue; semiparametric models; sparsity; VARIABLE SELECTION; SEMIPARAMETRIC REGRESSION; PENALIZED REGRESSION; ALGORITHMS;
D O I
10.1007/s11425-015-5093-2
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
We study the properties of the Lasso in the high-dimensional partially linear model where the number of variables in the linear part can be greater than the sample size. We use truncated series expansion based on polynomial splines to approximate the nonparametric component in this model. Under a sparsity assumption on the regression coefficients of the linear component and some regularity conditions, we derive the oracle inequalities for the prediction risk and the estimation error. We also provide sufficient conditions under which the Lasso estimator is selection consistent for the variables in the linear part of the model. In addition, we derive the rate of convergence of the estimator of the nonparametric function. We conduct simulation studies to evaluate the finite sample performance of variable selection and nonparametric function estimation.
引用
收藏
页码:769 / 788
页数:20
相关论文
共 50 条
[31]   High-Dimensional LASSO-Based Computational Regression Models: Regularization, Shrinkage, and Selection [J].
Emmert-Streib, Frank ;
Dehmer, Matthias .
MACHINE LEARNING AND KNOWLEDGE EXTRACTION, 2019, 1 (01) :359-383
[32]   The robust desparsified lasso and the focused information criterion for high-dimensional generalized linear models [J].
Pandhare, S. C. ;
Ramanathan, T. V. .
STATISTICS, 2023, 57 (01) :1-25
[33]   On the sign consistency of the Lasso for the high-dimensional Cox model [J].
Lv, Shaogao ;
You, Mengying ;
Lin, Huazhen ;
Lian, Heng ;
Huang, Jian .
JOURNAL OF MULTIVARIATE ANALYSIS, 2018, 167 :79-96
[34]   Stable prediction in high-dimensional linear models [J].
Lin, Bingqing ;
Wang, Qihua ;
Zhang, Jun ;
Pang, Zhen .
STATISTICS AND COMPUTING, 2017, 27 (05) :1401-1412
[35]   No penalty no tears: Least squares in high-dimensional linear models [J].
Wang, Xiangyu ;
Dunson, David ;
Leng, Chenlei .
INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 48, 2016, 48
[36]   ESTIMATION IN HIGH-DIMENSIONAL LINEAR MODELS WITH DETERMINISTIC DESIGN MATRICES [J].
Shao, Jun ;
Deng, Xinwei .
ANNALS OF STATISTICS, 2012, 40 (02) :812-831
[37]   Stable prediction in high-dimensional linear models [J].
Bingqing Lin ;
Qihua Wang ;
Jun Zhang ;
Zhen Pang .
Statistics and Computing, 2017, 27 :1401-1412
[38]   Simultaneous Inference for High-Dimensional Linear Models [J].
Zhang, Xianyang ;
Cheng, Guang .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2017, 112 (518) :757-768
[39]   High-dimensional inference in misspecified linear models [J].
Buehlmann, Peter ;
van de Geer, Sara .
ELECTRONIC JOURNAL OF STATISTICS, 2015, 9 (01) :1449-1473
[40]   NON-ASYMPTOTIC ORACLE INEQUALITIES FOR THE HIGH-DIMENSIONAL COX REGRESSION VIA LASSO [J].
Kong, Shengchun ;
Nan, Bin .
STATISTICA SINICA, 2014, 24 (01) :25-42