Asymptotic properties of Lasso in high-dimensional partially linear models

被引:16
作者
Ma Chi [1 ,2 ]
Huang Jian [3 ]
机构
[1] Anhui Univ Sci & Technol, Dept Appl Math, Huainan 232001, Peoples R China
[2] Shanghai Univ Finance & Econ, Sch Stat & Management, Shanghai 200433, Peoples R China
[3] Univ Iowa, Dept Stat & Actuarial Sci & Biostat, Iowa City, IA 52242 USA
关键词
Lasso; irrepresentable condition; restricted eigenvalue; semiparametric models; sparsity; VARIABLE SELECTION; SEMIPARAMETRIC REGRESSION; PENALIZED REGRESSION; ALGORITHMS;
D O I
10.1007/s11425-015-5093-2
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
We study the properties of the Lasso in the high-dimensional partially linear model where the number of variables in the linear part can be greater than the sample size. We use truncated series expansion based on polynomial splines to approximate the nonparametric component in this model. Under a sparsity assumption on the regression coefficients of the linear component and some regularity conditions, we derive the oracle inequalities for the prediction risk and the estimation error. We also provide sufficient conditions under which the Lasso estimator is selection consistent for the variables in the linear part of the model. In addition, we derive the rate of convergence of the estimator of the nonparametric function. We conduct simulation studies to evaluate the finite sample performance of variable selection and nonparametric function estimation.
引用
收藏
页码:769 / 788
页数:20
相关论文
共 50 条
[41]   Penalized least-squares estimation for regression coefficients in high-dimensional partially linear models [J].
Ni, Huey-Fan .
JOURNAL OF STATISTICAL PLANNING AND INFERENCE, 2012, 142 (02) :379-389
[42]   Orthogonality-projection-based penalized variable selection for high-dimensional partially linear models [J].
Yang, Yiping ;
Zhao, Peixin ;
Zhang, Jun .
APPLIED MATHEMATICAL MODELLING, 2025, 138
[43]   Calibrated Equilibrium Estimation and Double Selection for High-dimensional Partially Linear Measurement Error Models [J].
Luo, Jingxuan ;
Li, Gaorong ;
Peng, Heng ;
Yue, Lili .
JOURNAL OF BUSINESS & ECONOMIC STATISTICS, 2025, 43 (03) :710-722
[44]   Post Lasso Stability Selection for High Dimensional Linear Models [J].
Gauraha, Niharika ;
Pavlenko, Tatyana ;
Parui, Swapan K. .
ICPRAM: PROCEEDINGS OF THE 6TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION APPLICATIONS AND METHODS, 2017, :638-646
[45]   Moderately clipped LASSO for the high-dimensional generalized linear model [J].
Lee, Sangin ;
Ku, Boncho ;
Kown, Sunghoon .
COMMUNICATIONS FOR STATISTICAL APPLICATIONS AND METHODS, 2020, 27 (04) :445-458
[46]   Debiased lasso after sample splitting for estimation and inference in high-dimensional generalized linear models [J].
Vazquez, Omar ;
Nan, Bin .
CANADIAN JOURNAL OF STATISTICS-REVUE CANADIENNE DE STATISTIQUE, 2025, 53 (01)
[47]   Variable selection in high-dimensional linear models: partially faithful distributions and the PC-simple algorithm [J].
Buehlmann, P. ;
Kalisch, M. ;
Maathuis, M. H. .
BIOMETRIKA, 2010, 97 (02) :261-278
[48]   Smooth-Threshold GEE Variable Selection in High-Dimensional Partially Linear Models with Longitudinal Data [J].
Tian, Ruiqin ;
Xue, Liugen .
COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 2015, 44 (07) :1720-1734
[49]   Sparsity identification for high-dimensional partially linear model with measurement error [J].
Li, Rui ;
Zhao, Haibing .
COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 2018, 47 (08) :2378-2392
[50]   High-Dimensional Multiresponse Partially Functional Linear Regression [J].
Cai, Xiong ;
Cao, Jiguo ;
Yan, Xingyu ;
Zhao, Peng .
STATISTICS IN MEDICINE, 2025, 44 (13-14)