Simultaneous Lasso and Dantzig Selector in High Dimensional Nonparametric Regression

被引:0
作者
Wang, Shiqing [1 ]
Su, Limin [1 ]
机构
[1] North China Univ Water Resources & Elect Power, Coll Math & Informat Sci, Zhengzhou 450011, Henan, Peoples R China
来源
INTERNATIONAL JOURNAL OF APPLIED MATHEMATICS & STATISTICS | 2013年 / 42卷 / 12期
关键词
Linear model; sparsity; Lasso selector; Dantzig selector; oracle inequality; nonparametric regression model;
D O I
暂无
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
During the last few years, a great deal of attention has been focused on Lasso and Dantzig selector in high dimensional linear regression when the number of variables can be much larger than the sample size. Under a sparsity scenario, Bickel et al. (2009) showed that the Lasso estimator and the Dantzig selector exhibit similar behavior, and derived oracle inequalities for the prediction risk in the general nonparametric regression model, as well as bounds on the L-p estimation loss in the linear model. The Assumption RE(s, c) and Assumption RE(s,m,c) play a significant role in their paper. In this paper, the assumptions equivalent with Assumption RE(s, c) and Assumption RE (s,m,c) are given. More precise oracle inequalities for the prediction risk in the general nonparametric regression model and bounds on the L-p estimation loss in the linear model are derived when the number of variables can be much larger than the sample size.
引用
收藏
页码:103 / 118
页数:16
相关论文
共 50 条
[21]   The Dantzig Discriminant Analysis with High Dimensional Data [J].
Zhang, Yanli ;
Huo, Lei ;
Lin, Lu ;
Zeng, Yunhui .
COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2014, 43 (23) :5012-5025
[22]   Semiparametric regression models with additive nonparametric components and high dimensional parametric components [J].
Du, Pang ;
Cheng, Guang ;
Liang, Hua .
COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2012, 56 (06) :2006-2017
[23]   High-dimensional generalized linear models and the lasso [J].
van de Geer, Sara A. .
ANNALS OF STATISTICS, 2008, 36 (02) :614-645
[24]   High-dimensional additive hazards models and the Lasso [J].
Gaiffas, Stephane ;
Guilloux, Agathe .
ELECTRONIC JOURNAL OF STATISTICS, 2012, 6 :522-546
[25]   High-Dimensional LASSO-Based Computational Regression Models: Regularization, Shrinkage, and Selection [J].
Emmert-Streib, Frank ;
Dehmer, Matthias .
MACHINE LEARNING AND KNOWLEDGE EXTRACTION, 2019, 1 (01) :359-383
[26]   NON-ASYMPTOTIC ORACLE INEQUALITIES FOR THE HIGH-DIMENSIONAL COX REGRESSION VIA LASSO [J].
Kong, Shengchun ;
Nan, Bin .
STATISTICA SINICA, 2014, 24 (01) :25-42
[27]   Group Lasso Estimation of High-dimensional Covariance Matrices [J].
Bigot, Jeremie ;
Biscay, Rolando J. ;
Loubes, Jean-Michel ;
Muniz-Alvarez, Lilian .
JOURNAL OF MACHINE LEARNING RESEARCH, 2011, 12 :3187-3225
[28]   Change-Point Estimation in High Dimensional Linear Regression Models via Sparse Group Lasso [J].
Zhang, Bingwen ;
Geng, Jun ;
Lai, Lifeng .
2015 53RD ANNUAL ALLERTON CONFERENCE ON COMMUNICATION, CONTROL, AND COMPUTING (ALLERTON), 2015, :815-821
[29]   GFLASSO-LR: Logistic Regression with Generalized Fused LASSO for Gene Selection in High-Dimensional Cancer Classification [J].
Bir-Jmel, Ahmed ;
Douiri, Sidi Mohamed ;
Bernoussi, Souad El ;
Maafiri, Ayyad ;
Himeur, Yassine ;
Atalla, Shadi ;
Mansoor, Wathiq ;
Al-Ahmad, Hussain .
COMPUTERS, 2024, 13 (04)
[30]   Nonnegative adaptive lasso for ultra-high dimensional regression models and a two-stage method applied in financial modeling [J].
Yang, Yuehan ;
Wu, Lan .
JOURNAL OF STATISTICAL PLANNING AND INFERENCE, 2016, 174 :52-67