Simultaneous Lasso and Dantzig Selector in High Dimensional Nonparametric Regression

被引:0
作者
Wang, Shiqing [1 ]
Su, Limin [1 ]
机构
[1] North China Univ Water Resources & Elect Power, Coll Math & Informat Sci, Zhengzhou 450011, Henan, Peoples R China
来源
INTERNATIONAL JOURNAL OF APPLIED MATHEMATICS & STATISTICS | 2013年 / 42卷 / 12期
关键词
Linear model; sparsity; Lasso selector; Dantzig selector; oracle inequality; nonparametric regression model;
D O I
暂无
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
During the last few years, a great deal of attention has been focused on Lasso and Dantzig selector in high dimensional linear regression when the number of variables can be much larger than the sample size. Under a sparsity scenario, Bickel et al. (2009) showed that the Lasso estimator and the Dantzig selector exhibit similar behavior, and derived oracle inequalities for the prediction risk in the general nonparametric regression model, as well as bounds on the L-p estimation loss in the linear model. The Assumption RE(s, c) and Assumption RE(s,m,c) play a significant role in their paper. In this paper, the assumptions equivalent with Assumption RE(s, c) and Assumption RE (s,m,c) are given. More precise oracle inequalities for the prediction risk in the general nonparametric regression model and bounds on the L-p estimation loss in the linear model are derived when the number of variables can be much larger than the sample size.
引用
收藏
页码:103 / 118
页数:16
相关论文
共 50 条
[1]   The Oracle Inequalities on Simultaneous Lasso and Dantzig Selector in High-Dimensional Nonparametric Regression [J].
Wang, Shiqing ;
Su, Limin .
MATHEMATICAL PROBLEMS IN ENGINEERING, 2013, 2013
[2]   SIMULTANEOUS ANALYSIS OF LASSO AND DANTZIG SELECTOR [J].
Bickel, Peter J. ;
Ritov, Ya'acov ;
Tsybakov, Alexandre B. .
ANNALS OF STATISTICS, 2009, 37 (04) :1705-1732
[3]   A remark on the lasso and the Dantzig selector [J].
de Castro, Yohann .
STATISTICS & PROBABILITY LETTERS, 2013, 83 (01) :304-314
[4]   Transductive versions of the LASSO and the Dantzig Selector [J].
Alquier, Pierre ;
Hebiri, Mohamed .
JOURNAL OF STATISTICAL PLANNING AND INFERENCE, 2012, 142 (09) :2485-2500
[5]   DASSO: connections between the Dantzig selector and lasso [J].
James, Gareth M. ;
Radchenko, Peter ;
Lv, Jinchi .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 2009, 71 :127-142
[6]   A Multi-Stage Framework for Dantzig Selector and LASSO [J].
Liu, Ji ;
Wonka, Peter ;
Ye, Jieping .
JOURNAL OF MACHINE LEARNING RESEARCH, 2012, 13 :1189-1219
[7]   Rate Minimaxity of the Lasso and Dantzig Selector for the lq Loss in lr Balls [J].
Ye, Fei ;
Zhang, Cun-Hui .
JOURNAL OF MACHINE LEARNING RESEARCH, 2010, 11 :3519-3540
[8]   Selecting Informative Genes by Lasso and Dantzig Selector for Linear Classifiers [J].
Zheng, Songfeng ;
Liu, Weixiang .
2010 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE, 2010, :677-680
[9]   Optimal Designs for Lasso and Dantzig Selector Using Expander Codes [J].
de Castro, Yohann .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2014, 60 (11) :7293-7299
[10]   THE DANTZIG SELECTOR FOR CENSORED LINEAR REGRESSION MODELS [J].
Li, Yi ;
Dicker, Lee ;
Zhao, Sihai Dave .
STATISTICA SINICA, 2014, 24 (01) :251-U285