Convergence and sparsity of Lasso and group Lasso in high-dimensional generalized linear models

被引:0
|
作者
Lichun Wang
Yuan You
Heng Lian
机构
[1] Beijing Jiaotong University,Department of Mathematics
[2] Nanyang Technological University,Division of Mathematical Sciences, School of Physical and Mathematical Sciences
来源
Statistical Papers | 2015年 / 56卷
关键词
Grouped variables; Lasso penalty; Variable selection;
D O I
暂无
中图分类号
学科分类号
摘要
In this short paper, we investigate Lasso regularized generalized linear models in the “small n\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$n$$\end{document}, large p\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$p$$\end{document}” setting. While similar problems have been well-studied with SCAD penalty, the study of Lasso penalty is mostly restricted to the least squares loss function. Here we show the convergence rate of the Lasso penalized estimator as well as the sparsity property under suitable assumptions. We also extend the results to group Lasso regularized models when the variables are naturally grouped.
引用
收藏
页码:819 / 828
页数:9
相关论文
共 50 条
  • [1] Convergence and sparsity of Lasso and group Lasso in high-dimensional generalized linear models
    Wang, Lichun
    You, Yuan
    Lian, Heng
    STATISTICAL PAPERS, 2015, 56 (03) : 819 - 828
  • [2] Overlapping group lasso for high-dimensional generalized linear models
    Zhou, Shengbin
    Zhou, Jingke
    Zhang, Bo
    COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2019, 48 (19) : 4903 - 4917
  • [3] The sparsity and bias of the lasso selection in high-dimensional linear regression
    Zhang, Cun-Hui
    Huang, Jian
    ANNALS OF STATISTICS, 2008, 36 (04) : 1567 - 1594
  • [4] On the oracle property of adaptive group Lasso in high-dimensional linear models
    Zhang, Caiya
    Xiang, Yanbiao
    STATISTICAL PAPERS, 2016, 57 (01) : 249 - 265
  • [5] Moderately clipped LASSO for the high-dimensional generalized linear model
    Lee, Sangin
    Ku, Boncho
    Kown, Sunghoon
    COMMUNICATIONS FOR STATISTICAL APPLICATIONS AND METHODS, 2020, 27 (04) : 445 - 458
  • [6] The robust desparsified lasso and the focused information criterion for high-dimensional generalized linear models
    Pandhare, S. C.
    Ramanathan, T. V.
    STATISTICS, 2023, 57 (01) : 1 - 25
  • [7] Asymptotic properties of Lasso in high-dimensional partially linear models
    Ma Chi
    Huang Jian
    SCIENCE CHINA-MATHEMATICS, 2016, 59 (04) : 769 - 788
  • [8] AIC for the group Lasso in generalized linear models
    Komatsu, Satoshi
    Yamashita, Yuta
    Ninomiya, Yoshiyuki
    JAPANESE JOURNAL OF STATISTICS AND DATA SCIENCE, 2019, 2 (02) : 545 - 558
  • [9] AIC for the group Lasso in generalized linear models
    Satoshi Komatsu
    Yuta Yamashita
    Yoshiyuki Ninomiya
    Japanese Journal of Statistics and Data Science, 2019, 2 : 545 - 558
  • [10] Hi-LASSO: High-Dimensional LASSO
    Kim, Youngsoon
    Hao, Jie
    Mallavarapu, Tejaswini
    Park, Joongyang
    Kang, Mingon
    IEEE ACCESS, 2019, 7 : 44562 - 44573