Robust Adaptive Lasso method for parameter's estimation and variable selection in high-dimensional sparse models

被引:16
|
作者
Wahid, Abdul [1 ]
Khan, Dost Muhammad [1 ]
Hussain, Ijaz [2 ]
机构
[1] Abdul Wali Khan Univ Mardan, Dept Stat, Khyber Pakhtunkhwa, Pakistan
[2] Quiad I Azam Univ Islamabad, Dept Stat, Islamabad, Pakistan
来源
PLOS ONE | 2017年 / 12卷 / 08期
关键词
LIKELIHOOD; REGRESSION; SHRINKAGE; FACE;
D O I
10.1371/journal.pone.0183518
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
High dimensional data are commonly encountered in various scientific fields and pose great challenges to modern statistical analysis. To address this issue different penalized regression procedures have been introduced in the litrature, but these methods cannot cope with the problem of outliers and leverage points in the heavy tailed high dimensional data. For this purppose, a new Robust Adaptive Lasso (RAL) method is proposed which is based on pearson residuals weighting scheme. The weight function determines the compatibility of each observations and downweight it if they are inconsistent with the assumed model. It is observed that RAL estimator can correctly select the covariates with non-zero coefficients and can estimate parameters, simultaneously, not only in the presence of influential observations, but also in the presence of high multicolliearity. We also discuss the model selection oracle property and the asymptotic normality of the RAL. Simulations findings and real data examples also demonstrate the better performance of the proposed penalized regression approach.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] ADAPTIVE LASSO FOR SPARSE HIGH-DIMENSIONAL REGRESSION MODELS
    Huang, Jian
    Ma, Shuangge
    Zhang, Cun-Hui
    STATISTICA SINICA, 2008, 18 (04) : 1603 - 1618
  • [2] The adaptive lasso in high-dimensional sparse heteroscedastic models
    Wagener J.
    Dette H.
    Mathematical Methods of Statistics, 2013, 22 (2) : 137 - 154
  • [3] Variable selection and estimation in high-dimensional models
    Horowitz, Joel L.
    CANADIAN JOURNAL OF ECONOMICS-REVUE CANADIENNE D ECONOMIQUE, 2015, 48 (02): : 389 - 407
  • [4] High-dimensional graphs and variable selection with the Lasso
    Meinshausen, Nicolai
    Buehlmann, Peter
    ANNALS OF STATISTICS, 2006, 34 (03): : 1436 - 1462
  • [5] An improved variable selection procedure for adaptive Lasso in high-dimensional survival analysis
    He, Kevin
    Wang, Yue
    Zhou, Xiang
    Xu, Han
    Huang, Can
    LIFETIME DATA ANALYSIS, 2019, 25 (03) : 569 - 585
  • [6] Bayesian adaptive lasso with variational Bayes for variable selection in high-dimensional generalized linear mixed models
    Dao Thanh Tung
    Minh-Ngoc Tran
    Tran Manh Cuong
    COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 2019, 48 (02) : 530 - 543
  • [7] An improved variable selection procedure for adaptive Lasso in high-dimensional survival analysis
    Kevin He
    Yue Wang
    Xiang Zhou
    Han Xu
    Can Huang
    Lifetime Data Analysis, 2019, 25 : 569 - 585
  • [8] A study on tuning parameter selection for the high-dimensional lasso
    Homrighausen, Darren
    McDonald, Daniel J.
    JOURNAL OF STATISTICAL COMPUTATION AND SIMULATION, 2018, 88 (15) : 2865 - 2892
  • [9] Robust adaptive LASSO in high-dimensional logistic regression
    Basu, Ayanendranath
    Ghosh, Abhik
    Jaenada, Maria
    Pardo, Leandro
    STATISTICAL METHODS AND APPLICATIONS, 2024,
  • [10] Weighted LAD-LASSO method for robust parameter estimation and variable selection in regression
    Arslan, Olcay
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2012, 56 (06) : 1952 - 1965