Variable selection in linear-circular regression models

被引:2
|
作者
Camli, Onur [1 ]
Kalaylioglu, Zeynep [1 ]
SenGupta, Ashis [2 ]
机构
[1] Middle East Tech Univ, Dept Stat, Ankara, Turkey
[2] Indian Stat Inst, Appl Stat Unit, Kolkata, India
关键词
Regularization; Bayesian lasso; laplace distribution; circular regression; dimension reduction; TUNING PARAMETER SELECTION; BAYESIAN-ANALYSIS; SHRINKAGE; LASSO; DISTRIBUTIONS;
D O I
10.1080/02664763.2022.2110860
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Applications of circular regression models are ubiquitous in many disciplines, particularly in meteorology, biology and geology. In circular regression models, variable selection problem continues to be a remarkable open question. In this paper, we address variable selection in linear-circular regression models where uni-variate linear dependent and a mixed set of circular and linear independent variables constitute the data set. We consider Bayesian lasso which is a popular choice for variable selection in classical linear regression models. We show that Bayesian lasso in linear-circular regression models is not able to produce robust inference as the coefficient estimates are sensitive to the choice of hyper-prior setting for the tuning parameter. To eradicate the problem, we propose a robustified Bayesian lasso that is based on an empirical Bayes (EB) type methodology to construct a hyper-prior for the tuning parameter while using Gibbs Sampling. This hyper-prior construction is computationally more feasible than the hyper-priors that are based on correlation measures. We show in a comprehensive simulation study that Bayesian lasso with EB-GS hyper-prior leads to a more robust inference. Overall, the method offers an efficient Bayesian lasso for variable selection in linear-circular regression while reducing model complexity.
引用
收藏
页码:3337 / 3361
页数:25
相关论文
共 50 条
  • [31] BUILDING VARIABLE SELECTION ENSEMBLES FOR LINEAR REGRESSION MODELS BY ADDING NOISE
    Wang, Guan-Wei
    Zhang, Chun-Xia
    PROCEEDINGS OF 2015 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOL. 2, 2015, : 554 - 559
  • [32] Finite mixture-based Bayesian analysis of linear-circular models
    SenGupta, Ashis
    Bhattacharya, Sourabh
    ENVIRONMENTAL AND ECOLOGICAL STATISTICS, 2015, 22 (04) : 667 - 679
  • [33] Variable selection in linear models
    Chen, Yuqi
    Du, Pang
    Wang, Yuedong
    WILEY INTERDISCIPLINARY REVIEWS-COMPUTATIONAL STATISTICS, 2014, 6 (01) : 1 - 9
  • [34] An Improved Forward Regression Variable Selection Algorithm for High-Dimensional Linear Regression Models
    Xie, Yanxi
    Li, Yuewen
    Xia, Zhijie
    Yan, Ruixia
    IEEE ACCESS, 2020, 8 (08): : 129032 - 129042
  • [35] Variable selection in logistic regression models
    Zellner, D
    Keller, F
    Zellner, GE
    COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 2004, 33 (03) : 787 - 805
  • [36] Variable selection in wavelet regression models
    Alsberg, BK
    Woodward, AM
    Winson, MK
    Rowland, JJ
    Kell, DB
    ANALYTICA CHIMICA ACTA, 1998, 368 (1-2) : 29 - 44
  • [37] Bayesian variable selection for regression models
    Kuo, L
    Mallick, B
    AMERICAN STATISTICAL ASSOCIATION - 1996 PROCEEDINGS OF THE SECTION ON BAYESIAN STATISTICAL SCIENCE, 1996, : 170 - 175
  • [38] Variable selection via generalized SELO-penalized linear regression models
    Shi Yue-yong
    Cao Yong-xiu
    Yu Ji-chang
    Jiao Yu-ling
    APPLIED MATHEMATICS-A JOURNAL OF CHINESE UNIVERSITIES SERIES B, 2018, 33 (02) : 145 - 162
  • [39] Bayesian variable selection in linear regression models with non-normal errors
    Saverio Ranciati
    Giuliano Galimberti
    Gabriele Soffritti
    Statistical Methods & Applications, 2019, 28 : 323 - 358
  • [40] A Novel Bagging Ensemble Approach for Variable Ranking and Selection for Linear Regression Models
    Zhang, Chun-Xia
    Zhang, Jiang-She
    Wang, Guan-Wei
    MULTIPLE CLASSIFIER SYSTEMS (MCS 2015), 2015, 9132 : 3 - 14