Variational Bayesian EM Algorithm for Quantile Regression in Linear Mixed Effects Models

被引:0
作者
Wang, Weixian [1 ]
Tian, Maozai [2 ]
机构
[1] Cent Univ Finance & Econ, Sch Stat & Math, Beijing 102206, Peoples R China
[2] Xinjiang Med Univ, Dept Med Engn & Technol, Urumqi 830011, Peoples R China
基金
北京市自然科学基金;
关键词
mixed effects models; normal-beta prime prior; variational Bayesian EM algorithm;
D O I
10.3390/math12213311
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
This paper extends the normal-beta prime (NBP) prior to Bayesian quantile regression in linear mixed effects models and conducts Bayesian variable selection for the fixed effects of the model. The choice of hyperparameters in the NBP prior is crucial, and we employed the Variational Bayesian Expectation-Maximization (VBEM) for model estimation and variable selection. The Gibbs sampling algorithm is a commonly used Bayesian method, and it can also be combined with the EM algorithm, denoted as GBEM. The results from our simulation and real data analysis demonstrate that both the VBEM and GBEM algorithms provide robust estimates for the hyperparameters in the NBP prior, reflecting the sparsity level of the true model. The VBEM and GBEM algorithms exhibit comparable accuracy and can effectively select important explanatory variables. The VBEM algorithm stands out in terms of computational efficiency, significantly reducing the time and resource consumption in the Bayesian analysis of high-dimensional, longitudinal data.
引用
收藏
页数:16
相关论文
共 24 条
  • [1] Bayesian adaptive Lasso quantile regression
    Alhamzawi, Rahim
    Yu, Keming
    Benoit, Dries F.
    [J]. STATISTICAL MODELLING, 2012, 12 (03) : 279 - 297
  • [2] ON THE BETA PRIME PRIOR FOR SCALE PARAMETERS IN HIGH-DIMENSIONAL BAYESIAN REGRESSION MODELS
    Bai, Ray
    Ghosh, Malay
    [J]. STATISTICA SINICA, 2021, 31 (02) : 843 - 865
  • [3] Variational Inference: A Review for Statisticians
    Blei, David M.
    Kucukelbir, Alp
    McAuliffe, Jon D.
    [J]. JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2017, 112 (518) : 859 - 877
  • [4] High-Dimensional Variable Selection for Quantile Regression Based on Variational Bayesian Method
    Dai, Dengluan
    Tang, Anmin
    Ye, Jinli
    [J]. MATHEMATICS, 2023, 11 (10)
  • [5] Cluster analysis and display of genome-wide expression patterns
    Eisen, MB
    Spellman, PT
    Brown, PO
    Botstein, D
    [J]. PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 1998, 95 (25) : 14863 - 14868
  • [6] Regularization Paths for Generalized Linear Models via Coordinate Descent
    Friedman, Jerome
    Hastie, Trevor
    Tibshirani, Rob
    [J]. JOURNAL OF STATISTICAL SOFTWARE, 2010, 33 (01): : 1 - 22
  • [7] Giraud C., 2021, Introduction to High-Dimensional Statistics, DOI DOI 10.1201/9781003158745
  • [8] Decoupling Shrinkage and Selection in Bayesian Linear Models: A Posterior Summary Perspective
    Hahn, P. Richard
    Carvalho, Carlos M.
    [J]. JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2015, 110 (509) : 435 - 448
  • [9] Huang XC, 2016, Arxiv, DOI arXiv:1602.07640
  • [10] Bayesian variable selection in linear quantile mixed models for longitudinal data with application to macular degeneration
    Ji, Yonggang
    Shi, Haifang
    [J]. PLOS ONE, 2020, 15 (10):