Variational inference on a Bayesian adaptive lasso Tobit quantile regression model

被引:3
作者
Wang, Zhiqiang [1 ,2 ]
Wu, Ying [3 ,5 ]
Cheng, WeiLi [4 ]
机构
[1] LuoYang Normal Univ, Elect Commerce Coll, Luoyang, Peoples R China
[2] Luoyang Normal Univ, Henan Key Lab Big Data Proc & Analyt Elect Commerc, Luoyang, Peoples R China
[3] Yunnan Univ, Yunnan Key Lab Stat Modeling & Data Anal, Kunming, Peoples R China
[4] North China Univ Water Resources & Elect Power, Sch Math & Stat, Zhengzhou, Peoples R China
[5] Yunnan Univ, South Outer Ring Rd, Kunming 650500, Peoples R China
基金
中国国家自然科学基金;
关键词
Bayesian adaptive lasso; CAVI algorithm; ELBO; Tobit quantile regression; variational inference;
D O I
10.1002/sta4.563
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
The Tobit quantile regression model is a useful tool for quantifying the relationship between response variables with limited values and the explanatory variables. Under the Bayesian framework, the Tobit quantile regression model is often simulated by an asymmetric Laplacian distribution (ALD), which can be reformulated as a hierarchical structure model. An adaptive lasso prior is used to address the selection of active explanatory variables. A mean-field variational family is adopted, where the variables are assumed to be mutually independent with each being governed by a different factor in the variational density. A coordinate ascent variational inference (CAVI) algorithm is developed to iteratively optimize each factor, and the evidence lower bound (ELBO) is obtained. Parameter estimation and variable selection are simultaneously produced by the optimal variational density. Several simulation studies and an example are presented to illustrate the proposed methodologies.
引用
收藏
页数:13
相关论文
共 20 条
[1]   Bayesian tobit quantile regression with L1/2 penalty [J].
Alhamzawi, Rahim ;
Ali, Haithem Taha Mohammad .
COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 2018, 47 (06) :1739-1750
[2]   Bayesian adaptive Lasso quantile regression [J].
Alhamzawi, Rahim ;
Yu, Keming ;
Benoit, Dries F. .
STATISTICAL MODELLING, 2012, 12 (03) :279-297
[3]   Variational Inference: A Review for Statisticians [J].
Blei, David M. ;
Kucukelbir, Alp ;
McAuliffe, Jon D. .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2017, 112 (518) :859-877
[4]   Bayesian regularized quantile structural equation models [J].
Feng, Xiang-Nan ;
Wang, Yifan ;
Lu, Bin ;
Song, Xin-Yuan .
JOURNAL OF MULTIVARIATE ANALYSIS, 2017, 154 :234-248
[5]   Structure detection of semiparametric structural equation models with Bayesian adaptive group lasso [J].
Feng, Xiang-Nan ;
Wang, Guo-Chang ;
Wang, Yi-Fan ;
Song, Xin-Yuan .
STATISTICS IN MEDICINE, 2015, 34 (09) :1527-1547
[6]   A tutorial on variational Bayesian inference [J].
Fox, Charles W. ;
Roberts, Stephen J. .
ARTIFICIAL INTELLIGENCE REVIEW, 2012, 38 (02) :85-95
[7]   Bayesian Lasso for Semiparametric Structural Equation Models [J].
Guo, Ruixin ;
Zhu, Hongtu ;
Chow, Sy-Miin ;
Ibrahim, Joseph G. .
BIOMETRICS, 2012, 68 (02) :567-577
[8]   Bayesian mapping of genotype x expression interactions in quantitative and qualitative traits [J].
Hoti, F. ;
Sillanpaa, M. J. .
HEREDITY, 2006, 97 (01) :4-18
[9]  
Koenker Roger, 2005, QUANTILE REGRESSION, DOI DOI 10.1017/CBO9780511754098
[10]   Gibbs sampling methods for Bayesian quantile regression [J].
Kozumi, Hideo ;
Kobayashi, Genya .
JOURNAL OF STATISTICAL COMPUTATION AND SIMULATION, 2011, 81 (11) :1565-1578