Bayes Variable Selection in Semiparametric Linear Models

被引:20
作者
Kundu, Suprateek [1 ]
Dunson, David B. [2 ]
机构
[1] Texas A&M Univ, Dept Stat, College Stn, TX 77843 USA
[2] Duke Univ, Dept Stat Sci, Durham, NC 27708 USA
关键词
Asymptotic theory; Bayes' factor; g-prior; Large p; small n; Model selection; Posterior consistency; Stochastic search variable selection; Subset selection; DIABETES-MELLITUS; CONSISTENCY; SHRINKAGE; MIXTURES;
D O I
10.1080/01621459.2014.881153
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
There is a rich literature on Bayesian variable selection for parametric models. Our focus is on generalizing methods and asymptotic theory established for mixtures of g-priors to semiparametric linear regression models having unknown residual densities. Using a Dirichlet process location mixture for the residual density, we propose a semiparametric g-prior which incorporates an unknown matrix of cluster allocation indicators. For this class of priors, posterior computation can proceed via a straightforward stochastic search variable selection algorithm. In addition, Bayes' factor and variable selection consistency is shown to result under a class of proper priors on g even when the number of candidate predictors p is allowed to increase much faster than sample size n, while making sparsity assumptions on the true model size.
引用
收藏
页码:437 / 447
页数:11
相关论文
共 28 条
[1]  
[Anonymous], 2009, 2009 INT WORKSH OBJ
[2]   MIXTURES OF DIRICHLET PROCESSES WITH APPLICATIONS TO BAYESIAN NONPARAMETRIC PROBLEMS [J].
ANTONIAK, CE .
ANNALS OF STATISTICS, 1974, 2 (06) :1152-1174
[3]   Posterior consistency in linear models under shrinkage priors [J].
Armagan, A. ;
Dunson, D. B. ;
Lee, J. ;
Bajwa, W. U. ;
Strawn, N. .
BIOMETRIKA, 2013, 100 (04) :1011-1018
[4]   β-cell ABCA1 influences insulin secretion, glucose homeostasis and response to thiazolidinedione treatment [J].
Brunham, Liam R. ;
Kruit, Janine K. ;
Pape, Terry D. ;
Timmins, Jenelle M. ;
Reuwer, Anne Q. ;
Vasanji, Zainisha ;
Marsh, Brad J. ;
Rodrigues, Brian ;
Johnson, James D. ;
Parks, John S. ;
Verchere, C. Bruce ;
Hayden, Michael R. .
NATURE MEDICINE, 2007, 13 (03) :340-347
[5]   CONSISTENCY OF BAYESIAN PROCEDURES FOR VARIABLE SELECTION [J].
Casella, George ;
Giron, F. Javier ;
Martinez, M. Lina ;
Moreno, Elias .
ANNALS OF STATISTICS, 2009, 37 (03) :1207-1228
[6]   NEEDLES AND STRAW IN A HAYSTACK: POSTERIOR CONCENTRATION FOR POSSIBLY SPARSE SEQUENCES [J].
Castillo, Ismael ;
van der Vaart, Aad .
ANNALS OF STATISTICS, 2012, 40 (04) :2069-2101
[7]   DIABETES-MELLITUS AND HYPERTENSION [J].
EPSTEIN, M ;
SOWERS, JR .
HYPERTENSION, 1992, 19 (05) :403-418
[8]   BAYESIAN ANALYSIS OF SOME NONPARAMETRIC PROBLEMS [J].
FERGUSON, TS .
ANNALS OF STATISTICS, 1973, 1 (02) :209-230
[9]  
George EI, 1997, STAT SINICA, V7, P339
[10]   Bayesian variable selection for high dimensional generalized linear models: Convergence rates of the fitted densities [J].
Jiang, Wenxin .
ANNALS OF STATISTICS, 2007, 35 (04) :1487-1511