A caveat on the Savage-Dickey density ratio: The case of computing Bayes factors for regression parameters

被引:29
作者
Heck, Daniel W. [1 ]
机构
[1] Univ Mannheim, Stat Modeling Psychol, B6,30-32, D-68159 Mannheim, Germany
关键词
Hypothesis test; Bayesian model selection; marginal likelihood; variable selection; Jeffreys-Zellner-Siow prior; general linear model; HYPOTHESES; TESTS;
D O I
10.1111/bmsp.12150
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
The Savage-Dickey density ratio is a simple method for computing the Bayes factor for an equality constraint on one or more parameters of a statistical model. In regression analysis, this includes the important scenario of testing whether one or more of the covariates have an effect on the dependent variable. However, the Savage-Dickey ratio only provides the correct Bayes factor if the prior distribution of the nuisance parameters under the nested model is identical to the conditional prior under the full model given the equality constraint. This condition is violated for multiple regression models with a Jeffreys-Zellner-Siow prior, which is often used as a default prior in psychology. Besides linear regression models, the limitation of the Savage-Dickey ratio is especially relevant when analytical solutions for the Bayes factor are not available. This is the case for generalized linear models, non-linear models, or cognitive process models with regression extensions. As a remedy, the correct Bayes factor can be computed using a generalized version of the Savage-Dickey density ratio.
引用
收藏
页码:316 / 333
页数:18
相关论文
共 33 条
[1]  
[Anonymous], 1998, THEORY PROBABILITY
[2]  
Bailey DH, 2009, HUM NATURE-INT BIOS, V20, P67, DOI 10.1007/s12110-008-9054-0
[3]   CRITERIA FOR BAYESIAN MODEL CHOICE WITH APPLICATION TO VARIABLE SELECTION [J].
Bayarri, M. J. ;
Berger, J. O. ;
Forte, A. ;
Garcia-Donato, G. .
ANNALS OF STATISTICS, 2012, 40 (03) :1550-1577
[4]   Using Bayesian regression to test hypotheses about relationships between parameters and covariates in cognitive models [J].
Boehm, Udo ;
Steingroever, Helen ;
Wagenmakers, Eric-Jan .
BEHAVIOR RESEARCH METHODS, 2018, 50 (03) :1248-1269
[5]   Stan: A Probabilistic Programming Language [J].
Carpenter, Bob ;
Gelman, Andrew ;
Hoffman, Matthew D. ;
Lee, Daniel ;
Goodrich, Ben ;
Betancourt, Michael ;
Brubaker, Marcus A. ;
Guo, Jiqiang ;
Li, Peter ;
Riddell, Allen .
JOURNAL OF STATISTICAL SOFTWARE, 2017, 76 (01) :1-29
[6]   Compatibility of Prior Specifications Across Linear Models [J].
Consonni, Guido ;
Veronese, Piero .
STATISTICAL SCIENCE, 2008, 23 (03) :332-353
[7]   Computing Bayes factors by combining simulation and asymptotic approximations [J].
DiCiccio, TJ ;
Kass, RE ;
Raftery, A ;
Wasserman, L .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1997, 92 (439) :903-915
[8]   WEIGHTED LIKELIHOOD RATIO, SHARP HYPOTHESES ABOUT CHANCES, ORDER OF A MARKOV CHAIN [J].
DICKEY, JM ;
LIENTZ, BP .
ANNALS OF MATHEMATICAL STATISTICS, 1970, 41 (01) :214-&
[9]   On the Conditional Distribution of the Multivariate t Distribution [J].
Ding, Peng .
AMERICAN STATISTICIAN, 2016, 70 (03) :293-295
[10]  
Gronau Q. F., PSYCHOMETRIKA