Reparameterizing the generalized linear model to accelerate Gibbs sampler convergence

被引:63
作者
Nandram, B
Chen, MH
机构
[1] Department of Mathematical Sciences, Worcester Polytechnic Institute, Worcester, MA 01609
基金
美国国家科学基金会;
关键词
convergence; dirichlet distribution; latent variable; multinomial; potential scale reductions; proposal density;
D O I
10.1080/00949659608811724
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Albert and Chib introduced a complete Bayesian method to analyze data arising from the generalized linear model in which they used the Gibbs sampling algorithm facilitated by latent variables. Recently, Cowles proposed an alternative algorithm to accelerate the convergence of the Albert-Chib algorithm. The novelty in this latter algorithm is achieved by using a Hastings algorithm to generate latent variables and bin boundary parameters jointly instead of individually from their respective full conditionals. In the same spirit, we reparameterize the cumulative-link generalized linear model to accelerate the convergence of Cowles' algorithm even further. One important advantage of our method is that for the three-bin problem it does not require the Hastings algorithm. In addition, for problems with more than three bins, while the Hastings algorithm is required, we provide a proposal density based on the Dirichlet distribution which is more natural than the truncated normal density used in the competing algorithm. Also, using diagnostic procedures recommended in the literature for the Markov chain Monte Carlo algorithm (bath single and multiple runs) we show that our algorithm is substantially better than the one recently obtained. Precisely, our algorithm provides faster convergence and smaller autocorrelations between the iterates. Using the probit link function, extensive results are obtained for the three-bin and the five-bin multinomial ordinal data problems.
引用
收藏
页码:129 / 144
页数:16
相关论文
共 17 条
  • [1] BAYESIAN-ANALYSIS OF BINARY AND POLYCHOTOMOUS RESPONSE DATA
    ALBERT, JH
    CHIB, S
    [J]. JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1993, 88 (422) : 669 - 679
  • [2] [Anonymous], APPL STAT, DOI DOI 10.2307/2347565
  • [3] Bartholomew DJ., 1987, LATENT VARIABLE MODE
  • [4] BESAG J, 1993, J ROY STAT SOC B MET, V55, P25
  • [5] CHEN MH, 1995, BAYESIAN PREDICTION
  • [6] CHEN MH, 1994, P SECT BAY STAT SCI, P84
  • [7] Cowles M. K., 1994, 94001 U NEBR MED CTR
  • [8] COWLES MK, 1995, IN PRESS J AM STAT A
  • [9] SAMPLING-BASED APPROACHES TO CALCULATING MARGINAL DENSITIES
    GELFAND, AE
    SMITH, AFM
    [J]. JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1990, 85 (410) : 398 - 409
  • [10] Gelman A., 1992, Stat. Sci., V7, P457, DOI DOI 10.1214/SS/1177011136