Fast Variational Bayes Methods for Multinomial Probit Models

被引:4
|
作者
Loaiza-Maya, Ruben [1 ]
Nibbering, Didier [1 ,2 ]
机构
[1] Monash Univ, Dept Econometr & Business Stat, Clayton, Vic, Australia
[2] Monash Univ, Dept Econometr & Business Stat, Clayton, Vic 3800, Australia
关键词
Large choice datasets; Multinomial probit model; Variational inference; INFERENCE;
D O I
10.1080/07350015.2022.2139267
中图分类号
F [经济];
学科分类号
02 ;
摘要
The multinomial probit model is often used to analyze choice behavior. However, estimation with existing Markov chain Monte Carlo (MCMC) methods is computationally costly, which limits its applicability to large choice datasets. This article proposes a variational Bayes method that is accurate and fast, even when a large number of choice alternatives and observations are considered. Variational methods usually require an analytical expression for the unnormalized posterior density and an adequate choice of variational family. Both are challenging to specify in a multinomial probit, which has a posterior that requires identifying restrictions and is augmented with a large set of latent utilities. We employ a spherical transformation on the covariance matrix of the latent utilities to construct an unnormalized augmented posterior that identifies the parameters, and use the conditional posterior of the latent utilities as part of the variational family. The proposed method is faster than MCMC, and can be made scalable to both a large number of choice alternatives and a large number of observations. The accuracy and scalability of our method is illustrated in numerical experiments and real purchase data with one million observations.
引用
收藏
页码:1352 / 1363
页数:12
相关论文
共 50 条
  • [1] ADVERSARIAL VARIATIONAL BAYES METHODS FOR TWEEDIE COMPOUND POISSON MIXED MODELS
    Yang, Yaodong
    Luo, Rui
    Liu, Yuanyuan
    2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 3377 - 3381
  • [2] Fast and scalable variational Bayes estimation of spatial econometric models for Gaussian data
    Wu, Guohui
    SPATIAL STATISTICS, 2018, 24 : 32 - 53
  • [3] A Class of Conjugate Priors for Multinomial Probit Models which Includes the Multivariate Normal One
    Fasano, Augusto
    Durante, Daniele
    JOURNAL OF MACHINE LEARNING RESEARCH, 2022, 23
  • [4] Variational Bayes estimation of hierarchical Dirichlet-multinomial mixtures for text clustering
    Bilancia, Massimo
    Di Nanni, Michele
    Manca, Fabio
    Pio, Gianvito
    COMPUTATIONAL STATISTICS, 2023, 38 (04) : 2015 - 2051
  • [5] Variational Bayes estimation of hierarchical Dirichlet-multinomial mixtures for text clustering
    Massimo Bilancia
    Michele Di Nanni
    Fabio Manca
    Gianvito Pio
    Computational Statistics, 2023, 38 : 2015 - 2051
  • [6] Testing Homogeneity for Normal Mixture Models: Variational Bayes Approach
    Kariya, Natsuki
    Watanabe, Sumio
    IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES, 2020, E103A (11) : 1274 - 1282
  • [7] The Monte Carlo EM method for estimating multinomial probit latent variable models
    Xingcai Zhou
    Xinsheng Liu
    Computational Statistics, 2008, 23 : 277 - 289
  • [8] The Monte Carlo EM method for estimating multinomial probit latent variable models
    Zhou, Xingcai
    Liu, Xinsheng
    COMPUTATIONAL STATISTICS, 2008, 23 (02) : 277 - 289
  • [9] VARIATIONAL BAYES LEARNING OF MULTISCALE GRAPHICAL MODELS
    Yu, Hang
    Dauwels, Justin
    2015 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING (ICASSP), 2015, : 1891 - 1895
  • [10] Updating Variational Bayes: fast sequential posterior inference
    Nathaniel Tomasetti
    Catherine Forbes
    Anastasios Panagiotelis
    Statistics and Computing, 2022, 32