Fast Variational Bayes Methods for Multinomial Probit Models

被引:4
|
作者
Loaiza-Maya, Ruben [1 ]
Nibbering, Didier [1 ,2 ]
机构
[1] Monash Univ, Dept Econometr & Business Stat, Clayton, Vic, Australia
[2] Monash Univ, Dept Econometr & Business Stat, Clayton, Vic 3800, Australia
关键词
Large choice datasets; Multinomial probit model; Variational inference; INFERENCE;
D O I
10.1080/07350015.2022.2139267
中图分类号
F [经济];
学科分类号
02 ;
摘要
The multinomial probit model is often used to analyze choice behavior. However, estimation with existing Markov chain Monte Carlo (MCMC) methods is computationally costly, which limits its applicability to large choice datasets. This article proposes a variational Bayes method that is accurate and fast, even when a large number of choice alternatives and observations are considered. Variational methods usually require an analytical expression for the unnormalized posterior density and an adequate choice of variational family. Both are challenging to specify in a multinomial probit, which has a posterior that requires identifying restrictions and is augmented with a large set of latent utilities. We employ a spherical transformation on the covariance matrix of the latent utilities to construct an unnormalized augmented posterior that identifies the parameters, and use the conditional posterior of the latent utilities as part of the variational family. The proposed method is faster than MCMC, and can be made scalable to both a large number of choice alternatives and a large number of observations. The accuracy and scalability of our method is illustrated in numerical experiments and real purchase data with one million observations.
引用
收藏
页码:1352 / 1363
页数:12
相关论文
共 50 条
  • [41] Bernstein flows for flexible posteriors in variational Bayes
    Duerr, Oliver
    Hoertling, Stefan
    Dold, Danil
    Kovylov, Ivonne
    Sick, Beate
    ASTA-ADVANCES IN STATISTICAL ANALYSIS, 2024, 108 (02) : 375 - 394
  • [42] Loss-Based Variational Bayes Prediction
    Frazier, David T.
    Loaiza-Maya, Ruben
    Martin, Gael M.
    Koo, Bonsoo
    JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2025, 34 (01) : 84 - 95
  • [43] Variational Multinomial Logit Gaussian Process
    Chai, Kian Ming A.
    JOURNAL OF MACHINE LEARNING RESEARCH, 2012, 13 : 1745 - 1808
  • [44] Parallel Variational Bayes for Large Datasets With an Application to Generalized Linear Mixed Models
    Minh-Ngoc Tran
    Nan, David J.
    Kuk, Anthony Y. C.
    Kohn, Robert
    JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2016, 25 (02) : 626 - 646
  • [45] Scalable and accurate variational Bayes for high-dimensional binary regression models
    Fasano, Augusto
    Durante, Daniele
    Zanella, Giacomo
    BIOMETRIKA, 2022, 109 (04) : 901 - 919
  • [46] Frequentist Consistency of Variational Bayes
    Wang, Yixin
    Blei, David M.
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2019, 114 (527) : 1147 - 1161
  • [47] Variational Bayes With Intractable Likelihood
    Minh-Ngoc Tran
    Nott, David J.
    Kohn, Robert
    JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2017, 26 (04) : 873 - 882
  • [48] Variational Bayes with synthetic likelihood
    Ong, Victor M. H.
    Nott, David J.
    Minh-Ngoc Tran
    Sisson, Scott A.
    Drovandi, Christopher C.
    STATISTICS AND COMPUTING, 2018, 28 (04) : 971 - 988
  • [49] The maximum approximate composite marginal likelihood (MACML) estimation of multinomial probit-based unordered response choice models
    Bhat, Chandra R.
    TRANSPORTATION RESEARCH PART B-METHODOLOGICAL, 2011, 45 (07) : 923 - 939
  • [50] Nested Expectation Propagation for Gaussian Process Classification with a Multinomial Probit Likelihood
    Riihimaki, Jaakko
    Jylanki, Pasi
    Vehtari, Aki
    JOURNAL OF MACHINE LEARNING RESEARCH, 2013, 14 : 75 - 109