Variational Bayesian multinomial probit model with Gaussian process classification on mice protein expression level data

被引:1
作者
Son, Donghyun [1 ]
Hwang, Beom Seuk [1 ,2 ]
机构
[1] Chung Ang Univ, Dept Appl Stat, Seoul, South Korea
[2] Chung Ang Univ, Dept Appl Stat, 84 Heukseok Ro, Seoul, South Korea
基金
新加坡国家研究基金会;
关键词
variational Bayesian approximation; Gaussian process; multinomial probit model; latent variable; REGRESSION;
D O I
10.5351/KJAS.2023.36.2.115
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Multinomial probit model is a popular model for multiclass classification and choice model. Markov chain Monte Carlo (MCMC) method is widely used for estimating multinomial probit model, but its computational cost is high. However, it is well known that variational Bayesian approximation is more computationally efficient than MCMC, because it uses subsets of samples. In this study, we describe multinomial probit model with Gaussian process classification and how to employ variational Bayesian approximation on the model. This study also compares the results of variational Bayesian multinomial probit model to the results of naive Bayes, K-nearest neighbors and support vector machine for the UCI mice protein expression level data.
引用
收藏
页数:14
相关论文
共 16 条
[1]   BAYESIAN-ANALYSIS OF BINARY AND POLYCHOTOMOUS RESPONSE DATA [J].
ALBERT, JH ;
CHIB, S .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1993, 88 (422) :669-679
[2]  
[Anonymous], 2014, R LANG ENV STAT COMP, V2014
[3]  
Beal M.J., 2003, Variational algorithms for approximate Bayesian inference
[4]   Variational Inference: A Review for Statisticians [J].
Blei, David M. ;
Kucukelbir, Alp ;
McAuliffe, Jon D. .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2017, 112 (518) :859-877
[5]   Variational Bayesian multinomial probit regression with gaussian process priors [J].
Girolami, Mark ;
Rogers, Simon .
NEURAL COMPUTATION, 2006, 18 (08) :1790-1817
[6]   CONDITIONAL PROBIT MODEL FOR QUALITATIVE CHOICE - DISCRETE DECISIONS RECOGNIZING INTERDEPENDENCE AND HETEROGENEOUS PREFERENCES [J].
HAUSMAN, JA ;
WISE, DA .
ECONOMETRICA, 1978, 46 (02) :403-426
[7]   Self-Organizing Feature Maps Identify Proteins Critical to Learning in a Mouse Model of Down Syndrome [J].
Higuera, Clara ;
Gardiner, Katheleen J. ;
Cios, Krzysztof J. .
PLOS ONE, 2015, 10 (06)
[8]   An introduction to variational methods for graphical models [J].
Jordan, MI ;
Ghahramani, Z ;
Jaakkola, TS ;
Saul, LK .
MACHINE LEARNING, 1999, 37 (02) :183-233
[9]   Accurate prediction of BRCA1 and BRCA2 heterozygous genotype using expression profiling after induced DNA damage [J].
Kote-Jarai, Zsofia ;
Matthews, Lucy ;
Osorio, Ana ;
Shanley, Susan ;
Giddings, Ian ;
Moreews, Francois ;
Locke, Imogen ;
Evans, D. Gareth ;
Eccles, Diana .
CLINICAL CANCER RESEARCH, 2006, 12 (13) :3896-3901
[10]  
Lama N, 2022, VBMP VARIATIONAL BAY