Variational Flow Graphical Model

被引:2
作者
Ren, Shaogang [1 ]
Karimi, Belhal [1 ]
Li, Dingcheng [1 ]
Li, Ping [1 ]
机构
[1] Baidu Res, Cognit Comp Lab, 10900 NE 8th St, Bellevue, WA 98004 USA
来源
PROCEEDINGS OF THE 28TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2022 | 2022年
关键词
variational inference; flow-based model; generative model; INFERENCE;
D O I
10.1145/3534678.3539450
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper introduces a novel approach embedding flow-based models in hierarchical structures. The proposed model learns the representation of high dimensional data via a message-passing scheme by integrating flow-based functions through variational inference. Meanwhile, our model produces a representation of the data using a lower dimension, thus overcoming the drawbacks of many flow-based models, usually requiring a high dimensional latent space involving many trivial variables. With the proposed aggregation nodes, our model provides a new approach for distribution modeling and numerical inference on datasets. Multiple experiments on synthetic and real-world datasets show the benefits of our proposed method and potentially broad applications.
引用
收藏
页码:1493 / 1503
页数:11
相关论文
共 55 条
[1]  
Arjovsky M., 2017, Towards principled methods for training generative adversarial networks
[2]  
Bengio Emmanuel, 2021, ARXIV211109266
[3]   Representation Learning: A Review and New Perspectives [J].
Bengio, Yoshua ;
Courville, Aaron ;
Vincent, Pascal .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (08) :1798-1828
[4]  
Bishop C., 2003, Advances in Neural Information Processing Systems, V15, P793
[5]  
Bishop Christopher M., 2006, Pattern recognition and machine learning
[6]   Variational Inference: A Review for Statisticians [J].
Blei, David M. ;
Kucukelbir, Alp ;
McAuliffe, Jon D. .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2017, 112 (518) :859-877
[7]  
BUCK SF, 1960, J ROY STAT SOC B, V22, P302
[8]  
Choi Y., 2020, Technical report
[9]   A differential approach to inference in Bayesian networks [J].
Darwiche, A .
JOURNAL OF THE ACM, 2003, 50 (03) :280-305
[10]   AND/OR search spaces for graphical models [J].
Dechter, Rina ;
Mateescu, Robert .
ARTIFICIAL INTELLIGENCE, 2007, 171 (2-3) :73-106