Online Data Clustering Using Variational Learning of a Hierarchical Dirichlet Process Mixture of Dirichlet Distributions

被引:5
作者
Fan, Wentao [1 ]
Bouguila, Nizar [1 ]
机构
[1] Concordia Univ, Concordia Inst Informat Syst Engn, Montreal, PQ, Canada
来源
DATABASE SYSTEMS FOR ADVANCED APPLICATIONS, DASFAA 2014 | 2014年 / 8505卷
关键词
Mixture models; Dirichlet distribution; Variational inference; Hierarchical Dirichlet process; Online learning; Image clustering; CLASSIFICATION; MODELS;
D O I
10.1007/978-3-662-43984-5_2
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper proposes an online clustering approach based on both hierarchical Dirichlet processes and Dirichlet distributions. The deployment of hierarchical Dirichlet processes allows to resolve difficulties related to model selection thanks to its nonparametric nature that arises in the face of unknown number of mixture components. The consideration of the Dirichlet distribution is justified by its high flexibility for non-Gaussian data modeling as shown in several previous works. The resulting statistical model is learned using variational Bayes and is evaluated via a challenging application namely images clustering. The obtained results show the merits of the proposed statistical framework.
引用
收藏
页码:18 / 32
页数:15
相关论文
共 35 条
[1]  
[Anonymous], 2011, P 14 INT C ART INT S
[2]  
[Anonymous], 2010, Bayesian Nonparametrics
[3]  
[Anonymous], 2004, P 2004WORKSHOP STAT
[4]  
[Anonymous], 2007, P MACH LEARN RES
[5]  
[Anonymous], 1983, RECNT ADV STAT
[6]  
[Anonymous], 2006, Pattern recognition and machine learning
[7]   Variational Inference for Dirichlet Process Mixtures [J].
Blei, David M. ;
Jordan, Michael I. .
BAYESIAN ANALYSIS, 2006, 1 (01) :121-143
[8]   Online clustering via finite mixtures of Dirichlet and minimum message length [J].
Bouguila, N ;
Ziou, D .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2006, 19 (04) :371-379
[9]   Using unsupervised learning of a finite Dirichlet mixture model to improve pattern recognition applications [J].
Bouguila, N ;
Ziou, D .
PATTERN RECOGNITION LETTERS, 2005, 26 (12) :1916-1925
[10]   Infinite Liouville mixture models with application to text and texture categorization [J].
Bouguila, Nizar .
PATTERN RECOGNITION LETTERS, 2012, 33 (02) :103-110