A novelty Bayesian method for unsupervised learning offinite mixture models

被引:0
作者
Dai, H [1 ]
Ma, WM [1 ]
机构
[1] Xi An Jiao Tong Univ, Sch Management, Xian 710049, Peoples R China
来源
PROCEEDINGS OF THE 2004 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-7 | 2004年
关键词
Bayesian method; mixture models; parameters estimation;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Mixture models have universal applications in probabilistic modeling for multivariate data. This paper proposes a novelty parameters estimation and model selection method based on half Bayesian. In our algorithm, the mixture coefficient is a determinate variable, and the parameters of the components are random variables. Owing to the special prior distribution of the parameters, the parameters don't converge toward a singular estimation at the boundary of the parameter space, and the redundant components can be automatically removed. In a word, our algorithm has very good performances as follows: (1) automatically selects the number of components, (2) avoids converging the boundary of the parameter space, (3) is less sensitive to initialization, (4) can fulfill simultaneously the parameters estimation and model selection in one algorithm, therefore, the computation efficiency is higher. The experimental results show that the algorithm is effective and has above good performances.
引用
收藏
页码:3574 / 3578
页数:5
相关论文
共 5 条
[1]  
ATTIAS H, P 15 C UNC ART INT
[2]   Unsupervised learning of finite mixture models [J].
Figueiredo, MAT ;
Jain, AK .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2002, 24 (03) :381-396
[3]   Schwarz, Wallace, and Rissanen: Intertwining themes in theories of model selection [J].
Lanterman, AD .
INTERNATIONAL STATISTICAL REVIEW, 2001, 69 (02) :185-212
[4]   SMEM algorithm for mixture models [J].
Ueda, N ;
Nakano, R ;
Ghahramani, Z ;
Hinton, GE .
NEURAL COMPUTATION, 2000, 12 (09) :2109-2128
[5]   Deterministic annealing EM algorithm [J].
Ueda, N ;
Nakano, R .
NEURAL NETWORKS, 1998, 11 (02) :271-282