Fuzzy clustering to estimate the parameters of block mixture models

被引:15
作者
Govaert, G
Nadif, M
机构
[1] Univ Technol Compiegne, CNRS, UMR 6599, HEUDIASYC, F-60205 Compiegne, France
[2] Univ Metz, IUT Metz, LITA, F-57045 Metz, France
关键词
block clustering; mixture model; CEM algorithm; EM algorithm; fuzzy criterion;
D O I
10.1007/s00500-005-0502-z
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Finite mixture models are being increasingly used to provide model-based cluster analysis. To tackle the problem of block clustering which aims to organize the data into homogeneous blocks, recently we have proposed a block mixture model; we have considered this model under the classification maximum likelihood approach and we have developed a new algorithm for simultaneous partitioning based on the classification EM algorithm. From the estimation point of view, classification maximum likelihood approach yields inconsistent estimates of the parameters and in this paper we consider the block clustering problem under the maximum likelihood approach; unfortunately, the application of the classical EM algorithm for the block mixture model is not direct: difficulties arise due to the dependence structure in the model and approximations are required. Considering the block clustering problem under a fuzzy approach, we propose a fuzzy block clustering algorithm to approximate the EM algorithm. To illustrate our approach, we study the case of binary data by using a Bernoulli block mixture.
引用
收藏
页码:415 / 422
页数:8
相关论文
共 24 条
[1]  
AMBROISE C, 2000, COMPST 2000 P COMP S, P186
[2]  
[Anonymous], 1977, INRIA
[3]  
[Anonymous], EM ALGORITHM
[4]  
[Anonymous], Pattern Recognition With Fuzzy Objective Function Algorithms
[5]   NUMERICAL TAXONOMY WITH FUZZY SETS [J].
BEZDEK, JC .
JOURNAL OF MATHEMATICAL BIOLOGY, 1974, 1 (01) :57-71
[6]  
BOCK H, 1979, ANAL DONNEES INFORM, P187
[7]   ASYMPTOTIC-BEHAVIOR OF CLASSIFICATION MAXIMUM LIKELIHOOD ESTIMATES [J].
BRYANT, P ;
WILLIAMSON, JA .
BIOMETRIKA, 1978, 65 (02) :273-281
[8]   LARGE-SAMPLE RESULTS FOR OPTIMIZATION-BASED CLUSTERING METHODS [J].
BRYANT, PG .
JOURNAL OF CLASSIFICATION, 1991, 8 (01) :31-44
[9]  
BRYANT PG, 1986, CLASSIFICATION TOOL, P35
[10]   A CLASSIFICATION EM ALGORITHM FOR CLUSTERING AND 2 STOCHASTIC VERSIONS [J].
CELEUX, G ;
GOVAERT, G .
COMPUTATIONAL STATISTICS & DATA ANALYSIS, 1992, 14 (03) :315-332