A method for training finite mixture models under a fuzzy clustering principle

被引:9
作者
Chatzis, Sotirios [1 ]
机构
[1] Univ Miami, Ctr Computat Sci, Miami, FL 33146 USA
关键词
Learning; Fuzzy clustering; Fuzzy statistics and data analysis; EM;
D O I
10.1016/j.fss.2010.03.015
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
In this paper, we establish a novel regard towards fuzzy clustering, showing it provides a sound framework for fitting finite mixture models. We propose a novel fuzzy clustering-type methodology for finite mixture model fitting, effected by utilizing a regularized form of the fuzzy c-means (FCM) algorithm, and introducing a proper dissimilarity functional for the algorithm with respect to the probabilistic properties of the model being treated. We apply the proposed methodology in a number of popular finite mixture models, and the corresponding expressions of the fuzzy model fitting algorithm are derived. We examine the efficacy of our novel approach in both clustering and classification applications of benchmark data sets, and we demonstrate the advantages of the proposed approach over maximum-likelihood. (C) 2010 Elsevier B.V. All rights reserved.
引用
收藏
页码:3000 / 3013
页数:14
相关论文
共 19 条
[1]  
[Anonymous], 2007, Uci machine learning repository
[2]  
[Anonymous], 2003, ICML
[3]  
[Anonymous], Pattern Recognition with Fuzzy Objective Function Algorithms
[4]  
Bezdek J., 1999, FUZZY MODELS ALGORIT
[5]   MAXIMUM LIKELIHOOD FROM INCOMPLETE DATA VIA EM ALGORITHM [J].
DEMPSTER, AP ;
LAIRD, NM ;
RUBIN, DB .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-METHODOLOGICAL, 1977, 39 (01) :1-38
[6]   From a Gaussian mixture model to additive fuzzy systems [J].
Gan, MT ;
Hanmandlu, M ;
Tan, AH .
IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2005, 13 (03) :303-316
[7]   UNSUPERVISED OPTIMAL FUZZY CLUSTERING [J].
GATH, I ;
GEVA, AB .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1989, 11 (07) :773-781
[8]  
Ghahramani Z., 1997, Technical Repoort CRG-TR-96-1)
[9]   ANOTHER INTERPRETATION OF THE EM ALGORITHM FOR MIXTURE DISTRIBUTIONS [J].
HATHAWAY, RJ .
STATISTICS & PROBABILITY LETTERS, 1986, 4 (02) :53-56
[10]   Regularized linear fuzzy clustering and probabilistic PCA mixture models [J].
Honda, K ;
Ichihashi, H .
IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2005, 13 (04) :508-516