Robust Improper Maximum Likelihood: Tuning, Computation, and a Comparison With Other Methods for Robust Gaussian Clustering

被引:44
作者
Coretto, Pietro [1 ]
Hennig, Christian [2 ]
机构
[1] Univ Salerno, Dept Econ & Stat, I-84084 Fisciano, SA, Italy
[2] UCL, Dept Stat Sci, London, England
基金
英国工程与自然科学研究理事会;
关键词
Cluster analysis; EM-algorithm; Improper density; Mixture models; Model-based clustering; Robustness; MIXTURE; IDENTIFICATION; ESTIMATORS; POINT;
D O I
10.1080/01621459.2015.1100996
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
The two main topics of this article are the introduction of the "optimally tuned robust improper maximum likelihood estimator" (OTRIMLE) for robust clustering based on the multivariate Gaussian model for clusters, and a comprehensive simulation study comparing the OTRIMLE to maximum likelihood in Gaussian mixtures with and without noise component, mixtures oft-distributions, and the TCLUST approach for trimmed clustering. The OTRIMLE uses an improper constant density for modeling outliers and noise. This can be chosen optimally so that the nonnoise part of the data looks as close to a Gaussian mixture as possible. Some deviation from Gaussianity can be traded in for lowering the estimated noise proportion. Covariance matrix constraints and computation of the OTRIMLE are also treated. In the simulation study, all methods are confronted with setups in which their model assumptions are not exactly fulfilled, and to evaluate the experiments in a standardized way by misclassification rates, a new model-based definition of "true clusters" is introduced that deviates from the usual identification of mixture components with clusters. In the study, every method turns out to be superior for one or more setups, but the OTRIMLE achieves the most satisfactory overall performance. The methods are also applied to two real datasets, one without and one with known "true" clusters. Supplementary materials for this article are available online.
引用
收藏
页码:1648 / 1659
页数:12
相关论文
共 39 条
[1]   A review of robust clustering methods [J].
Angel Garcia-Escudero, Luis ;
Gordaliza, Alfonso ;
Matran, Carlos ;
Mayo-Iscar, Agustin .
ADVANCES IN DATA ANALYSIS AND CLASSIFICATION, 2010, 4 (2-3) :89-109
[2]  
[Anonymous], 2012, Technical Report No. 597
[3]   MODEL-BASED GAUSSIAN AND NON-GAUSSIAN CLUSTERING [J].
BANFIELD, JD ;
RAFTERY, AE .
BIOMETRICS, 1993, 49 (03) :803-821
[4]  
Becker C, 1999, J AM STAT ASSOC, V94, P947
[5]   Nearest-neighbor clutter removal for estimating features in spatial point processes [J].
Byers, S ;
Raftery, AE .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1998, 93 (442) :577-584
[6]   Central limit theorem and influence function for the MCD estimators at general multivariate distributions [J].
Cator, Eric A. ;
Lopuhaa, Hendrik P. .
BERNOULLI, 2012, 18 (02) :520-551
[7]  
Coretto P., CONSISTENT IN PRESS
[8]  
Coretto P., ROBUST IM IN PRESS S
[9]   A simulation study to compare robust clustering methods based on mixtures [J].
Coretto, Pietro ;
Hennig, Christian .
ADVANCES IN DATA ANALYSIS AND CLASSIFICATION, 2010, 4 (2-3) :111-135
[10]   Influence function and efficiency of the minimum covariance determinant scatter matrix estimator [J].
Croux, C ;
Haesbroeck, G .
JOURNAL OF MULTIVARIATE ANALYSIS, 1999, 71 (02) :161-190