Robust L2E Parameter Estimation of Gaussian Mixture Models: Comparison with Expectation Maximization

被引:1
作者
Thayasivam, Umashanger [1 ]
Kuruwita, Chinthaka [2 ]
Ramachandran, Ravi P. [1 ]
机构
[1] Rowan Univ, Glassboro, NJ USA
[2] Hamilton Coll, Clinton, NY 13323 USA
来源
NEURAL INFORMATION PROCESSING, PT III | 2015年 / 9491卷
关键词
Robust L2E estimation; Gaussian mixture model; Expectation maximization; Unsupervised learning; Big data; MAXIMUM-LIKELIHOOD; DENSITY;
D O I
10.1007/978-3-319-26555-1_32
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The purpose of this paper is to discuss the use of L2E estimation that minimizes integrated square distance as a practical robust estimation tool for unsupervised clustering. Comparisons to the expectation maximization (EM) algorithm are made. The L2E approach for mixture models is particularly useful in the study of big data sets and especially those with a consistent numbers of outliers. The focus is on the comparison of L2E and EM for parameter estimation of Gaussian Mixture Models. Simulation examples show that the L2E approach is more robust than EM when there is noise in the data (particularly outliers) and for the case when the underlying probability density function of the data does not match a mixture of Gaussians.
引用
收藏
页码:281 / 288
页数:8
相关论文
共 18 条
[1]   MIXTURE-MODELS, OUTLIERS, AND THE EM ALGORITHM [J].
AITKIN, M ;
WILSON, GT .
TECHNOMETRICS, 1980, 22 (03) :325-331
[2]  
[Anonymous], 2011, R LANG ENV STAT COMP
[3]   Robust and efficient estimation by minimising a density power divergence [J].
Basu, A ;
Harris, IR ;
Hjort, NL ;
Jones, MC .
BIOMETRIKA, 1998, 85 (03) :549-559
[4]  
BOWMAN AW, 1984, BIOMETRIKA, V71, P353
[5]   MAXIMUM LIKELIHOOD FROM INCOMPLETE DATA VIA EM ALGORITHM [J].
DEMPSTER, AP ;
LAIRD, NM ;
RUBIN, DB .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-METHODOLOGICAL, 1977, 39 (01) :1-38
[6]   Weighted likelihood equations with bootstrap root search [J].
Markatou, M ;
Basu, A ;
Lindsay, BG .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1998, 93 (442) :740-750
[7]  
McLachlan GJ., 2000, WILEY SER PROB STAT, DOI 10.1002/0471721182
[8]  
RUDEMO M, 1982, SCAND J STAT, V9, P65
[9]  
Scott D.W., 2004, COMPSTAT S
[10]  
Scott D.W., 1999, COMPUTING SCI STAT, P104