An efficient ECM algorithm for maximum likelihood estimation in mixtures of t-factor analyzers

被引:0
作者
Wan-Lun Wang
Tsung-I Lin
机构
[1] Feng Chia University,Department of Statistics
[2] National Chung Hsing University,Institute of Statistics
[3] China Medical University,Department of Public Health
来源
Computational Statistics | 2013年 / 28卷
关键词
AECM algorithm; ECM algorithm; EM algorithm; Maximum likelihood estimation; MFA; MtFA;
D O I
暂无
中图分类号
学科分类号
摘要
Mixture of t factor analyzers (MtFA) have been shown to be a sound model-based tool for robust clustering of high-dimensional data. This approach, which is deemed to be one of natural parametric extensions with respect to normal-theory models, allows for accommodation of potential noise components, atypical observations or data with longer-than-normal tails. In this paper, we propose an efficient expectation conditional maximization (ECM) algorithm for fast maximum likelihood estimation of MtFA. The proposed algorithm inherits all appealing properties of the ordinary EM algorithm such as its stability and monotonicity, but has a faster convergence rate since its CM steps are governed by a much smaller fraction of missing information. Numerical experiments based on simulated and real data show that the new procedure outperforms the commonly used EM and AECM algorithms substantially in most of the situations, regardless of how the convergence speed is assessed by the computing time or number of iterations.
引用
收藏
页码:751 / 769
页数:18
相关论文
共 60 条
[1]  
Celeux G(2001)A component-wise EM algorithm for mixtures J Comput Graph Statist 10 697-712
[2]  
Chrétien S(1977)Maximum likelihood from incomplete data via the EM algorithm (with discussion) J R Stat Soc Ser B 39 1-38
[3]  
Forbes F(1994)Space-alternating generalized expectation-maximisation algorithm IEEE Tran Sig Proc 42 2664-2677
[4]  
Mkhadri A(2012)Maximum likelihood inference for mixtures of skew Student- Stat Comput 22 287-299
[5]  
Dempster AP(1993)-normal distributions through practical EM-type algorithms J Am Stat Assoc 88 221-228
[6]  
Laird NM(2009)Conjugate gradient acceleration of the EM algorithm J Multivar Anal 100 257-265
[7]  
Rubin DB(2010)Maximum likelihood estimation for multivariate skew normal mixture models (In press) Stat Comput 20 343-356
[8]  
Fessler JA(2009)Robust mixture modeling using multivariate skew Comp Stat 24 375-392
[9]  
Hero AO(2004) distributions Stat Comput 14 119-130
[10]  
Ho HJ(2010)Computationally efficient learning of multivariate Comput Stat 25 183-201