A variational Bayesian methodology for hidden Markov models utilizing Student's-t mixtures

被引:45
作者
Chatzis, Sotirios P. [1 ]
Kosmopoulos, Dimitrios I. [2 ]
机构
[1] Univ London Imperial Coll Sci Technol & Med, Dept Elect & Elect Engn, London SW7 2BT, England
[2] NSCR Dimokritos, Inst Informat & Telecommun, Athens 15310, Greece
关键词
Hidden Markov models; Student's-t distribution; Variational Bayes; Speaker identification; Robotic task failure; Violence detection; EM;
D O I
10.1016/j.patcog.2010.09.001
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The Student's-t hidden Markov model (SHMM) has been recently proposed as a robust to outliers form of conventional continuous density hidden Markov models, trained by means of the expectation-maximization algorithm. In this paper, we derive a tractable variational Bayesian inference algorithm for this model. Our innovative approach provides an efficient and more robust alternative to EM-based methods, tackling their singularity and overfitting proneness, while allowing for the automatic determination of the optimal model size without cross-validation. We highlight the superiority of the proposed model over the competition using synthetic and real data. We also demonstrate the merits of our methodology in applications from diverse research fields, such as human computer interaction, robotics and semantic audio analysis. (C) 2010 Elsevier Ltd. All rights reserved.
引用
收藏
页码:295 / 306
页数:12
相关论文
共 33 条
[1]  
[Anonymous], 2007, Uci machine learning repository
[2]  
[Anonymous], 2006, Pattern recognition and machine learning
[3]  
ARCHAMBEAU C, 2003, 11 EUR S ART NEUR NE, P99
[4]   Robust Bayesian clustering [J].
Archambeau, Cedric ;
Verleysen, Michel .
NEURAL NETWORKS, 2007, 20 (01) :129-138
[5]  
Attias H., 2000, P ANN C NEUR INF PRO
[6]   Audio thumbnailing of popular music using chroma-based representations [J].
Bartsch, MA ;
Wakefield, GH .
IEEE TRANSACTIONS ON MULTIMEDIA, 2005, 7 (01) :96-104
[7]  
Beal M.J., 2003, PhD. Thesis
[8]  
Bishop C.M., 2000, P C UNC ART INT, P46
[9]   Integration and learning in supervision of flexible assembly systems [J].
CamarinhaMatos, LM ;
Lopes, LS ;
Barata, J .
IEEE TRANSACTIONS ON ROBOTICS AND AUTOMATION, 1996, 12 (02) :202-219
[10]  
CAPPE O, 2005, SPR S STAT, P1