A variational Bayesian methodology for hidden Markov models utilizing Student's-t mixtures

被引:44
|
作者
Chatzis, Sotirios P. [1 ]
Kosmopoulos, Dimitrios I. [2 ]
机构
[1] Univ London Imperial Coll Sci Technol & Med, Dept Elect & Elect Engn, London SW7 2BT, England
[2] NSCR Dimokritos, Inst Informat & Telecommun, Athens 15310, Greece
关键词
Hidden Markov models; Student's-t distribution; Variational Bayes; Speaker identification; Robotic task failure; Violence detection; EM;
D O I
10.1016/j.patcog.2010.09.001
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The Student's-t hidden Markov model (SHMM) has been recently proposed as a robust to outliers form of conventional continuous density hidden Markov models, trained by means of the expectation-maximization algorithm. In this paper, we derive a tractable variational Bayesian inference algorithm for this model. Our innovative approach provides an efficient and more robust alternative to EM-based methods, tackling their singularity and overfitting proneness, while allowing for the automatic determination of the optimal model size without cross-validation. We highlight the superiority of the proposed model over the competition using synthetic and real data. We also demonstrate the merits of our methodology in applications from diverse research fields, such as human computer interaction, robotics and semantic audio analysis. (C) 2010 Elsevier Ltd. All rights reserved.
引用
收藏
页码:295 / 306
页数:12
相关论文
共 50 条
  • [41] The Student's t-Hidden Markov Model With Truncated Stick-Breaking Priors
    Wei, Xin
    Li, Chunguang
    IEEE SIGNAL PROCESSING LETTERS, 2011, 18 (06) : 355 - 358
  • [42] On sampling the degree-of-freedom of Student's-t disturbances
    Watanabe, T
    STATISTICS & PROBABILITY LETTERS, 2001, 52 (02) : 177 - 181
  • [43] ROBUST CLASSIFICATION USING HIDDEN MARKOV MODELS AND MIXTURES OF NORMALIZING FLOWS
    Ghosh, Anubhab
    Honore, Antoine
    Liu, Dong
    Henter, Gustav Eje
    Chatterjee, Saikat
    PROCEEDINGS OF THE 2020 IEEE 30TH INTERNATIONAL WORKSHOP ON MACHINE LEARNING FOR SIGNAL PROCESSING (MLSP), 2020,
  • [44] Classification of Graph Sequences Utilizing the Eigenvalues of the Distance Matrices and Hidden Markov Models
    Schmidt, Miriam
    Schwenker, Friedhelm
    GRAPH-BASED REPRESENTATIONS IN PATTERN RECOGNITION, 2011, 6658 : 325 - 334
  • [45] Classification of graph sequences utilizing the eigenvalues of the distance matrices and hidden markov models
    Schmidt M.
    Schwenker F.
    Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2011, 6658 LNCS : 325 - 334
  • [46] Bayesian change point prediction for downhole drilling pressures with hidden Markov models
    Erivwo, Ochuko
    Makis, Viliam
    Kwon, Roy
    APPLIED STOCHASTIC MODELS IN BUSINESS AND INDUSTRY, 2024, 40 (03) : 772 - 790
  • [47] Go Multivariate: Recommendations on Bayesian Multilevel Hidden Markov Models with Categorical Data
    Mildiner Moraga, Sebastian
    Aarts, Emmeke
    MULTIVARIATE BEHAVIORAL RESEARCH, 2024, 59 (01) : 17 - 45
  • [48] A Bayesian Approach to Image Recognition Based on Separable Lattice Hidden Markov Models
    Sawada, Kei
    Tamamori, Akira
    Hashimoto, Kei
    Nankaku, Yoshihiko
    Tokuda, Keiichi
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2016, E99D (12): : 3119 - 3131
  • [49] Efficient Bayesian estimation and use of cut posterior in semiparametric hidden Markov models
    Moss, Daniel
    Rousseau, Judith
    ELECTRONIC JOURNAL OF STATISTICS, 2024, 18 (01): : 1815 - 1886
  • [50] A Comparison of Dynamic Naive Bayesian Classifiers and Hidden Markov Models for Gesture Recognition
    Aviles-Arriaga, H. H.
    Sucar-Succar, L. E.
    Mendoza-Duran, C. E.
    Pineda-Cortes, L. A.
    JOURNAL OF APPLIED RESEARCH AND TECHNOLOGY, 2011, 9 (01) : 81 - 102