A variational Bayesian methodology for hidden Markov models utilizing Student's-t mixtures

被引:44
|
作者
Chatzis, Sotirios P. [1 ]
Kosmopoulos, Dimitrios I. [2 ]
机构
[1] Univ London Imperial Coll Sci Technol & Med, Dept Elect & Elect Engn, London SW7 2BT, England
[2] NSCR Dimokritos, Inst Informat & Telecommun, Athens 15310, Greece
关键词
Hidden Markov models; Student's-t distribution; Variational Bayes; Speaker identification; Robotic task failure; Violence detection; EM;
D O I
10.1016/j.patcog.2010.09.001
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The Student's-t hidden Markov model (SHMM) has been recently proposed as a robust to outliers form of conventional continuous density hidden Markov models, trained by means of the expectation-maximization algorithm. In this paper, we derive a tractable variational Bayesian inference algorithm for this model. Our innovative approach provides an efficient and more robust alternative to EM-based methods, tackling their singularity and overfitting proneness, while allowing for the automatic determination of the optimal model size without cross-validation. We highlight the superiority of the proposed model over the competition using synthetic and real data. We also demonstrate the merits of our methodology in applications from diverse research fields, such as human computer interaction, robotics and semantic audio analysis. (C) 2010 Elsevier Ltd. All rights reserved.
引用
收藏
页码:295 / 306
页数:12
相关论文
共 50 条
  • [21] Extending multivariate Student's-t semiparametric mixed models for longitudinal data with censored responses and heavy tails
    Mattos, Thalita B.
    Lachos, Victor H.
    Castro, Luis M.
    Matos, Larissa A.
    STATISTICS IN MEDICINE, 2022, 41 (19) : 3696 - 3719
  • [22] Variational Bayesian Learning of Directed Graphical Models with Hidden Variables
    Beal, Matthew J.
    Ghahramani, Zoubin
    BAYESIAN ANALYSIS, 2006, 1 (04): : 793 - 831
  • [23] Exploring the predictability of cryptocurrencies via Bayesian hidden Markov models
    Koki, Constandina
    Leonardos, Stefanos
    Piliouras, Georgios
    RESEARCH IN INTERNATIONAL BUSINESS AND FINANCE, 2022, 59
  • [24] BAYESIAN LARGE MARGIN HIDDEN MARKOV MODELS FOR SPEECH RECOGNITION
    Chen, Jung-Chun
    Chien, Jen-Tzung
    2009 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOLS 1- 8, PROCEEDINGS, 2009, : 3765 - 3768
  • [25] Bayesian Monte Carlo estimation for profile hidden Markov models
    Lewis, Steven J.
    Raval, Alpan
    Angus, John E.
    MATHEMATICAL AND COMPUTER MODELLING, 2008, 47 (11-12) : 1198 - 1216
  • [26] Bayesian Analysis of Semiparametric Hidden Markov Models With Latent Variables
    Song, Xinyuan
    Kang, Kai
    Ouyang, Ming
    Jiang, Xuejun
    Cai, Jingheng
    STRUCTURAL EQUATION MODELING-A MULTIDISCIPLINARY JOURNAL, 2018, 25 (01) : 1 - 20
  • [27] Nonparametric approach to learning the Bayesian procedure for Hidden Markov Models
    State, L
    Cocianu, C
    Panayiotis, V
    6TH WORLD MULTICONFERENCE ON SYSTEMICS, CYBERNETICS AND INFORMATICS, VOL III, PROCEEDINGS: IMAGE, ACOUSTIC, SPEECH AND SIGNAL PROCESSING I, 2002, : 362 - 366
  • [28] Divide-and-conquer Bayesian inference in hidden Markov models
    Wang, Chunlei
    Srivastava, Sanvesh
    ELECTRONIC JOURNAL OF STATISTICS, 2023, 17 (01): : 895 - 947
  • [29] AN ASYMPTOTIC ANALYSIS OF BAYESIAN STATE ESTIMATION IN HIDDEN MARKOV MODELS
    Yamazaki, Keisuke
    2011 IEEE INTERNATIONAL WORKSHOP ON MACHINE LEARNING FOR SIGNAL PROCESSING (MLSP), 2011,
  • [30] Variational Beta Process Hidden Markov Models with Shared Hidden States for Trajectory Recognition
    Zhao, Jing
    Zhang, Yi
    Sun, Shiliang
    Dai, Haiwei
    ENTROPY, 2021, 23 (10)