A variational Bayesian methodology for hidden Markov models utilizing Student's-t mixtures

被引:44
|
作者
Chatzis, Sotirios P. [1 ]
Kosmopoulos, Dimitrios I. [2 ]
机构
[1] Univ London Imperial Coll Sci Technol & Med, Dept Elect & Elect Engn, London SW7 2BT, England
[2] NSCR Dimokritos, Inst Informat & Telecommun, Athens 15310, Greece
关键词
Hidden Markov models; Student's-t distribution; Variational Bayes; Speaker identification; Robotic task failure; Violence detection; EM;
D O I
10.1016/j.patcog.2010.09.001
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The Student's-t hidden Markov model (SHMM) has been recently proposed as a robust to outliers form of conventional continuous density hidden Markov models, trained by means of the expectation-maximization algorithm. In this paper, we derive a tractable variational Bayesian inference algorithm for this model. Our innovative approach provides an efficient and more robust alternative to EM-based methods, tackling their singularity and overfitting proneness, while allowing for the automatic determination of the optimal model size without cross-validation. We highlight the superiority of the proposed model over the competition using synthetic and real data. We also demonstrate the merits of our methodology in applications from diverse research fields, such as human computer interaction, robotics and semantic audio analysis. (C) 2010 Elsevier Ltd. All rights reserved.
引用
收藏
页码:295 / 306
页数:12
相关论文
共 50 条
  • [1] A novel corporate credit rating system based on Student's-t hidden Markov models
    Petropoulos, Anastasios
    Chatzis, Sotirios P.
    Xanthopoulos, Stylianos
    EXPERT SYSTEMS WITH APPLICATIONS, 2016, 53 : 87 - 105
  • [2] Clustering Hidden Markov Models With Variational Bayesian Hierarchical EM
    Lan, Hui
    Liu, Ziquan
    Hsiao, Janet H.
    Yu, Dan
    Chan, Antoni B.
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (03) : 1537 - 1551
  • [3] Variational Bayesian Variable Selection for High-Dimensional Hidden Markov Models
    Zhai, Yao
    Liu, Wei
    Jin, Yunzhi
    Zhang, Yanqing
    MATHEMATICS, 2024, 12 (07)
  • [4] Dynamic Variational Bayesian Student's T Mixture Regression With Hidden Variables Propagation for Industrial Inferential Sensor Development
    Wang, Jingbo
    Shao, Weiming
    Zhang, Xinmin
    Song, Zhihuan
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (08) : 5314 - 5324
  • [5] Bayesian classification of Hidden Markov Models
    Kehagias, A
    MATHEMATICAL AND COMPUTER MODELLING, 1996, 23 (05) : 25 - 43
  • [6] Estimation of Viterbi path in Bayesian hidden Markov models
    Lember, Juri
    Gasbarra, Dario
    Koloydenko, Alexey
    Kuljus, Kristi
    METRON-INTERNATIONAL JOURNAL OF STATISTICS, 2019, 77 (02): : 137 - 169
  • [7] Estimation of Viterbi path in Bayesian hidden Markov models
    Jüri Lember
    Dario Gasbarra
    Alexey Koloydenko
    Kristi Kuljus
    METRON, 2019, 77 : 137 - 169
  • [8] Visual Workflow Recognition Using a Variational Bayesian Treatment of Multistream Fused Hidden Markov Models
    Chatzis, Sotirios P.
    Kosmopoulos, Dimitrios
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2012, 22 (07) : 1076 - 1086
  • [9] Bayesian hidden Markov models for delineating the pathology of Alzheimer's disease
    Kang, Kai
    Cai, Jingheng
    Song, Xinyuan
    Zhu, Hongtu
    STATISTICAL METHODS IN MEDICAL RESEARCH, 2019, 28 (07) : 2112 - 2124
  • [10] An introduction to hidden Markov models and Bayesian networks
    Ghahramani, Z
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2001, 15 (01) : 9 - 42