What HMMs can do

被引:62
作者
Bilmes, JA [1 ]
机构
[1] Univ Washington, Dept Elect Engn, Seattle, WA 98195 USA
关键词
automatic speech recognition; hidden Markov models; HMMs; time-series processes; hand-writing recognition; graphical models; dynamic Bayesian networks; dynamic graphical models; stochastic processes; time-series densities; bio-informatics;
D O I
10.1093/ietisy/e89-d.3.869
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Since their inception almost fifty years ago, hidden Markov models (HMMs) have have become the predominant methodology for automatic speech recognition (ASR) systems - today, most state-of-the-art speech systems are HMM-based. There have been a number of ways to explain HMMs and to list their capabilities, each of these ways having both advantages and disadvantages. In an effort to better understand what HMMs can do, this tutorial article analyzes HMMs by exploring a definition of HMMs in terms of random variables and conditional independence assumptions. We prefer this definition as it allows Lis to reason more throughly about the capabilities of HMMs. In particular, it is possible to deduce that there are, in theory at least, no limitations to the class of probability distributions representable by HMMs. This paper concludes that, in search of a model to Supersede the HMM (say for ASR), rather than trying to correct for HMM limitations in the general case, new models Should be found based on their potential for better parsimony, computational requirements, and noise insensitivity.
引用
收藏
页码:869 / 891
页数:23
相关论文
共 130 条
  • [71] Minimum classification error rate methods for speech recognition
    Juang, BH
    Chou, W
    Lee, CH
    [J]. IEEE TRANSACTIONS ON SPEECH AND AUDIO PROCESSING, 1997, 5 (03): : 257 - 265
  • [72] MIXTURE AUTOREGRESSIVE HIDDEN MARKOV-MODELS FOR SPEECH SIGNALS
    JUANG, BH
    RABINER, LR
    [J]. IEEE TRANSACTIONS ON ACOUSTICS SPEECH AND SIGNAL PROCESSING, 1985, 33 (06): : 1404 - 1413
  • [73] DISCRIMINATIVE LEARNING FOR MINIMUM ERROR CLASSIFICATION
    JUANG, BH
    KATAGIRI, S
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 1992, 40 (12) : 3043 - 3054
  • [74] ON THE HIDDEN MARKOV MODEL AND DYNAMIC TIME WARPING FOR SPEECH RECOGNITION - A UNIFIED VIEW
    JUANG, BH
    [J]. AT&T BELL LABORATORIES TECHNICAL JOURNAL, 1984, 63 (07): : 1213 - 1243
  • [75] KADIRKAMANATHAN M, 1991, INT CONF ACOUST SPEE, P897, DOI 10.1109/ICASSP.1991.150484
  • [76] A LINEAR PREDICTIVE HMM FOR VECTOR-VALUED OBSERVATIONS WITH APPLICATIONS TO SPEECH RECOGNITION
    KENNY, P
    LENNIG, M
    MERMELSTEIN, P
    [J]. IEEE TRANSACTIONS ON ACOUSTICS SPEECH AND SIGNAL PROCESSING, 1990, 38 (02): : 220 - 225
  • [77] KONIG Y, 1996, THESIS UC BERKELEY
  • [78] Factor graphs and the sum-product algorithm
    Kschischang, FR
    Frey, BJ
    Loeliger, HA
    [J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 2001, 47 (02) : 498 - 519
  • [79] Lafferty J., 2001, PROC 18 INT C MACHIN, DOI [10.1038/nprot.2006.61, DOI 10.1038/NPROT.2006.61]
  • [80] Lauritzen S. L., 1996, GRAPHICAL MODELS