A Novel Low-Complexity HMM Similarity Measure

被引:29
作者
Sahraeian, Sayed Mohammad Ebrahim [1 ]
Yoon, Byung-Jun [1 ]
机构
[1] Texas A&M Univ, Dept Elect & Comp Engn, College Stn, TX 77843 USA
关键词
Hidden Markov model (HMM) similarity measure; HMM comparison; semi-Markov random walk; DISTANCE;
D O I
10.1109/LSP.2010.2096417
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this letter, we propose a novel similarity measure for comparing Hidden Markov models (HMMs) and an efficient scheme for its computation. In the proposed approach, we probabilistically evaluate the correspondence, or goodness of match, between every pair of states in the respective HMMs, based on the concept of semi-Markov random walk. We show that this correspondence score reflects the contribution of a given state pair to the overall similarity between the two HMMs. For similar HMMs, each state in one HMM is expected to have only a few matching states in the other HMM, resulting in a sparse state correspondence score matrix. This allows us to measure the similarity between HMMs by evaluating the sparsity of the state correspondence matrix. Estimation of the proposed similarity score does not require time-consuming Monte-Carlo simulations, hence it can be computed much more efficiently compared to the Kullback-Leibler divergence (KLD) thas has been widely used. We demonstrate the effectiveness of the proposed measure through several examples.
引用
收藏
页码:87 / 90
页数:4
相关论文
共 15 条
[1]  
[Anonymous], 1999, P 37 ANN M ASS COMP, DOI DOI 10.3115/1034678.1034693
[2]  
[Anonymous], 1996, Stochastic Processes
[3]   Measuring HMM similarity with the Bayes probability of error and its application to online handwriting recognition [J].
Bahlmann, C ;
Burkhardt, H .
SIXTH INTERNATIONAL CONFERENCE ON DOCUMENT ANALYSIS AND RECOGNITION, PROCEEDINGS, 2001, :406-411
[4]   DISTANCE MEASURES FOR SIGNAL-PROCESSING AND PATTERN-RECOGNITION [J].
BASSEVILLE, M .
SIGNAL PROCESSING, 1989, 18 (04) :349-369
[5]   Fast schemes for computing similarities between Gaussian HMMs and their applications in texture image classification [J].
Chen, L ;
Man, H .
EURASIP JOURNAL ON APPLIED SIGNAL PROCESSING, 2005, 2005 (13) :1984-1993
[6]   Rotation invariant texture characterization and retrieval using steerable wavelet-domain hidden Markov models [J].
Do, MN ;
Vetterli, M .
IEEE TRANSACTIONS ON MULTIMEDIA, 2002, 4 (04) :517-527
[7]   Fast approximation of Kullback-Leibler distance for dependence trees and hidden Markov models [J].
Do, MN .
IEEE SIGNAL PROCESSING LETTERS, 2003, 10 (04) :115-118
[8]   Comparing Measures of Sparsity [J].
Hurley, Niall ;
Rickard, Scott .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2009, 55 (10) :4723-4741
[9]   A PROBABILISTIC DISTANCE MEASURE FOR HIDDEN MARKOV-MODELS [J].
JUANG, BH ;
RABINER, LR .
AT&T TECHNICAL JOURNAL, 1985, 64 (02) :391-408
[10]  
Kullback S., 1958, INFORM THEORY STAT