A new distance measure for hidden Markov models

被引:16
作者
Zeng, Jianping [1 ]
Duan, Jiangjiao [1 ]
Wu, Chengrong [1 ]
机构
[1] Fudan Univ, Sch Comp Sci, Shanghai 200433, Peoples R China
关键词
Hidden Markov models; Distance measure; Stationary probability distribution; Cumulative probability distribution function;
D O I
10.1016/j.eswa.2009.06.063
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Hidden Markov model (HMM) has been found useful in modeling complex time series in various applications. An appropriate distance measure between two HMMs is of theoretical interests and it is also important in HMM-based applications. Kullback-Leibler (KL) and modified KL are usually used as distance measures between two HMMs However. these measures do not satisfy the necessary properties of a distance measure. such as the triangle inequality A novel distance measure. which is based on the HMM stationary cumulative distribution function, is proposed to discriminate two HMMs it is proved that the measure can fulfill the properties requirements The distance measure is evaluated by making comparisons to KL distance in experiments on a series of models. Also clustering oil both synthesized data and real world data is performed with the new distance and KL distance, respectively. The results show that the proposed distance is more effective and reasonable in discriminating HMMs. (C) 2009 Elsevier Ltd. All rights reserved.
引用
收藏
页码:1550 / 1555
页数:6
相关论文
共 17 条
[1]  
[Anonymous], J MACH LEARN RES
[2]  
BAHLMANN C, 2001, P 6 ICDAR
[3]   Investigating Hidden Markov Models capabilities in 2D shape classification [J].
Bicego, M ;
Murino, V .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2004, 26 (02) :281-286
[4]   A sequential pruning strategy for the selection of the number of states in hidden Markov models [J].
Bicego, M ;
Murino, V ;
Figueiredo, MAT .
PATTERN RECOGNITION LETTERS, 2003, 24 (9-10) :1395-1407
[5]   On measuring the distance between histograms [J].
Cha, SH ;
Srihari, SN .
PATTERN RECOGNITION, 2002, 35 (06) :1355-1370
[6]   Rotation invariant texture characterization and retrieval using steerable wavelet-domain hidden Markov models [J].
Do, MN ;
Vetterli, M .
IEEE TRANSACTIONS ON MULTIMEDIA, 2002, 4 (04) :517-527
[7]   A prediction algorithm for time series based on adaptive model selection [J].
Duan, Jiangjiao ;
Wang, Wei ;
Zeng, Jianping ;
Zhang, Dongzhan ;
Shi, Baile .
EXPERT SYSTEMS WITH APPLICATIONS, 2009, 36 (02) :1308-1314
[8]   A fusion model of HMM, ANN and GA for stock market forecasting [J].
Hassan, Md. Rafiul ;
Nath, Baikunth ;
Kirley, Michael .
EXPERT SYSTEMS WITH APPLICATIONS, 2007, 33 (01) :171-180
[9]   A PROBABILISTIC DISTANCE MEASURE FOR HIDDEN MARKOV-MODELS [J].
JUANG, BH ;
RABINER, LR .
AT&T TECHNICAL JOURNAL, 1985, 64 (02) :391-408
[10]  
LYNGS RB, 1999, P INT C INT SYST MOL