The entropy of a binary Hidden Markov Process

被引：28
|
作者：
Zuk, O [1 ]
Kanter, I
Domany, E
机构：
[1] Weizmann Inst Sci, Dept Phys Complex Syst, IL-76100 Rehovot, Israel
[2] Bar Ilan Univ, Dept Phys, IL-52900 Ramat Gan, Israel
来源：
JOURNAL OF STATISTICAL PHYSICS | 2005年 / 121卷 / 3-4期
关键词：
Hidden Markov Process; entropy; random-field Ising model;
D O I：
10.1007/s10955-005-7576-y
中图分类号：
O4 [物理学];
学科分类号：
0702 ;
摘要：
The entropy of a binary symmetric Hidden Markov Process is calculated as an expansion in the noise parameter epsilon. We map the problem onto a one-dimensional Ising model in a large field of random signs and calculate the expansion coefficients up to second order in epsilon. Using a conjecture we extend the calculation to 11th order and discuss the convergence of the resulting series.
引用
收藏
页码：343 / 360
页数：18
相关论文
共 50 条
  • [31] Steganalysis of Compressed Speech Based on Markov and Entropy
    Miao, Haibo
    Huang, Liusheng
    Shen, Yao
    Lu, Xiaorong
    Chen, Zhili
    DIGITAL-FORENSICS AND WATERMARKING, IWDW 2013, 2014, 8389 : 63 - 76
  • [32] Bias of a nonparametric entropy estimator for Markov measures
    Timofeev E.A.
    Journal of Mathematical Sciences, 2011, 176 (2) : 255 - 269
  • [33] A CLASSROOM NOTE: ENTROPY, INFORMATION, AND MARKOV PROPERTY
    Pop-Stojanovic, Zoran R.
    TEACHING OF MATHEMATICS, 2006, 9 (01): : 1 - 12
  • [34] Gradient flows of the entropy for finite Markov chains
    Maas, Jan
    JOURNAL OF FUNCTIONAL ANALYSIS, 2011, 261 (08) : 2250 - 2292
  • [35] Entropy computation in partially observed Markov Chains
    Desbouvries, Francois
    BAYESIAN INFERENCE AND MAXIMUM ENTROPY METHODS IN SCIENCE AND ENGINEERING, 2006, 872 : 355 - 357
  • [36] Estimating components in finite mixtures and hidden Markov models
    Poskitt, DS
    Zhang, J
    AUSTRALIAN & NEW ZEALAND JOURNAL OF STATISTICS, 2005, 47 (03) : 269 - 286
  • [37] A Monte Carlo Estimation of the Entropy for Markov Chains
    Didier Chauveau
    Pierre Vandekerkhove
    Methodology and Computing in Applied Probability, 2007, 9 : 133 - 149
  • [38] Extended Golomb codes for binary Markov sources
    Hong, ES
    Ladner, RE
    DCC 2002: DATA COMPRESSION CONFERENCE, PROCEEDINGS, 2002, : 456 - 456
  • [39] Entropy of continuous Markov processes in local thermal equilibrium
    Hoyuelos, Miguel
    PHYSICAL REVIEW E, 2009, 79 (05):
  • [40] A PROBABILISTIC APPROACH TO CONVEX (φ)-ENTROPY DECAY FOR MARKOV CHAINS
    Conforti, Giovanni
    ANNALS OF APPLIED PROBABILITY, 2022, 32 (02) : 932 - 973
12345