Entropy bounds for constrained two-dimensional random fields

被引:36
作者
Forchhammer, S [1 ]
Justesen, J [1 ]
机构
[1] Tech Univ Denmark, Dept Telecommun, DK-2800 Lyngby, Denmark
关键词
data compression; entropy bounds; storage; 2-D channel capacity; 2-D input constrained channels; 2-D run-length limits;
D O I
10.1109/18.746776
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The maximum entropy and thereby the capacity of two-dimensional (2-D) fields given by certain constraints on configurations is considered. Upper and lower bounds are derived. A new class of 2-D processes yielding good lower bounds is introduced. Asymptotically, the process achieves capacity for constraints with limited long-range effects. The processes are general and may also be applied to, e.g., data compression of digital images. Results are given for the binary hard square model, which is a 2-D run-length-limited model and some other 2-D models with simple constraints.
引用
收藏
页码:118 / 127
页数:10
相关论文
共 16 条
[1]   CLASSIFICATION OF BINARY RANDOM PATTERNS [J].
ABEND, K ;
HARLEY, TJ ;
KANAL, LN .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1965, 11 (04) :538-544
[2]  
Berger R., 1966, MEMOIRS AM MATH SOC, V66
[3]   NONUNIQUENESS OF MEASURES OF MAXIMAL ENTROPY FOR SUBSHIFTS OF FINITE-TYPE [J].
BURTON, R ;
STEIF, JE .
ERGODIC THEORY AND DYNAMICAL SYSTEMS, 1994, 14 :213-235
[4]   LOCAL CHARACTERISTICS, ENTROPY AND LIMIT-THEOREMS FOR SPANNING-TREES AND DOMINO TILINGS VIA TRANSFER-IMPEDANCES [J].
BURTON, R ;
PEMANTLE, R .
ANNALS OF PROBABILITY, 1993, 21 (03) :1329-1371
[5]   The number of independent sets in a grid graph [J].
Calkin, NJ ;
Wilf, HS .
SIAM JOURNAL ON DISCRETE MATHEMATICS, 1998, 11 (01) :54-60
[6]  
Cover T. M., 2005, ELEM INF THEORY, DOI 10.1002/047174882X
[7]   Partially Hidden Markov Models [J].
Forchhammer, S ;
Rissanen, J .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1996, 42 (04) :1253-1256
[8]  
Immink K. A. S., 1991, Coding Techniques for Digital Recorders
[9]  
JUSTESEN J, 1997, PROBL PEREDACHI INF, V33, P3
[10]   Crystal statistics I A two-dimensional model with an order-disorder transition [J].
Onsager, L .
PHYSICAL REVIEW, 1944, 65 (3/4) :117-149