Csiszar's cutoff rates for arbitrary discrete sources

被引:10
作者
Chen, PN [1 ]
Alajaji, F
机构
[1] Natl Chiao Tung Univ, Dept Commun Engn, Hsinchu, Taiwan
[2] Queens Univ, Dept Math & Stat, Kingston, ON K7L 3N6, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
arbitrary sources with memory; cutoff rates; fixed-length source coding; probability of error; Renyi's entropy rates; source reliability function;
D O I
10.1109/18.904531
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Csiszar's forward beta -cutoff rate (given a fixed beta > 0) for a discrete source is defined as the smallest number Ro such that for every R > R-0, there exists a sequence of tired-length codes of rate R with probability of error asymptotically vanishing as e(-n beta (R-R0)). For a discrete memoryless source (DMS), the forward beta -cutoff rate is shown by Csiszar [6] to be equal to the source Renyi entropy. An analogous concept of reverse beta -cutoff rate regarding the probability of correct decoding is also characterized by Csiszar in terms of the Renyi entropy. In this work, Csiszar's results are generalized by investigating the beta -cutoff rates for the class of arbitrary discrete sources with memory. It is demonstrated that the limsup and liminf Renyi entropy rates provide the formulas for the forward and reverse beta -cutoff rates, respectively. Consequently, new fixed-length source coding operational characterizations for the Renyi entropy rates are established.
引用
收藏
页码:330 / 338
页数:9
相关论文
共 18 条
[1]  
[Anonymous], 1961, CONTRIBUTIONS THEORY
[2]  
[Anonymous], 1990, Large Deviation Techniques in Decision, Simulation and Estimation
[3]   An inequality on guessing and its application to sequential decoding [J].
Arikan, E .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1996, 42 (01) :99-105
[4]  
BLAHUT RE, 1987, PRINCIPLE PRACTICE I
[5]  
BLAHUT RE, 1974, IEEE T INFORM THEORY, V20, P40
[6]   CODING THEOREM AND RENYIS ENTROPY [J].
CAMPBELL, LL .
INFORMATION AND CONTROL, 1965, 8 (04) :423-&
[7]   GENERALIZED CUTOFF RATES AND RENYIS INFORMATION MEASURES [J].
CSISZAR, I .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1995, 41 (01) :26-34
[8]  
Csiszar I., 1971, Stud. Sci. Math. Hung., V6, P181
[9]   THE ERROR EXPONENT FOR THE NOISELESS ENCODING OF FINITE ERGODIC MARKOV SOURCES [J].
DAVISSON, LD ;
LONGO, G ;
SGARRO, A .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1981, 27 (04) :431-438
[10]  
EREZ U, 1999, P INF THEOR WORKSH M