Source codes as random number generators

被引:26
作者
Visweswariah, K [1 ]
Kulkarni, SR [1 ]
Verdu, S [1 ]
机构
[1] Princeton Univ, Dept Elect Engn, Princeton, NJ 08544 USA
基金
美国国家科学基金会;
关键词
data compression; entropy; Lempel-Ziv algorithm; random number generation; universal source coding;
D O I
10.1109/18.661497
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
A random number generator generates fair coin flips by processing deterministically an arbitrary source of nonideal randomness. Pin optimal random number generator generates asymptotically Fair coin flips from a stationary ergodic source at a rate of bits per source symbol equal to the entropy rate of the source, Since optimal noiseless data compression codes produce incompressible outputs, it is natural to investigate their capabilities as optimal random number generators. In this paper we show under general conditions that optimal variable-length source codes asymptotically achieve optimal variable-length random bit generation in a rather strong sense, In particular, we show in a-hat sense the Lempel-Ziv algorithm earn be considered an optimal universal random bit generator front arbitrary stationary ergodic random sources with unknown distributions.
引用
收藏
页码:462 / 471
页数:10
相关论文
共 14 条
[1]   Universal coding of integers and unbounded search trees [J].
Ahlswede, R ;
Han, TS ;
Kobayashi, K .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1997, 43 (02) :669-682
[2]  
[Anonymous], 1951, Appl. Math Ser, DOI DOI 10.1080/01621459.1949.10483310
[3]  
Cover T. M., 2005, ELEM INF THEORY, DOI 10.1002/047174882X
[4]  
CSISZAR I, 1981, INFORMATION THEORY C
[5]   EFFICIENT CONSTRUCTION OF AN UNBIASED RANDOM SEQUENCE [J].
ELIAS, P .
ANNALS OF MATHEMATICAL STATISTICS, 1972, 43 (03) :865-&
[6]  
Han TS, 1997, IEEE T INFORM THEORY, V43, P599, DOI 10.1109/18.556116
[7]   UNBIASED COIN TOSSING WITH A BIASED COIN [J].
HOEFFDIN.W ;
SIMONS, G .
ANNALS OF MATHEMATICAL STATISTICS, 1970, 41 (02) :341-&
[8]   ITERATING VONNEUMANN PROCEDURE FOR EXTRACTING RANDOM BITS [J].
PERES, Y .
ANNALS OF STATISTICS, 1992, 20 (01) :590-597
[9]  
SHACK R, 1994, IEEE T INFORM THEORY, V40, P1246
[10]   TREE ALGORITHMS FOR UNBIASED COIN TOSSING WITH A BIASED COIN [J].
STOUT, QF ;
WARREN, B .
ANNALS OF PROBABILITY, 1984, 12 (01) :212-222