Guessing Revisited: A Large Deviations Approach

被引:58
作者
Hanawal, Manjesh Kumar [1 ,2 ]
Sundaresan, Rajesh [3 ]
机构
[1] INRIA, F-84911 Avignon 9, France
[2] Univ Avignon, Lab Informat Avignon, F-84911 Avignon 9, France
[3] Indian Inst Sci, ECE Dept, Bangalore 560012, Karnataka, India
关键词
Guessing; information spectrum; large deviations; length function; source coding;
D O I
10.1109/TIT.2010.2090221
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The problem of guessing a random string is revisited. A close relation between guessing and compression is first established. Then it is shown that if the sequence of distributions of the information spectrum satisfies the large deviation property with a certain rate function, then the limiting guessing exponent exists and is a scalar multiple of the Legendre-Fenchel dual of the rate function. Other sufficient conditions related to certain continuity properties of the information spectrum are briefly discussed. This approach highlights the importance of the information spectrum in determining the limiting guessing exponent. All known prior results are then re-derived as example applications of our unifying approach.
引用
收藏
页码:70 / 78
页数:9
相关论文
共 27 条
[1]  
[Anonymous], 1973, Non-negative Matrices and Markov Chains
[2]   Guessing subject to distortion [J].
Arikan, E ;
Merhav, N .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1998, 44 (03) :1041-1056
[3]   An inequality on guessing and its application to sequential decoding [J].
Arikan, E .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1996, 42 (01) :99-105
[4]   CODING THEOREM AND RENYIS ENTROPY [J].
CAMPBELL, LL .
INFORMATION AND CONTROL, 1965, 8 (04) :423-&
[5]  
Dembo A., 1998, Large Deviation Techniques and Applications
[6]  
den Hollander F., 2003, LARGE DEVIATIONS
[7]  
Dupuis P., 1997, A weak convergence approach to the theory of large deviations
[8]  
Ellis R. S., 2006, P LECT INT SEM EXTR
[9]  
Ellis Richard S., 1985, GRUNDLEHREN MATH WIS, V271
[10]  
Han T., 2003, Information-Spectrum Methods in Information Theory