Zipf's law, hyperbolic distributions and entropy loss

被引:7
作者
Harremoës, P [1 ]
Topsoe, F [1 ]
机构
[1] Univ Copenhagen, Dept Math, DK-2100 Copenhagen, Denmark
来源
ISIT: 2002 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY, PROCEEDINGS | 2002年
关键词
D O I
10.1109/ISIT.2002.1023479
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Zipf's law is an empirical observation which relates rank and frequency of words in natural languages. The law suggests modelling by distributions of "hyperbolic type". We present a general definition and an information theoretical characterization of such distributions. This leads to a property of stability and flexibility, explaining that a language can develop towards higher and higher expressive powers without changing its basic structure.
引用
收藏
页码:207 / 207
页数:1
相关论文
共 5 条
  • [1] [Anonymous], 1949, Human behaviour and the principle of least-effort
  • [2] Estoup J.-B., 1916, GAMMES STENOGRAPHIQU
  • [3] Harremoes P., 2001, Entropy, V3, DOI 10.3390/e3030191
  • [4] Mandelbrot B., 1961, STRUCTURE LANGUAGE I
  • [5] PREDICTION AND ENTROPY OF PRINTED ENGLISH
    SHANNON, CE
    [J]. BELL SYSTEM TECHNICAL JOURNAL, 1951, 30 (01): : 50 - 64