Binomial and Poisson distributions as maximum entropy distributions

被引：80

作者：

Harremoës, P ^{[1
]}

机构：

[1] Aurehoj Amtsgymnasium, Kobenhavns Amt, DK-2860 Soborg, Denmark

来源：

IEEE TRANSACTIONS ON INFORMATION THEORY | 2001年 / 47卷 / 05期

关键词：

binomial distribution; entropy; generalized binomial distribution; information divergence; Poisson distribution; Poisson's law;

D O I：

10.1109/18.930936

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

The binomial and the Poisson distributions are shown to be maximum entropy distributions of suitably defined sets. Poisson's law is considered as a case of entropy maximization, and also convergence in information divergence is established.

引用

页码：2039 / 2041

页数：3

共 18 条

[1]

[Anonymous], USPEHI MATEM NAUK

[2]

[Anonymous], 1960, PAC J MATH, DOI DOI 10.2140/PJM.1960.10.1181

[3] ENTROPY AND THE CENTRAL-LIMIT-THEOREM [J].

BARRON, AR .

ANNALS OF PROBABILITY, 1986, 14 (01) :336-342

[4] I-DIVERGENCE GEOMETRY OF PROBABILITY DISTRIBUTIONS AND MINIMIZATION PROBLEMS [J].

CSISZAR, I .

ANNALS OF PROBABILITY, 1975, 3 (01) :146-158

[5]

Csiszar I, 1967, STUD SCI MATH HUNG, V2, P299

[6] A SEMIGROUP APPROACH TO POISSON APPROXIMATION [J].

DEHEUVELS, P ;

PFEIFER, D .

ANNALS OF PROBABILITY, 1986, 14 (02) :663-676

[7]

Hardy G.H., 1964, INEQUALITIES

[8]

LeCam L., 1986, ASYMPTOTIC METHODS S

[9]

Ochs W., 1976, Reports on Mathematical Physics, V9, P135, DOI 10.1016/0034-4877(76)90050-1

[10]

PRESMAN EL, 1985, THEOR PROBAB APPL, V30, P417

← 1 2 →