A maximum entropy approach to natural language processing

被引：28

作者：

Berger, AL ^{[1
]}

DellaPietra, SA ^{[1
]}

DellaPietra, VJ ^{[1
]}

机构：

[1] RENAISSANCE TECHNOL, STONY BROOK, NY USA

来源：

COMPUTATIONAL LINGUISTICS | 1996年 / 22卷 / 01期

关键词：

D O I：

暂无

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

The concept of maximum entropy can be traced back along multiple threads to Biblical times. Only recently, however, have computers become powerful enough to permit the widescale application of this concept to real world problems in statistical estimation and pattern recognition. In this paper, we describe a method for statistical modeling based on maximum entropy. We present a maximum-likelihood approach for automatically constructing maximum entropy models and describe how to implement this approach efficiently, using as examples several problems in natural language processing.

引用

页码：39 / 71

页数：33

共 23 条

[11] A GEOMETRIC INTERPRETATION OF DARROCH AND RATCLIFF GENERALIZED ITERATIVE SCALING
CSISZAR, I
[J]. ANNALS OF STATISTICS, 1989, 17 (03) : 1409 - 1413
[12] I-DIVERGENCE GEOMETRY OF PROBABILITY DISTRIBUTIONS AND MINIMIZATION PROBLEMS
CSISZAR, I
[J]. ANNALS OF PROBABILITY, 1975, 3 (01) : 146 - 158
[13] CSISZAR L, 1984, STATISTICS DECISIO S, P205
[14] GENERALIZED ITERATIVE SCALING FOR LOG-LINEAR MODELS
DARROCH, JN
RATCLIFF, D
[J]. ANNALS OF MATHEMATICAL STATISTICS, 1972, 43 (05): : 1470 - &
[15] DELLAPIETRA S, 1994, LECTURE NOTES ARTIFI, V862, P78
[16] DELLAPIETRA S, 1995, CMUCS95144
[17] MAXIMUM LIKELIHOOD FROM INCOMPLETE DATA VIA EM ALGORITHM
DEMPSTER, AP
LAIRD, NM
RUBIN, DB
[J]. JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-METHODOLOGICAL, 1977, 39 (01): : 1 - 38
[18] Guiasu S., 1985, MATH INTELLIGENCER, V7
[19] JAYNES ET, 1990, FUND THEOR, V39, P1
[20] LUCASSEN JM, 1984, P IEEE INT C AC SPEE

← 1 2 3 →