GENERAL ENTROPY CRITERIA FOR INVERSE PROBLEMS, WITH APPLICATIONS TO DATA-COMPRESSION, PATTERN-CLASSIFICATION, AND CLUSTER-ANALYSIS

被引:60
作者
JONES, LK
BYRNE, CL
机构
[1] Department of Mathematics University of Lowell, Lowell, MA
关键词
D O I
10.1109/18.50370
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Minimum distance approaches are considered for the reconstruction of a real function from finitely many linear functional values. An optimal class of distances satisfying an orthogonality condition analogous to that enjoyed by linear projections in Hilbert space is derived. These optimal distances are related to measures of distance between probability distributions recently introduced by Rao and Nayak and possess the geometric properties of cross entropy useful in speech and image compression, pattern classification, and cluster analysis. Several examples from spectrum estimation and image processing are discussed. © 1990 IEEE
引用
收藏
页码:23 / 30
页数:8
相关论文
共 22 条
[1]  
BURG JP, 1967, 37TH ANN M SOC EXPL
[2]  
Charnes A., 1978, Mathematische Operationsforschung und Statistik, Series Optimization, V9, P21, DOI 10.1080/02331937808842461
[3]   I-DIVERGENCE GEOMETRY OF PROBABILITY DISTRIBUTIONS AND MINIMIZATION PROBLEMS [J].
CSISZAR, I .
ANNALS OF PROBABILITY, 1975, 3 (01) :146-158
[4]   RESTORING WITH MAXIMUM LIKELIHOOD AND MAXIMUM ENTROPY [J].
FRIEDEN, BR .
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA, 1972, 62 (04) :511-&
[5]   AN OPTIMAL GLOBAL NEAREST NEIGHBOR METRIC [J].
FUKUNAGA, K ;
FLICK, TE .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1984, 6 (03) :314-318
[6]   AUTOMATIC CLASSIFICATION OF ELECTROENCEPHALOGRAMS - KULLBACK-LEIBLER NEAREST NEIGHBOR RULES [J].
GERSCH, W ;
MARTINELLI, F ;
YONEMOTO, J ;
LOW, MD ;
MCEWAN, JA .
SCIENCE, 1979, 205 (4402) :193-195
[7]  
GOODRICH R, 1986, SIAM J APPL MATH, V40, P417
[8]  
GORDON R, 1971, Q B CTR THEOR BIOL, V4, P71
[9]   DISTORTION MEASURES FOR SPEECH PROCESSING [J].
GRAY, RM ;
BUZO, A ;
GRAY, AH ;
MATSUYAMA, Y .
IEEE TRANSACTIONS ON ACOUSTICS SPEECH AND SIGNAL PROCESSING, 1980, 28 (04) :367-376
[10]  
GULL S, 1978, NATURE, V272, P666