About the asymptotic accuracy of Barron density estimates

被引:24
作者
Berlinet, A [1 ]
Vajda, I
van der Meulen, EC
机构
[1] Univ Montpellier 2, Dept Stat, F-34095 Montpellier, France
[2] Acad Sci Czech Republ, Inst Informat Theory & Automat, CR-18208 Prague, Czech Republic
[3] Katholieke Univ Leuven, Dept Math, B-3001 Heverlee, Belgium
关键词
Barron density estimate; consistency in divergences and expected divergences; divergences of Csiszar; nonparametric density estimates; Renyi distances;
D O I
10.1109/18.669143
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
By extending the information-theoretic arguments of previous papers dealing vith the Barren-type density estimates, and their consistency in information divergence and chi-square divergence, the problem of consistency in Csiszar's phi-divergence is motivated for general convex functions phi. The problem of consistency in phi-divergence is solved for all phi with phi(0) < infinity and phi(t) = O(t ill t) when t --> infinity. The problem of consistency in the expected phi-divergence is solved for all phi with t phi(1/t) + phi(t) = O(t(2)) when t --> infinity, Various stronger versions of these asymptotic restrictions are considered too. Assumptions about the model needed for the consistency are shown to depend on how strong these restrictions are.
引用
收藏
页码:999 / 1009
页数:11
相关论文
共 38 条
[1]  
ABOUJAOUDE S, ANN I H POINCARE, V12, P213
[2]  
[Anonymous], 1992, MULTIVARIATE DENSITY
[3]  
[Anonymous], 1961, CONTRIBUTIONS THEORY
[4]  
[Anonymous], 1972, CONTIGUITY PROBABILI
[5]  
Barron A. R., 1988, IEEE INT S INF THEOR
[6]   DISTRIBUTION ESTIMATION CONSISTENT IN TOTAL VARIATION AND IN 2 TYPES OF INFORMATION DIVERGENCE [J].
BARRON, AR ;
GYORFI, L ;
VANDERMEULEN, EC .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1992, 38 (05) :1437-1454
[7]   APPROXIMATION OF DENSITY-FUNCTIONS BY SEQUENCES OF EXPONENTIAL-FAMILIES [J].
BARRON, AR ;
SHEU, CH .
ANNALS OF STATISTICS, 1991, 19 (03) :1347-1369
[8]   ASYMPTOTIC NORMALITY OF L(1)-ERROR IN DENSITY-ESTIMATION [J].
BERLINET, A ;
DEVROYE, L ;
GYORFI, L .
STATISTICS, 1995, 26 (04) :329-343
[9]  
Berlinet A., 1997, PUBLICATIONS I STAT, V41, P3
[10]   SOME GLOBAL MEASURES OF DEVIATIONS OF DENSITY-FUNCTION ESTIMATES [J].
BICKEL, PJ ;
ROSENBLA.M .
ANNALS OF STATISTICS, 1973, 1 (06) :1071-1095