Theoretical properties of the log-concave maximum likelihood estimator of a multidimensional density

被引:62
作者
Cule, Madeleine [1 ]
Samworth, Richard [1 ]
机构
[1] Ctr Math Sci, Cambridge CB3 0WB, England
关键词
Consistency; log-concavity; Kullback-Leibler divergence; maximum likelihood estimation; model misspecification; LIMIT DISTRIBUTION-THEORY; K-MONOTONE DENSITY; CONSISTENCY;
D O I
10.1214/09-EJS505
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
We present theoretical properties of the log-concave maximum likelihood estimator of a density based on an independent and identically distributed sample in R-d. Our study covers both the case where the true underlying density is log-concave, and where this model is misspecified. We begin by showing that for a sequence of log-concave densities, convergence in distribution implies much stronger types of convergence in particular, it implies convergence in Hellinger distance and even in certain exponentially weighted total variation norms. In our main result, we prove the existence and uniqueness of a log-concave density that minimises the Kullback-Leibler divergence from the true density over the class of all log-concave densities, and also show that the log-concave maximum likelihood estimator converges almost surely in these exponentially weighted total variation norms to this minimiser. In the case of a correctly specified model, this demonstrates a strong type of consistency for the estimator; in a misspecified model, it shows that the estimator converges to the log-concave density that is closest in the Kullback-Leibler sense to the true density.
引用
收藏
页码:254 / 270
页数:17
相关论文
共 34 条
[1]  
[Anonymous], 1999, REAL ANAL MODERN TEC
[2]  
[Anonymous], 1996, PRINCETON MATH SER
[3]  
[Anonymous], 1988, UNIMODALITY CONVEXIT
[4]  
[Anonymous], 2009, J STAT SOFTWARE
[5]  
[Anonymous], 1999, CONVERGE PROBAB MEAS
[6]  
Bagnoli Mark, 1989, LOG CONCAVE PR UNPUB
[7]  
BALABDAOUI F, 2010, STAT SINICA IN PRESS
[8]   Estimation of a k-monotone density: Limit distribution theory and the spline connection [J].
Balabdaoui, Fadoua ;
Wellner, Jon A. .
ANNALS OF STATISTICS, 2007, 35 (06) :2536-2564
[9]   Estimation of a k-monotone density: characterizations, consistency and minimax lower bounds [J].
Balabdaoui, Fadoua ;
Wellner, Jon A. .
STATISTICA NEERLANDICA, 2010, 64 (01) :45-70
[10]   LIMIT DISTRIBUTION THEORY FOR MAXIMUM LIKELIHOOD ESTIMATION OF A LOG-CONCAVE DENSITY [J].
Balabdaoui, Fadoua ;
Rufibach, Kaspar ;
Wellner, Jon A. .
ANNALS OF STATISTICS, 2009, 37 (03) :1299-1331