Exact minimax strategies for predictive density estimation, data compression, and model selection

被引:51
作者
Liang, F [1 ]
Barron, A
机构
[1] Duke Univ, Inst Stat & Decis Sci, Durham, NC 27708 USA
[2] Yale Univ, Dept Stat, New Haven, CT 06520 USA
关键词
Haar measure; Hunt-Stein; invariance; Kullback-Leibler divergence; minimum description length (MDL); minimax risk; predictive density estimation; universal coding;
D O I
10.1109/TIT.2004.836922
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
For location and scale families of distributions and related settings of linear regression, we determine minimax procedures for predictive density estimation, for universal data compression, and for the minimum description length (MDL) criterion for model selection. The analysis gives the best invariant and indeed minimax procedure for predictive density estimation by directly verifying extended Bayes properties or, alternatively, by general aspects of decision theory on groups which are shown to simplify in the case of Kullback-Leibler loss. An exact minimax rule is generalized Bayes using a uniform (Lebesgue measure) prior on the location and log-scale parameters, which is made proper by conditioning on an initial set of observations.
引用
收藏
页码:2708 / 2726
页数:19
相关论文
共 58 条