On optimality of Bayesian testimation in the normal means problem

被引:30
作者
Abramovich, Felix [1 ]
Grinshtein, Vadim
Pensky, Marianna
机构
[1] Tel Aviv Univ, Dept Stat & Operat Res, IL-69978 Tel Aviv, Israel
[2] Open Univ, Dept Math, IL-43107 Raanana, Israel
[3] Univ Cent Florida, Dept Math, Orlando, FL 32816 USA
关键词
adaptivity; complexity penalty; maximum a posteriori rule; minimax estimation; sequence estimation; sparsity; thresholding;
D O I
10.1214/009053607000000226
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
We consider a problem of recovering a high-dimensional vector mu observed in white noise, where the unknown vector g is assumed to be sparse. The objective of the paper is to develop a Bayesian formalism which gives rise to a family of l(0)-type penalties. The penalties are associated with various choices of the prior distributions pi(n)(center dot) on the number of nonzero entries of mu and, hence, are easy to interpret. The resulting Bayesian estimators lead to a general thresholding rule which accommodates many of the known thresholding and model selection procedures as particular cases corresponding to specific choices of pi(n)(center dot). Furthermore, they achieve optimality in a rather general setting under very mild conditions on the prior. We also specify the class of priors pi(n)(center dot) for which the resulting estimator is adaptively optimal (in the minimax sense) for a wide range of sparse sequences and consider several examples of such priors.
引用
收藏
页码:2261 / 2286
页数:26
相关论文
共 26 条
  • [1] Adaptive thresholding of wavelet coefficients
    Abramovich, F
    Benjamini, Y
    [J]. COMPUTATIONAL STATISTICS & DATA ANALYSIS, 1996, 22 (04) : 351 - 361
  • [2] ABRAMOVICH F, 2006, SANKHYA, V68, P436
  • [3] Abramovich F., 1995, LECT NOTES STAT, V103, P5
  • [4] Adapting to unknown sparsity by controlling the false discovery rate
    Abramovich, Felix
    Benjamini, Yoav
    Donoho, David L.
    Johnstone, Iain M.
    [J]. ANNALS OF STATISTICS, 2006, 34 (02) : 584 - 653
  • [5] Akaike H., 1973, 2 INT S INFORM THEOR, P267, DOI [DOI 10.1007/978-1-4612-1694-0_15, 10.1007/978-1-4612-1694-0_15]
  • [6] [Anonymous], 2001, Journal of the European Mathematical Society, DOI DOI 10.1007/S100970100031
  • [7] [Anonymous], 1996, BERNOULLI
  • [8] Regularization of wavelet approximations - Rejoinder
    Antoniadis, A
    Fan, J
    [J]. JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2001, 96 (455) : 964 - 967
  • [9] CONTROLLING THE FALSE DISCOVERY RATE - A PRACTICAL AND POWERFUL APPROACH TO MULTIPLE TESTING
    BENJAMINI, Y
    HOCHBERG, Y
    [J]. JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 1995, 57 (01) : 289 - 300
  • [10] DONOHO DL, 1992, J ROY STAT SOC B MET, V54, P41