An objective prior for hyperparameters in normal hierarchical models

被引:3
|
作者
Berger, James O. [1 ,3 ]
Sun, Dongchu [2 ,3 ]
Song, Chengyuan [3 ]
机构
[1] Duke Univ, Dept Stat Sci, Durham, NC 27708 USA
[2] Univ Nebraska, Dept Stat, 343D Hardin Hall North Wing, Lincoln, NE 68583 USA
[3] East China Normal Univ, Sch Stat, Shanghai 200062, Peoples R China
关键词
Admissibility; Bayesian analysis; Hyperparameters; Normal hierarchical model; Objective prior; VARIANCE PARAMETERS; PRIOR DISTRIBUTIONS; ADMISSIBILITY; MULTIVARIATE; ESTIMATORS; INFERENCE; PROPRIETY;
D O I
10.1016/j.jmva.2020.104606
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Hierarchical models are the workhorse of much of Bayesian analysis, yet there is uncertainty as to which priors to use for hyperparameters. Formal approaches to objective Bayesian analysis, such as the Jeffreys-rule approach or reference prior approach, are only implementable in simple hierarchical settings. It is thus common to use less formal approaches, such as utilizing formal priors from non-hierarchical models in hierarchical settings. This can be fraught with danger, however. For instance, non-hierarchical Jeffreys-rule priors for variances or covariance matrices result in improper posterior distributions if they are used at higher levels of a hierarchical model. Berger et al. (2005) approached the question of choice of hyperpriors in normal hierarchical models by looking at the frequentist notion of admissibility of resulting estimators. Hyperpriors that are 'on the boundary of admissibility' are sensible choices for objective priors, being as diffuse as possible without resulting in inadmissible procedures. The admissibility (and propriety) properties of a number of priors were considered in the paper, but no overall conclusion was reached as to a specific prior. In this paper, we complete the story and propose a particular objective prior for use in all normal hierarchical models, based on considerations of admissibility, ease of implementation and performance. (C) 2020 Published by Elsevier Inc.
引用
收藏
页数:13
相关论文
共 50 条
  • [11] Objective Bayesian Analysis for Gaussian Hierarchical Models with Intrinsic Conditional Autoregressive Priors
    Keefe, Matthew J.
    Ferreira, Marco A. R.
    Franck, Christopher T.
    BAYESIAN ANALYSIS, 2019, 14 (01): : 181 - 209
  • [12] Objective Prior for the Number of Degrees of Freedom of a t Distribution
    Villa, Cristiano
    Walker, Stephen G.
    BAYESIAN ANALYSIS, 2014, 9 (01): : 197 - 220
  • [13] HIERARCHICAL MARKOV NORMAL MIXTURE MODELS WITH APPLICATIONS TO FINANCIAL ASSET RETURNS
    Geweke, John
    Amisano, Gianni
    JOURNAL OF APPLIED ECONOMETRICS, 2011, 26 (01) : 1 - 29
  • [14] Fast Low-Rank Bayesian Matrix Completion With Hierarchical Gaussian Prior Models
    Yang, Linxiao
    Fang, Jun
    Duan, Huiping
    Li, Hongbin
    Zeng, Bing
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2018, 66 (11) : 2804 - 2817
  • [15] A survey on hyperparameters optimization algorithms of forecasting models in smart grid
    Khalid, Rabiya
    Javaid, Nadeem
    SUSTAINABLE CITIES AND SOCIETY, 2020, 61 (61)
  • [16] ON SELECTING THE HYPERPARAMETERS OF THE DPM MODELS FOR THE DENSITY ESTIMATION OF OBSERVATION ERRORS
    Rabaoui, Asma
    Viandier, Nicolas
    Marais, Juliette
    Duflos, Emmanuel
    2011 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2011, : 4092 - 4095
  • [17] Objective Bayesian Model Selection for Spatial Hierarchical Models with Intrinsic Conditional Autoregressive Priors
    Porter, Erica M.
    Franck, Christopher T.
    Ferreira, Marco A. R.
    BAYESIAN ANALYSIS, 2024, 19 (04): : 985 - 1011
  • [18] Optimizing ensemble weights and hyperparameters of machine learning models for regression problems
    Shahhosseini, Mohsen
    Hu, Guiping
    Pham, Hieu
    MACHINE LEARNING WITH APPLICATIONS, 2022, 7
  • [19] An Objective Prior from a Scoring Rule
    Walker, Stephen G.
    Villa, Cristiano
    ENTROPY, 2021, 23 (07)
  • [20] Prior Distributions for Objective Bayesian Analysis
    Consonni, Guido
    Fouskakis, Dimitris
    Liseo, Brunero
    Ntzoufras, Ioannis
    BAYESIAN ANALYSIS, 2018, 13 (02): : 627 - 679