Ultra high-dimensional multivariate posterior contraction rate under shrinkage priors

被引:2
|
作者
Zhang, Ruoyang [1 ]
Ghosh, Malay [1 ]
机构
[1] Univ Florida, Dept Stat, Gainesville, FL 32611 USA
关键词
Gaussian scale mixture; Multivariate regression; Unknown covariance matrix; BAYESIAN VARIABLE SELECTION; LINEAR-REGRESSION; HORSESHOE ESTIMATOR; GROUP LASSO; SPARSE; CONSISTENCY; REDUCTION;
D O I
10.1016/j.jmva.2021.104835
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
In recent years, shrinkage priors have received much attention in high-dimensional data analysis from a Bayesian perspective. Compared with widely used spike-and-slab priors, shrinkage priors have better computational efficiency. But the theoretical properties, especially posterior contraction rate, which is important in uncertainty quantification, are not established in many cases. In this paper, we apply global-local shrinkage priors to high-dimensional multivariate linear regression with unknown covariance matrix. We show that when the prior is highly concentrated near zero and has heavy tail, the posterior contraction rates for both coefficients matrix and covariance matrix are nearly optimal. Our results hold when number of features p grows much faster than the sample size n, which is of great interest in modern data analysis. We show that a class of readily implementable scale mixture of normal priors satisfies the conditions of the main theorem. (c) 2021 Elsevier Inc. All rights reserved.
引用
收藏
页数:18
相关论文
共 50 条
  • [1] High-dimensional multivariate posterior consistency under global-local shrinkage priors
    Bai, Ray
    Ghosh, Malay
    JOURNAL OF MULTIVARIATE ANALYSIS, 2018, 167 : 157 - 170
  • [2] Shrinkage priors for high-dimensional demand estimation
    Adam N. Smith
    Jim E. Griffin
    Quantitative Marketing and Economics, 2023, 21 : 95 - 146
  • [3] Shrinkage priors for high-dimensional demand estimation
    Smith, Adam N.
    Griffin, Jim E.
    QME-QUANTITATIVE MARKETING AND ECONOMICS, 2023, 21 (01): : 95 - 146
  • [4] Necessary and Sufficient Conditions for High-Dimensional Posterior Consistency under g-Priors
    Sparks, Douglas K.
    Khare, Kshitij
    Ghosh, Malay
    BAYESIAN ANALYSIS, 2015, 10 (03): : 627 - 664
  • [5] Hierarchical Shrinkage Priors and Model Fitting for High-dimensional Generalized Linear Models
    Yi, Nengjun
    Ma, Shuangge
    STATISTICAL APPLICATIONS IN GENETICS AND MOLECULAR BIOLOGY, 2012, 11 (06)
  • [6] Posterior consistency in linear models under shrinkage priors
    Armagan, A.
    Dunson, D. B.
    Lee, J.
    Bajwa, W. U.
    Strawn, N.
    BIOMETRIKA, 2013, 100 (04) : 1011 - 1018
  • [7] High-Dimensional Bayesian Network Classification with Network Global-Local Shrinkage Priors
    Guha, Sharmistha
    Rodriguez, Abel
    BAYESIAN ANALYSIS, 2023, 18 (04): : 1131 - 1160
  • [8] Posterior model consistency in high-dimensional Bayesian variable selection with arbitrary priors
    Hua, Min
    Goh, Gyuhyeong
    STATISTICS & PROBABILITY LETTERS, 2025, 223
  • [9] Asymptotic Optimality of One-Group Shrinkage Priors in Sparse High-dimensional Problems
    Ghosh, Prasenjit
    Chakrabarti, Arijit
    BAYESIAN ANALYSIS, 2017, 12 (04): : 1133 - 1161
  • [10] High-Dimensional Posterior Consistency for Hierarchical Non-Local Priors in Regression
    Cao, Xuan
    Khare, Kshitij
    Ghosh, Malay
    BAYESIAN ANALYSIS, 2020, 15 (01): : 241 - 262