Empirical Bayes posterior concentration in sparse high-dimensional linear models

被引:69
|
作者
Martin, Ryan [1 ]
Mess, Raymond [1 ]
Walker, Stephen G. [2 ]
机构
[1] Univ Illinois, Dept Math Stat & Comp Sci, 851 S Morgan St, Chicago, IL 60607 USA
[2] Univ Texas Austin, Dept Math, 2525 Speedway Stop C1200, Austin, TX 78712 USA
基金
美国国家科学基金会;
关键词
data-dependent prior; fractional likelihood; minimax; regression; variable selection; VARIABLE SELECTION; DANTZIG SELECTOR; CONVERGENCE-RATES; REGRESSION; SHRINKAGE; LASSO; SPIKE;
D O I
10.3150/15-BEJ797
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
We propose a new empirical Bayes approach for inference in the p >> n normal linear model. The novelty is the use of data in the prior in two ways, for centering and regularization. Under suitable sparsity assumptions, we establish a variety of concentration rate results for the empirical Bayes posterior distribution, relevant for both estimation and model selection. Computation is straightforward and fast, and simulation results demonstrate the strong finite-sample performance of the empirical Bayes model selection procedure.
引用
收藏
页码:1822 / 1847
页数:26
相关论文
共 50 条
  • [41] Robust Information Criterion for Model Selection in Sparse High-Dimensional Linear Regression Models
    Gohain, Prakash Borpatra
    Jansson, Magnus
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2023, 71 : 2251 - 2266
  • [42] NEW IMPROVED CRITERION FOR MODEL SELECTION IN SPARSE HIGH-DIMENSIONAL LINEAR REGRESSION MODELS
    Gohain, Prakash B.
    Jansson, Magnus
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 5692 - 5696
  • [43] Fixed-Size Confidence Regions in High-Dimensional Sparse Linear Regression Models
    Ing, Ching-Kang
    Lai, Tze Leung
    SEQUENTIAL ANALYSIS-DESIGN METHODS AND APPLICATIONS, 2015, 34 (03): : 324 - 335
  • [44] Empirical Bayes Confidence Intervals for Selected Parameters in High-Dimensional Data
    Hwang, J. T. Gene
    Zhao, Zhigen
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2013, 108 (502) : 607 - 618
  • [45] EMPIRICAL BAYES METHODS FOR ESTIMATION AND CONFIDENCE INTERVALS IN HIGH-DIMENSIONAL PROBLEMS
    Ghosh, Debashis
    STATISTICA SINICA, 2009, 19 (01) : 125 - 143
  • [46] STATISTICAL INFERENCE IN SPARSE HIGH-DIMENSIONAL ADDITIVE MODELS
    Gregory, Karl
    Mammen, Enno
    Wahl, Martin
    ANNALS OF STATISTICS, 2021, 49 (03): : 1514 - 1536
  • [47] ADAPTIVE LASSO FOR SPARSE HIGH-DIMENSIONAL REGRESSION MODELS
    Huang, Jian
    Ma, Shuangge
    Zhang, Cun-Hui
    STATISTICA SINICA, 2008, 18 (04) : 1603 - 1618
  • [48] High-dimensional sparse multivariate stochastic volatility models
    Poignard, Benjamin
    Asai, Manabu
    JOURNAL OF TIME SERIES ANALYSIS, 2023, 44 (01) : 4 - 22
  • [49] The adaptive lasso in high-dimensional sparse heteroscedastic models
    Wagener J.
    Dette H.
    Mathematical Methods of Statistics, 2013, 22 (2) : 137 - 154
  • [50] Stable prediction in high-dimensional linear models
    Lin, Bingqing
    Wang, Qihua
    Zhang, Jun
    Pang, Zhen
    STATISTICS AND COMPUTING, 2017, 27 (05) : 1401 - 1412