Ultra-Fast Approximate Inference Using Variational Functional Mixed Models

被引:2
作者
Huo, Shuning [1 ]
Morris, Jeffrey S. [2 ]
Zhu, Hongxiao [1 ]
机构
[1] Virginia Tech, Dept Stat, Blacksburg, VA 24061 USA
[2] Univ Penn, Dept Stat, Dept Biostat Epidemiol & Informat, Philadelphia, PA 19104 USA
基金
美国国家科学基金会;
关键词
Approximate Bayesian inference; Distributed inference; Functional data analysis; Parallel computing; Variational Bayes; QUANTITATIVE IMAGE DATA; MASS-SPECTROMETRY; DATA REGISTRATION; REGRESSION; ROBUST; BAYES; SPIKE;
D O I
10.1080/10618600.2022.2107532
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
While Bayesian functional mixed models have been shown effective to model functional data with various complex structures, their application to extremely high-dimensional data is limited due to computational challenges involved in posterior sampling. We introduce a new computational framework that enables ultra-fast approximate inference for high-dimensional data in functional form. This framework adopts parsimonious basis to represent functional observations, which facilitates efficient compression and parallel computing in basis space. Instead of performing expensive Markov chain Monte Carlo sampling, we approximate the posterior distribution using variational Bayes and adopt a fast iterative algorithm to estimate parameters of the approximate distribution. Our approach facilitates a fast multiple testing procedure in basis space, which can be used to identify significant local regions that reflect differences across groups of samples. We perform two simulation studies to assess the performance of approximate inference, and demonstrate applications of the proposed approach by using a proteomic mass spectrometry dataset and a brain imaging dataset. for this article are available online.
引用
收藏
页码:353 / 365
页数:13
相关论文
共 65 条
[1]  
[Anonymous], 1992, Variance Components
[2]   Variational Inference for Dirichlet Process Mixtures [J].
Blei, David M. ;
Jordan, Michael I. .
BAYESIAN ANALYSIS, 2006, 1 (01) :121-143
[3]   Variational Inference: A Review for Statisticians [J].
Blei, David M. ;
Kucukelbir, Alp ;
McAuliffe, Jon D. .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2017, 112 (518) :859-877
[4]   Functional linear model [J].
Cardot, H ;
Ferraty, F ;
Sarda, P .
STATISTICS & PROBABILITY LETTERS, 1999, 45 (01) :11-22
[5]   The horseshoe estimator for sparse signals [J].
Carvalho, Carlos M. ;
Polson, Nicholas G. ;
Scott, James G. .
BIOMETRIKA, 2010, 97 (02) :465-480
[6]   Linear functional regression: the case of fixed design and functional response [J].
Cuevas, A ;
Febrero, M ;
Fraiman, R .
CANADIAN JOURNAL OF STATISTICS-REVUE CANADIENNE DE STATISTIQUE, 2002, 30 (02) :285-300
[7]   Variational Bayes for Functional Data Registration, Smoothing, and Prediction [J].
Earls, Cecilia ;
Hooker, Giles .
BAYESIAN ANALYSIS, 2017, 12 (02) :557-582
[8]   Combining Functional Data Registration and Factor Analysis [J].
Earls, Cecilia ;
Hooker, Giles .
JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2017, 26 (02) :296-305
[9]   Variational Bayesian Inference for Parametric and Nonparametric Regression With Missing Data [J].
Faes, C. ;
Ormerod, J. T. ;
Wand, M. P. .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2011, 106 (495) :959-971
[10]   FUNCTIONAL ADDITIVE REGRESSION [J].
Fan, Yingying ;
James, Gareth M. ;
Radchenk, Peter .
ANNALS OF STATISTICS, 2015, 43 (05) :2296-2325