Copula Approximate Bayesian Computation Using Distribution Random Forests

被引:0
|
作者
Karabatsos, George [1 ,2 ]
机构
[1] Univ Illinois, Dept Math Stat & Comp Sci, 1040 W Harrison St,MC 147, Chicago, IL 60607 USA
[2] Univ Illinois, Dept Educ Psychol Stat & Measurement, 1040 W Harrison St,MC 147, Chicago, IL 60607 USA
来源
STATS | 2024年 / 7卷 / 03期
关键词
Bayesian analysis; maximum likelihood; intractable likelihood; MAXIMUM-LIKELIHOOD-ESTIMATION; HIDDEN MARKOV-MODELS; RANDOM GRAPH MODELS; PSEUDOLIKELIHOOD ESTIMATION; PARAMETER-ESTIMATION; INFERENCE; NETWORKS; FAMILY; REDUCTION; SPREAD;
D O I
10.3390/stats7030061
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
Ongoing modern computational advancements continue to make it easier to collect increasingly large and complex datasets, which can often only be realistically analyzed using models defined by intractable likelihood functions. This Stats invited feature article introduces and provides an extensive simulation study of a new approximate Bayesian computation (ABC) framework for estimating the posterior distribution and the maximum likelihood estimate (MLE) of the parameters of models defined by intractable likelihoods, that unifies and extends previous ABC methods proposed separately. This framework, copulaABCdrf, aims to accurately estimate and describe the possibly skewed and high-dimensional posterior distribution by a novel multivariate copula-based meta-t distribution based on univariate marginal posterior distributions that can be accurately estimated by distribution random forests (drf), while performing automatic summary statistics (covariates) selection, based on robustly estimated copula dependence parameters. The copulaABCdrf framework also provides a novel multivariate mode estimator to perform MLE and posterior mode estimation and an optional step to perform model selection from a given set of models using posterior probabilities estimated by drf. The posterior distribution estimation accuracy of the ABC framework is illustrated and compared with previous standard ABC methods through several simulation studies involving low- and high-dimensional models with computable posterior distributions, which are either unimodal, skewed, or multimodal; and exponential random graph and mechanistic network models, each defined by an intractable likelihood from which it is costly to simulate large network datasets. This paper also proposes and studies a new solution to the simulation cost problem in ABC involving the posterior estimation of parameters from datasets simulated from the given model that are smaller compared to the potentially large size of the dataset being analyzed. This proposal is motivated by the fact that, for many models defined by intractable likelihoods, such as the network models when they are applied to analyze massive networks, the repeated simulation of large datasets (networks) for posterior-based parameter estimation can be too computationally costly and vastly slow down or prohibit the use of standard ABC methods. The copulaABCdrf framework and standard ABC methods are further illustrated through analyses of large real-life networks of sizes ranging between 28,000 and 65.6 million nodes (between 3 million and 1.8 billion edges), including a large multilayer network with weighted directed edges. The results of the simulation studies show that, in settings where the true posterior distribution is not highly multimodal, copulaABCdrf usually produced similar point estimates from the posterior distribution for low-dimensional parametric models as previous ABC methods, but the copula-based method can produce more accurate estimates from the posterior distribution for high-dimensional models, and, in both dimensionality cases, usually produced more accurate estimates of univariate marginal posterior distributions of parameters. Also, posterior estimation accuracy was usually improved when pre-selecting the important summary statistics using drf compared to ABC employing no pre-selection of the subset of important summaries. For all ABC methods studied, accurate estimation of a highly multimodal posterior distribution was challenging. In light of the results of all the simulation studies, this article concludes by discussing how the copulaABCdrf framework can be improved for future research.
引用
收藏
页码:1002 / 1050
页数:49
相关论文
共 50 条
  • [31] Approximate Bayesian computation with functional statistics
    Soubeyrand, Samuel
    Carpentier, Florence
    Guiton, Francois
    Klein, Etienne K.
    STATISTICAL APPLICATIONS IN GENETICS AND MOLECULAR BIOLOGY, 2013, 12 (01) : 17 - 37
  • [32] DIFFUSION FILTRATION WITH APPROXIMATE BAYESIAN COMPUTATION
    Dedecius, Kamil
    Djuric, Petar M.
    2015 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING (ICASSP), 2015, : 3207 - 3211
  • [33] Approximate Bayesian Computation by Subset Simulation using hierarchical state-space models
    Vakilzadeh, Majid K.
    Huang, Yong
    Beck, James L.
    Abrahamsson, Thomas
    MECHANICAL SYSTEMS AND SIGNAL PROCESSING, 2017, 84 : 2 - 20
  • [34] Approximate Bayesian Computation via Classification
    Wang, Yuexi
    Kaji, Tetsuya
    Rockova, Veronika
    JOURNAL OF MACHINE LEARNING RESEARCH, 2022, 23
  • [35] Approximate Bayesian Computation for Discrete Spaces
    Auzina, Ilze A.
    Tomczak, Jakub M.
    ENTROPY, 2021, 23 (03) : 1 - 16
  • [36] MICROSIMULATION MODEL CALIBRATION USING INCREMENTAL MIXTURE APPROXIMATE BAYESIAN COMPUTATION
    Rutter, Carolyn M.
    Ozik, Jonathan
    DeYoreo, Maria
    Collier, Nicholson
    ANNALS OF APPLIED STATISTICS, 2019, 13 (04) : 2189 - 2212
  • [37] Estimation of Parameters for Macroparasite Population Evolution Using Approximate Bayesian Computation
    Drovandi, C. C.
    Pettitt, A. N.
    BIOMETRICS, 2011, 67 (01) : 225 - 233
  • [38] On optimality of kernels for approximate Bayesian computation using sequential Monte Carlo
    Filippi, Sarah
    Barnes, Chris P.
    Cornebise, Julien
    Stumpf, Michael P. H.
    STATISTICAL APPLICATIONS IN GENETICS AND MOLECULAR BIOLOGY, 2013, 12 (01) : 87 - 107
  • [39] Piecewise Approximate Bayesian Computation: fast inference for discretely observed Markov models using a factorised posterior distribution
    White, S. R.
    Kypraios, T.
    Preston, S. P.
    STATISTICS AND COMPUTING, 2015, 25 (02) : 289 - 301
  • [40] MODELLING TRAIT-DEPENDENT SPECIATION WITH APPROXIMATE BAYESIAN COMPUTATION
    Bartoszek, Krzysztof
    Lio, Pietro
    ACTA PHYSICA POLONICA B PROCEEDINGS SUPPLEMENT, 2019, 12 (01) : 25 - 47