A high-dimensional additive nonparametric model

被引:0
作者
Wu, Frank C. Z. [1 ]
机构
[1] Purdue Univ, W Lafayette, IN 47907 USA
关键词
Nonparametric additive models; Bayesian shrinkage; Bayesian backfitting; High-dimensional; VARIABLE SELECTION; REGRESSION; EFFICIENT; SPECIFICATION; INFERENCE;
D O I
10.1016/j.jedc.2024.104916
中图分类号
F [经济];
学科分类号
02 ;
摘要
Nonparametric additive models are garnering increasing attention in applied research across fields like statistics and economics, attributed to their distinct interpretability, versatility, and their adeptness at addressing the curse of dimensionality. This paper introduces a novel and efficient fully Bayesian method for estimating nonparametric additive models, employing a band matrix smoothness prior. Our methodology leverages unobserved binary indicator parameters, promoting linearity in each additive component while allowing for deviations from it. We validate the efficacy of our approach through experiments on synthetic data derived from ten-component additive models, encompassing diverse configurations of linear, nonlinear, and zero function components. Additionally, the robustness of our algorithm is tested on high-dimensional models featuring up to one hundred components, and models correlated components. The practical utility and computational efficiency of our technique are further underscored by its application to two real world datasets, showcasing its broad applicability and effectiveness in various scenarios.
引用
收藏
页数:26
相关论文
共 47 条
[1]   Fourier series approximation of separable models [J].
Amato, U ;
Antoniadis, A ;
De Feis, I .
JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, 2002, 146 (02) :459-479
[2]   Adaptive wavelet series estimation in separable nonparametric regression models [J].
Amato, U ;
Antoniadis, A .
STATISTICS AND COMPUTING, 2001, 11 (04) :373-394
[3]  
[Anonymous], 1996, J. Time Ser. Anal.
[4]   Efficient Gaussian process regression for large datasets [J].
Banerjee, Anjishnu ;
Dunson, David B. ;
Tokdar, Surya T. .
BIOMETRIKA, 2013, 100 (01) :75-89
[5]  
Benigno P., 2024, Working paper
[6]   Adaptive Bayesian regression splines in semiparametric generalized linear models [J].
Biller, C .
JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2000, 9 (01) :122-140
[7]  
BUJA A, 1989, ANN STAT, V17, P453, DOI 10.1214/aos/1176347115
[8]  
Chan J., 2019, Advances in Econometrics: Topics in Identification, Limited Dependent Variables, Partial Observability, Experimentation, and Flexible Modeling, V40B, P47
[9]   Inference in semiparametric dynamic models for binary longitudinal data [J].
Chib, Siddhartha ;
Jeliazkov, Ivan .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2006, 101 (474) :685-700
[10]   Estimation of Semiparametric Models in the Presence of Endogeneity and Sample Selection [J].
Chib, Siddhartha ;
Greenberg, Edward ;
Jeliazkov, Ivan .
JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2009, 18 (02) :321-348