Data-driven deep density estimation

被引:0
作者
Patrik Puchert
Pedro Hermosilla
Tobias Ritschel
Timo Ropinski
机构
[1] Ulm University,Institute of Media Informatics
[2] University College London,Department of Computer Science
[3] Linköping University,Department of Science and Technology
来源
Neural Computing and Applications | 2021年 / 33卷
关键词
Density estimation; Deep learning; Data-driven; Kernel density estimation; Probability density function;
D O I
暂无
中图分类号
学科分类号
摘要
Density estimation plays a crucial role in many data analysis tasks, as it infers a continuous probability density function (PDF) from discrete samples. Thus, it is used in tasks as diverse as analyzing population data, spatial locations in 2D sensor readings, or reconstructing scenes from 3D scans. In this paper, we introduce a learned, data-driven deep density estimation (DDE) to infer PDFs in an accurate and efficient manner, while being independent of domain dimensionality or sample size. Furthermore, we do not require access to the original PDF during estimation, neither in parametric form, nor as priors, or in the form of many samples. This is enabled by training an unstructured convolutional neural network on an infinite stream of synthetic PDFs, as unbound amounts of synthetic training data generalize better across a deck of natural PDFs than any natural finite training data will do. Thus, we hope that our publicly available DDE method will be beneficial in many areas of data analysis, where continuous models are to be estimated from discrete observations.
引用
收藏
页码:16773 / 16807
页数:34
相关论文
共 60 条
[1]  
Banan A(2020)Deep learning-based appearance features extraction for automated carp species identification Aquacult Eng 89 102053-143
[2]  
Nasiri A(2006)Variational inference for dirichlet process mixtures Bayesian Anal 1 121-360
[3]  
Taheri-Garavand A(1984)An alternative method of cross-validation for the smoothing of density estimates Biometrika 71 353-55
[4]  
Blei DM(2011)Asymptotics for general multivariate kernel density derivative estimators Stat Sin 21 807-22
[5]  
Jordan MI(1968)Estimation by the nearest neighbor rule IEEE Trans Inf Theory 14 50-506
[6]  
Bowman AW(1977)Maximum likelihood from incomplete data via the EM algorithm J Roy Stat Soc Ser B (Methodol) 39 1-25121
[7]  
Chacón JE(2005)Cross-validation bandwidth matrices for multivariate kernel density estimation Scand J Stat 32 485-433
[8]  
Duong T(2020)Spatiotemporal modeling for nonlinear distributed thermal processes based on kl decomposition, MLP and LSTM network IEEE Access 8 25111-1932
[9]  
Wand MP(2018)High throughput nonparametric probability density estimation PLoS ONE 13 e0196937-86
[10]  
Cover T(2013)Bandwidth selection for kernel density estimation: a review of fully automatic selectors AStA Adv Stat Anal 97 403-175