GAUSSIAN APPROXIMATIONS OF SMALL NOISE DIFFUSIONS IN KULLBACK-LEIBLER DIVERGENCE

被引:6
|
作者
Sanz-Alonso, Daniel [1 ]
Stuart, Andrew M. [1 ]
机构
[1] Univ Warwick, Inst Math, Coventry CV4 7AL, W Midlands, England
基金
英国工程与自然科学研究理事会;
关键词
Gaussian approximations; diffusion processes; small noise; Kullback-Leibler divergence;
D O I
10.4310/CMS.2017.v15.n7.a13
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
We study Gaussian approximations to the distribution of a diffusion. The approximations are easy to compute: they are defined by two simple ordinary differential equations for the mean and the covariance. Time correlations can also be computed via solution of a linear stochastic differential equation. We show, using the Kullback-Leibler divergence, that the approximations are accurate in the small noise regime. An analogous discrete time setting is also studied. The results provide both theoretical support for the use of Gaussian processes in the approximation of diffusions, and methodological guidance in the construction of Gaussian approximations in applications.
引用
收藏
页码:2087 / 2097
页数:11
相关论文
共 50 条
  • [1] The Kullback-Leibler Divergence Between Lattice Gaussian Distributions
    Nielsen, Frank
    JOURNAL OF THE INDIAN INSTITUTE OF SCIENCE, 2022, 102 (04) : 1177 - 1188
  • [2] Renyi Divergence and Kullback-Leibler Divergence
    van Erven, Tim
    Harremoes, Peter
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2014, 60 (07) : 3797 - 3820
  • [3] The fractional Kullback-Leibler divergence
    Alexopoulos, A.
    JOURNAL OF PHYSICS A-MATHEMATICAL AND THEORETICAL, 2021, 54 (07)
  • [4] BOUNDS FOR KULLBACK-LEIBLER DIVERGENCE
    Popescu, Pantelimon G.
    Dragomir, Sever S.
    Slusanschi, Emil I.
    Stanasila, Octavian N.
    ELECTRONIC JOURNAL OF DIFFERENTIAL EQUATIONS, 2016,
  • [5] Kullback-Leibler Divergence Between Multivariate Generalized Gaussian Distributions
    Bouhlel, Nizar
    Dziri, Ali
    IEEE SIGNAL PROCESSING LETTERS, 2019, 26 (07) : 1021 - 1025
  • [6] On the Interventional Kullback-Leibler Divergence
    Wildberger, Jonas
    Guo, Siyuan
    Bhattacharyya, Arnab
    Schoelkopf, Bernhard
    CONFERENCE ON CAUSAL LEARNING AND REASONING, VOL 213, 2023, 213 : 328 - 349
  • [7] Kullback-Leibler Divergence Revisited
    Raiber, Fiana
    Kurland, Oren
    ICTIR'17: PROCEEDINGS OF THE 2017 ACM SIGIR INTERNATIONAL CONFERENCE THEORY OF INFORMATION RETRIEVAL, 2017, : 117 - 124
  • [8] On the Properties of Kullback-Leibler Divergence Between Multivariate Gaussian Distributions
    Zhang, Yufeng
    Pan, Jialu
    Li, Kenli
    Liu, Wanwei
    Chen, Zhenbang
    Liu, Xinwang
    Wang, Ji
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [9] Model Fusion with Kullback-Leibler Divergence
    Claici, Sebastian
    Yurochkin, Mikhail
    Ghosh, Soumya
    Solomon, Justin
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 119, 2020, 119
  • [10] Kullback-Leibler Divergence Metric Learning
    Ji, Shuyi
    Zhang, Zizhao
    Ying, Shihui
    Wang, Liejun
    Zhao, Xibin
    Gao, Yue
    IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (04) : 2047 - 2058