A Score-Based Approach for Training Schrodinger Bridges for Data Modelling

被引:3
|
作者
Winkler, Ludwig [1 ]
Ojeda, Cesar [2 ,3 ]
Opper, Manfred [2 ,3 ,4 ]
机构
[1] Tech Univ Berlin, Learning Grp 1Machine, D-10623 Berlin, Germany
[2] Tech Univ Berlin, Artificial Intelligence Grp, D-10623 Berlin, Germany
[3] Univ Potsdam, Inst Math, D-14469 Potsdam, Germany
[4] Univ Birmingham, Ctr Syst Modelling & Quantitat Biomed, Birmingham B15 2TT, England
关键词
Schrodinger bridge problem; score estimation; reverse-time stochastic processes; OPTIMAL TRANSPORT;
D O I
10.3390/e25020316
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
A Schrodinger bridge is a stochastic process connecting two given probability distributions over time. It has been recently applied as an approach for generative data modelling. The computational training of such bridges requires the repeated estimation of the drift function for a time-reversed stochastic process using samples generated by the corresponding forward process. We introduce a modified score- function-based method for computing such reverse drifts, which can be efficiently implemented by a feed-forward neural network. We applied our approach to artificial datasets with increasing complexity. Finally, we evaluated its performance on genetic data, where Schrodinger bridges can be used to model the time evolution of single-cell RNA measurements.
引用
收藏
页数:26
相关论文
共 50 条
  • [1] Riemannian Score-Based Generative Modelling
    De Bortoli, Valentin
    Mathieu, Emile
    Hutchinson, Michael
    Thornton, James
    Teh, Yee Whye
    Doucet, Arnaud
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [2] Score-based Data Assimilation
    Rozet, Francois
    Louppe, Gilles
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [3] Diffusion Schrodinger Bridge with Applications to Score-Based Generative Modeling
    De Bortoli, Valentin
    Thornton, James
    Heng, Jeremy
    Doucet, Arnaud
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [4] Improved Techniques for Training Score-Based Generative Models
    Song, Yang
    Ermon, Stefano
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [5] STASY: SCORE-BASED TABULAR DATA SYNTHESIS
    Kim, Jayoung
    Lee, Chaejeong
    Park, Noseong
    arXiv, 2022,
  • [6] Maximum Likelihood Training of Score-Based Diffusion Models
    Song, Yang
    Durkan, Conor
    Murray, Iain
    Ermon, Stefano
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [7] A score-based filter for nonlinear data assimilation
    Bao, Feng
    Zhang, Zezhong
    Zhang, Guannan
    JOURNAL OF COMPUTATIONAL PHYSICS, 2024, 514
  • [8] Pathway Analysis for RNA-Seq Data Using a Score-Based Approach
    Zhou, Yi-Hui
    BIOMETRICS, 2016, 72 (01) : 165 - 174
  • [9] SOS: Score-based Oversampling for Tabular Data
    Kim, Jayoung
    Lee, Chaejeong
    Shin, Yehjin
    Park, Sewon
    Kim, Minjung
    Park, Noseong
    Cho, Jihoon
    PROCEEDINGS OF THE 28TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2022, 2022, : 762 - 772
  • [10] Prognostic score-based model averaging approach for propensity score estimation
    Kabata, Daijiro
    Stuart, Elizabeth A.
    Shintani, Ayumi
    BMC MEDICAL RESEARCH METHODOLOGY, 2024, 24 (01)