Adjoint operators enable fast and amortized machine learning based Bayesian uncertainty quantification

被引:5
作者
Orozco, Rafael [1 ]
Siahkoohi, Ali [2 ]
Rizzuti, Gabrio [3 ]
van Leeuwen, Tristan [4 ]
Herrmann, Felix [1 ]
机构
[1] Georgia Inst Technol, Computat Sci & Engn, Atlanta, GA 30332 USA
[2] Rice Univ, Houston, TX USA
[3] Univ Utrecht, Dept Math, Utrecht, Netherlands
[4] Ctr Wiskunde & Informat, Amsterdam, Netherlands
来源
MEDICAL IMAGING 2023 | 2023年 / 12464卷
关键词
Uncertainty Quantification; Bayesian Inference; Amortized Inference; Normalizing Flows; Inverse Problems; Medical Imaging; Machine Learning; Deep Learning; ALGORITHM;
D O I
10.1117/12.2651691
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Machine learning algorithms are powerful tools in Bayesian uncertainty quantification (UQ) of inverse problems. Unfortunately, when using these algorithms medical imaging practitioners are faced with the challenging task of manually defining neural networks that can handle complicated inputs such as acoustic data. This task needs to be replicated for different receiver types or configurations since these change the dimensionality of the input. We propose to first transform the data using the adjoint operator -ex: time reversal in photoacoustic imaging (PAI) or back-projection in computer tomography (CT) imaging - then continue posterior inference using the adjoint data as an input now that it has been standardized to the size of the unknown model. This adjoint preprocessing technique has been used in previous works but with minimal discussion on if it is biased. In this work, we prove that conditioning on adjoint data is unbiased for a certain class of inverse problems. We then demonstrate with two medical imaging examples (PAI and CT) that adjoints enable two things: Firstly, adjoints partially undo the physics of the forward operator resulting in faster convergence of a learned Bayesian UQ technique. Secondly, the algorithm is now robust to changes in the observed data caused by different transducer subsampling in PAI and number of angles in CT. Our adjoint-based Bayesian inference method results in point estimates that are faster to compute than traditional baselines and show higher SSIM metrics, while also providing validated UQ.
引用
收藏
页数:11
相关论文
共 45 条
  • [1] Adler J, 2018, Arxiv, DOI [arXiv:1811.05910, 10.48550/ARXIV.1811.05910]
  • [2] Task adapted reconstruction for inverse problems
    Adler, Jonas
    Lunz, Sebastian
    Verdier, Olivier
    Schonlieb, Carola-Bibiane
    Oktem, Ozan
    [J]. INVERSE PROBLEMS, 2022, 38 (07)
  • [3] SIMULTANEOUS ALGEBRAIC RECONSTRUCTION TECHNIQUE (SART) - A SUPERIOR IMPLEMENTATION OF THE ART ALGORITHM
    ANDERSEN, AH
    KAK, AC
    [J]. ULTRASONIC IMAGING, 1984, 6 (01) : 81 - 94
  • [4] On instabilities of deep learning in image reconstruction and the potential costs of AI
    Antun, Vegard
    Renna, Francesco
    Poon, Clarice
    Adcock, Ben
    Hansen, Anders C.
    [J]. PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2020, 117 (48) : 30088 - 30095
  • [5] Ardizzone L, 2019, Arxiv, DOI arXiv:1808.04730
  • [6] On the optimality of conditional expectation as a Bregman predictor
    Banerjee, A
    Guo, X
    Wang, H
    [J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 2005, 51 (07) : 2664 - 2669
  • [7] Baptista R, 2022, Arxiv, DOI arXiv:2206.11343
  • [8] Baptista R, 2023, Arxiv, DOI arXiv:2006.06755
  • [9] Bauer Sebastian, 2013, Time-Of-Flight and Depth Imaging. Sensors, Algorithms and Applications. Dagstuhl 2012 Seminar on Time-of-Flight Imaging and GCPR 2013 Workshop on Imaging New Modalities: LNCS 8200, P228, DOI 10.1007/978-3-642-44964-2_11
  • [10] On Hallucinations in Tomographic Image Reconstruction
    Bhadra, Sayantan
    Kelkar, Varun A.
    Brooks, Frank J.
    Anastasio, Mark A.
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2021, 40 (11) : 3249 - 3260