Self-Supervised Deep Learning for Image Reconstruction: A Langevin Monte Carlo Approach

被引:3
|
作者
Li, Ji [1 ,2 ]
Wang, Weixi [1 ]
Ji, Hui [1 ]
机构
[1] Natl Univ Singapore, Dept Math, Singapore, Singapore
[2] Capital Normal Univ, Acad Multidisciplinary Studies, Beijing, Peoples R China
来源
SIAM JOURNAL ON IMAGING SCIENCES | 2023年 / 16卷 / 04期
关键词
self-supervised learning; inverse problems; image reconstruction; Langevin dynamics; Bayesian inference; PLAY PRIORS; PLUG; RESTORATION; CONVERGENCE;
D O I
10.1137/23M1548025
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep learning has proved to be a powerful tool for solving inverse problems in imaging, and most of the related work is based on supervised learning. In many applications, collecting truth images is a challenging and costly task, and the prerequisite of having a training dataset of truth images limits its applicability. This paper proposes a self-supervised deep learning method for solving inverse imaging problems that does not require any training samples. The proposed approach is built on a reparametrization of latent images using a convolutional neural network, and the reconstruction is motivated by approximating the minimum mean square error estimate of the latent image using a Langevin dynamics-based Monte Carlo (MC) method. To efficiently sample the network weights in the context of image reconstruction, we propose a Langevin MC scheme called Adam-LD, inspired by the well-known optimizer in deep learning, Adam. The proposed method is applied to solve linear and nonlinear inverse problems, specifically, sparse-view computed tomography image reconstruction and phase retrieval. Our experiments demonstrate that the proposed method outperforms existing unsupervised or self-supervised solutions in terms of reconstruction quality.
引用
收藏
页码:2247 / 2284
页数:38
相关论文
共 50 条
  • [11] A Self-supervised Deep Learning Network for Low-Dose CT Reconstruction
    Liang, Kaichao
    Zhang, Li
    Yang, Yirong
    Yang, Hongkai
    Xing, Yuxiang
    2018 IEEE NUCLEAR SCIENCE SYMPOSIUM AND MEDICAL IMAGING CONFERENCE PROCEEDINGS (NSS/MIC), 2018,
  • [12] An image retrieval approach based on feature extraction and self-supervised learning
    Kolahkaj, Maral
    2022 SECOND INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING AND HIGH PERFORMANCE COMPUTING (DCHPC), 2022, : 46 - 51
  • [13] Weakly-Supervised Contrastive Learning in Path Manifold for Monte Carlo Image Reconstruction
    Cho, In-Young
    Huo, Yuchi
    Yoon, Sung-Eui
    ACM TRANSACTIONS ON GRAPHICS, 2021, 40 (04):
  • [14] Deep active sampling with self-supervised learning
    Shi, Haochen
    Zhou, Hui
    FRONTIERS OF COMPUTER SCIENCE, 2023, 17 (04)
  • [15] Self-Supervised Deep Metric Learning for Pointsets
    Arsomngern, Pattaramanee
    Long, Cheng
    Suwajanakorn, Supasorn
    Nutanong, Sarana
    2021 IEEE 37TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2021), 2021, : 2171 - 2176
  • [16] Deep Metric Learning with Self-Supervised Ranking
    Fu, Zheren
    Li, Yan
    Mao, Zhendong
    Wang, Quan
    Zhang, Yongdong
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 1370 - 1378
  • [17] Self-supervised Learning for Sonar Image Classification
    Preciado-Grijalva, Alan
    Wehbe, Bilal
    Firvida, Miguel Bande
    Valdenegro-Toro, Matias
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 1498 - 1507
  • [18] Pathological Image Contrastive Self-supervised Learning
    Qin, Wenkang
    Jiang, Shan
    Luo, Lin
    RESOURCE-EFFICIENT MEDICAL IMAGE ANALYSIS, REMIA 2022, 2022, 13543 : 85 - 94
  • [19] Self-supervised Learning for Astronomical Image Classification
    Martinazzo, Ana
    Espadoto, Mateus
    Hirata, Nina S. T.
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 4176 - 4182
  • [20] DEEP SELF-SUPERVISED LEARNING FOR FEW-SHOT HYPERSPECTRAL IMAGE CLASSIFICATION
    Li, Yu
    Zhang, Lei
    Wei, Wei
    Zhang, Yanning
    IGARSS 2020 - 2020 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2020, : 501 - 504