INDigo: An INN-Guided Probabilistic Diffusion Algorithm for Inverse Problems

被引:0
作者
You, Di [1 ]
Floros, Andreas [1 ]
Dragotti, Pier Luigi [1 ]
机构
[1] Imperial Coll London, EEE Dept, London, England
来源
2023 IEEE 25TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING, MMSP | 2023年
关键词
inverse problems; diffusion models; invertible neural networks;
D O I
10.1109/MMSP59012.2023.10337733
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Recently it has been shown that using diffusion models for inverse problems can lead to remarkable results. However, these approaches require a closed-form expression of the degradation model and can not support complex degradations. To overcome this limitation, we propose a method (INDigo) that combines invertible neural networks (INN) and diffusion models for general inverse problems. Specifically, we train the forward process of INN to simulate an arbitrary degradation process and use the inverse as a reconstruction process. During the diffusion sampling process, we impose an additional data-consistency step that minimizes the distance between the intermediate result and the INN-optimized result at every iteration, where the INN-optimized image is composed of the coarse information given by the observed degraded image and the details generated by the diffusion process. With the help of INN, our algorithm effectively estimates the details lost in the degradation process and is no longer limited by the requirement of knowing the closed-form expression of the degradation model. Experiments demonstrate that our algorithm obtains competitive results compared with recently leading methods both quantitatively and visually. Moreover, our algorithm performs well on more complex degradation models and real-world low-quality images.
引用
收藏
页数:6
相关论文
共 28 条
  • [1] ILVR: Conditioning Method for Denoising Diffusion Probabilistic Models
    Choi, Jooyoung
    Kim, Sungwon
    Jeong, Yonghyun
    Gwon, Youngjune
    Yoon, Sungroh
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 14347 - 14356
  • [2] Chung H., 2023, INT C LEARN REPR ICL
  • [3] Come-Closer-Diffuse-Faster: Accelerating Conditional Diffusion Models for Inverse Problems through Stochastic Contraction
    Chung, Hyungjin
    Sim, Byeongsu
    Ye, Jong Chul
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 12403 - 12412
  • [4] Factoring wavelet transforms into lifting steps
    Daubechies, I
    Sweldens, W
    [J]. JOURNAL OF FOURIER ANALYSIS AND APPLICATIONS, 1998, 4 (03) : 247 - 269
  • [5] Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
  • [6] Dhariwal P, 2021, ADV NEUR IN, V34
  • [7] Hensel M, 2017, ADV NEUR IN, V30
  • [8] Ho J., 2020, P NIPS, V33, P6840
  • [9] WINNet: Wavelet-Inspired Invertible Network for Image Denoising
    Huang, Jun-Jie
    Dragotti, Pier Luigi
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 4377 - 4392
  • [10] Kadkhodaie Z., NEURIPS 2020 WORKSH