A Generative Variational Model for Inverse Problems in Imaging

被引:9
作者
Habring, Andreas [1 ]
Holler, Martin [1 ]
机构
[1] Karl Franzens Univ Graz, Inst Math & Sci Comp, Graz, Austria
来源
SIAM JOURNAL ON MATHEMATICS OF DATA SCIENCE | 2022年 / 4卷 / 01期
关键词
inverse problems; data science; mathematical imaging; deep image prior; generative neural net-works; machine learning; REGULARIZATION;
D O I
10.1137/21M1414978
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
This paper is concerned with the development, analysis, and numerical realization of a novel varia-tional model for the regularization of inverse problems in imaging. The proposed model is inspired by the architecture of generative convolutional neural networks; it aims to generate the unknown from variables in a latent space via multilayer convolutions and nonlinear penalties, and penalizes an associated cost. In contrast to conventional neural-network-based approaches, however, the con-volution kernels are learned directly from the measured data such that no training is required. The present work provides a mathematical analysis of the proposed model in a function space setting, including proofs for regularity and existence/stability of solutions, and convergence for vanishing noise. Moreover, in a discretized setting, a numerical algorithm for solving various types of inverse problems with the proposed model is derived. Numerical results are provided for applications in in -painting, denoising, deblurring under noise, superresolution, and JPEG decompression with multiple test images.
引用
收藏
页码:306 / 335
页数:30
相关论文
共 40 条
  • [1] Lower semicontinuity and relaxation results in BV for integral functionals with BV integrands
    Amar, Micol
    De Cicco, Virginia
    Fusco, Nicola
    [J]. ESAIM-CONTROL OPTIMISATION AND CALCULUS OF VARIATIONS, 2008, 14 (03) : 456 - 477
  • [2] Ambrosio L., 2000, OX MATH M, pxviii, DOI 10.1017/S0024609301309281
  • [3] Solving inverse problems using data-driven models
    Arridge, Simon
    Maass, Peter
    Oktem, Ozan
    Schonlieb, Carola-Bibiane
    [J]. ACTA NUMERICA, 2019, 28 : 1 - 174
  • [4] Asim M, 2020, PR MACH LEARN RES, V119
  • [5] ON REPRESENTER THEOREMS AND CONVEX REGULARIZATION
    Boyer, Claire
    Chambolle, Antonin
    De Castro, Yohann
    Duval, Vincent
    De Gournay, Frederic
    Weiss, Pierre
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2019, 29 (02) : 1260 - 1281
  • [6] A Total Variation-Based JPEG Decompression Model
    Bredies, K.
    Holler, M.
    [J]. SIAM JOURNAL ON IMAGING SCIENCES, 2012, 5 (01): : 366 - 393
  • [7] Bredies K., 2018, Mathematical image processing
  • [8] Higher-order total variation approaches and generalisations
    Bredies, Kristian
    Holler, Martin
    [J]. INVERSE PROBLEMS, 2020, 36 (12)
  • [9] Sparsity of solutions for variational inverse problems with finite-dimensional data
    Bredies, Kristian
    Carioni, Marcello
    [J]. CALCULUS OF VARIATIONS AND PARTIAL DIFFERENTIAL EQUATIONS, 2020, 59 (01)
  • [10] Total Generalized Variation
    Bredies, Kristian
    Kunisch, Karl
    Pock, Thomas
    [J]. SIAM JOURNAL ON IMAGING SCIENCES, 2010, 3 (03): : 492 - 526