IMAGE DENOISING WITH DEEP UNFOLDING AND NORMALIZING FLOWS

被引:1
作者
Wei, Xinyi [1 ]
van Gorp, Hans [1 ]
Carabarin, Lizeth Gonzalez [1 ]
Freedman, Daniel [2 ]
Eldar, Yonina C. [3 ]
van Sloun, Ruud J. G. [1 ]
机构
[1] Eindhoven Univ Technol, Dept Elect Engn, Eindhoven, Netherlands
[2] Verily Res, Tel Aviv, Israel
[3] Weizmann Inst Sci, Dept Math & Comp Sci, Rehovot, Israel
来源
2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP) | 2022年
关键词
image denoising; inverse problems; deep unfolding; generative modeling; normalizing flows;
D O I
10.1109/ICASSP43922.2022.9747748
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Many application domains, spanning from low-level computer vision to medical imaging, require high-fidelity images from noisy measurements. State-of-the-art methods for solving denoising problems combine deep learning with iterative modelbased solvers, a concept known as deep algorithm unfolding or unrolling. By combining a-priori knowledge of the forward measurement model with learned proximal image-to-image mappings based on deep networks, these methods yield solutions that are both physically feasible (data-consistent) and perceptually plausible (consistent with prior belief). However, current proximal mappings based on (predominantly convolutional) neural networks only implicitly learn such image priors. In this paper, we propose to make these image priors fully explicit by embedding deep generative models in the form of normalizing flows within the unfolded proximal gradient algorithm, and training the entire algorithm in an end-to-end fashion. We demonstrate that the proposed method outperforms competitive baselines on image denoising.
引用
收藏
页码:1551 / 1555
页数:5
相关论文
共 30 条
[1]  
[Anonymous], 2017, Compressed sensing using generative models
[2]  
[Anonymous], 2012, 2012 IEEE conference on computer vision and pattern recognition, DOI DOI 10.1109/CVPR.2012.6247952
[3]  
Asim M., 2020, P MACHINE LEARNING S, P4577
[4]  
Asim Muhammad, 2018, SOLVING BILINEAR INV
[5]   Distributed optimization and statistical learning via the alternating direction method of multipliers [J].
Boyd S. ;
Parikh N. ;
Chu E. ;
Peleato B. ;
Eckstein J. .
Foundations and Trends in Machine Learning, 2010, 3 (01) :1-122
[6]  
Demir Ugur, 2018, PATCH BASED IMAGE IM
[7]   Compressed sensing [J].
Donoho, DL .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2006, 52 (04) :1289-1306
[8]  
Eldar Y., 2012, Compressed Sensing: Theory and Applications
[9]  
Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672
[10]   Global Guarantees for Enforcing Deep Generative Priors by Empirical Risk [J].
Hand, Paul ;
Voroninski, Vladislav .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2020, 66 (01) :401-418