Douglas-Rachford Networks: Learning Both the Image Prior and Data Fidelity Terms for Blind Image Deconvolution

被引:33
作者
Aljadaany, Raied [1 ]
Pal, Dipan K. [1 ]
Savvides, Marios [1 ]
机构
[1] Carnegie Mellon Univ, Dept Elect & Comp Engn, Pittsburgh, PA 15213 USA
来源
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019) | 2019年
关键词
ALGORITHM; SPARSE;
D O I
10.1109/CVPR.2019.01048
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Blind deconvolution problems are heavily ill-posed where the specific blurring kernel is not known. Recovering these images typically requires estimates of the kernel. In this paper, we present a method called Dr-Net, which does not require any such estimate and is further able to invert the effects of the blurring in blind image recovery tasks. These image recovery problems typically have two terms, the data fidelity term (for faithful reconstruction) and the image prior (for realistic looking reconstructions). We use the Douglas-Rachford iterations to solve this problem since it is a more generally applicable optimization procedure than methods such as the proximal gradient descent algorithm. Two proximal operators originate from these iterations, one for the data fidelity term and the second for the image prior. It is non-trivial to design a hand-crafted function to represent these proximal operators which would work with real-world image distributions. We therefore approximate both these proximal operators using deep networks. This provides a sound motivation for the final architecture for Dr-Net which we find outperforms the state-of-the-art on two mainstream blind deconvolution benchmarks. While doing so, we also find that Dr-Net is one of the fastest algorithms according to wall-clock times.
引用
收藏
页码:10227 / 10236
页数:10
相关论文
共 59 条
[31]  
Mallat S., 1998, WAVELET TOUR SIGNAL
[32]   Least Squares Generative Adversarial Networks [J].
Mao, Xudong ;
Li, Qing ;
Xie, Haoran ;
Lau, Raymond Y. K. ;
Wang, Zhen ;
Smolley, Stephen Paul .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :2813-2821
[33]   Learning Proximal Operators: Using Denoising Networks for Regularizing Inverse Imaging Problems [J].
Meinhardt, Tim ;
Moeller, Michael ;
Hazirbas, Caner ;
Cremers, Daniel .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :1799-1808
[34]  
Mirza M, CoRR, VarXiv
[35]   Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurring [J].
Nah, Seungjun ;
Kim, Tae Hyun ;
Lee, Kyoung Mu .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :257-265
[36]   Deblurring Images via Dark Channel Prior [J].
Pan, Jinshan ;
Sun, Deqing ;
Pfister, Hanspeter ;
Yang, Ming-Hsuan .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (10) :2315-2328
[37]   Blind Image Deblurring Using Dark Channel Prior [J].
Pan, Jinshan ;
Sun, Deqing ;
Pfister, Hanspeter ;
Yang, Ming-Hsuan .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :1628-1636
[38]  
Parikh Neal, 2014, Foundations and Trends in Optimization, V1, P127, DOI 10.1561/2400000003
[39]  
Paszke A., 2017, Pytorch
[40]   THE NUMERICAL SOLUTION OF PARABOLIC AND ELLIPTIC DIFFERENTIAL EQUATIONS [J].
PEACEMAN, DW ;
RACHFORD, HH .
JOURNAL OF THE SOCIETY FOR INDUSTRIAL AND APPLIED MATHEMATICS, 1955, 3 (01) :28-41