FFDNet: Toward a Fast and Flexible Solution for CNN-Based Image Denoising

被引:1936
作者
Zhang, Kai [1 ,2 ]
Zuo, Wangmeng [1 ]
Zhang, Lei [2 ]
机构
[1] Harbin Inst Technol, Sch Comp Sci & Technol, Harbin 150001, Heilongjiang, Peoples R China
[2] Hong Kong Polytech Univ, Dept Comp, Hong Kong, Hong Kong, Peoples R China
关键词
Image denoising; convolutional neural networks; Gaussian noise; spatially variant noise; SPARSE; FRAMEWORK; NOISE;
D O I
10.1109/TIP.2018.2839891
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Due to the fast inference and good performance, discriminative learning methods have been widely studied in image denoising. However, these methods mostly learn a specific model for each noise level, and require multiple models for denoising images with different noise levels. They also lack flexibility to deal with spatially variant noise, limiting their applications in practical denoising. To address these issues, we present a fast and flexible denoising convolutional neural network, namely FFDNet, with a tunable noise level map as the input. The proposed FFDNet works on downsampled sub-images, achieving a good trade-off between inference speed and denoising performance. In contrast to the existing discriminative denoisers, FFDNet enjoys several desirable properties, including: 1) the ability to handle a wide range of noise levels (i.e., [0, 75]) effectively with a single network; 2) the ability to remove spatially variant noise by specifying a non-uniform noise level map; and 3) faster speed than benchmark BM3D even on CPU without sacrificing denoising performance. Extensive experiments on synthetic and real noisy images are conducted to evaluate FFDNet in comparison with state-of-the-art denoisers. The results show that FFDNet is effective and efficient, making it highly attractive for practical denoising applications.
引用
收藏
页码:4608 / 4622
页数:15
相关论文
共 63 条
[41]   Non-local Sparse Models for Image Restoration [J].
Mairal, Julien ;
Bach, Francis ;
Ponce, Jean ;
Sapiro, Guillermo ;
Zisserman, Andrew .
2009 IEEE 12TH INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2009, :2272-2279
[42]  
Martin D, 2001, EIGHTH IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION, VOL II, PROCEEDINGS, P416, DOI 10.1109/ICCV.2001.937655
[43]   A Holistic Approach to Cross-Channel Image Noise Modeling and its Application to Image Denoising [J].
Nam, Seonghyeon ;
Hwang, Youngbae ;
Matsushita, Yasuyuki ;
Kim, Seon Joo .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :1683-1691
[44]   Benchmarking Denoising Algorithms with Real Photographs [J].
Ploetz, Tobias ;
Roth, Stefan .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :2750-2759
[45]   Image denoising using scale mixtures of Gaussians in the wavelet domain [J].
Portilla, J ;
Strela, V ;
Wainwright, MJ ;
Simoncelli, EP .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2003, 12 (11) :1338-1351
[46]   Learning Non-local Image Diffusion for Image Denoising [J].
Qiao, Peng ;
Dou, Yong ;
Feng, Wensen ;
Li, Rongchun ;
Chen, Yunjin .
PROCEEDINGS OF THE 2017 ACM MULTIMEDIA CONFERENCE (MM'17), 2017, :1847-1855
[47]   Conditioned Regression Models for Non-Blind Single Image Super-Resolution [J].
Riegler, Gernot ;
Schulter, Samuel ;
Ruether, Matthias ;
Bischof, Horst .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :522-530
[48]   The Little Engine That Could: Regularization by Denoising (RED) [J].
Romano, Yaniv ;
Elad, Michael ;
Milanfar, Peyman .
SIAM JOURNAL ON IMAGING SCIENCES, 2017, 10 (04) :1804-1844
[49]  
Roth S, 2005, PROC CVPR IEEE, P860
[50]  
Samuel KGG, 2009, PROC CVPR IEEE, P477, DOI 10.1109/CVPRW.2009.5206774