CDLNet: Noise-Adaptive Convolutional Dictionary Learning Network for Blind Denoising and Demosaicing

被引:10
作者
Janjusevic, Nikola [1 ]
Khalilian-Gourtani, Amirhossein [1 ]
Wang, Yao [1 ]
机构
[1] NYU, Tandon Sch Engn, Elect & Comp Engn Dept, Brooklyn, NY 11201 USA
来源
IEEE OPEN JOURNAL OF SIGNAL PROCESSING | 2022年 / 3卷
关键词
Noise reduction; Dictionaries; Convolutional codes; Convolution; Training; Task analysis; Signal processing algorithms; Interpretable deep learning; unrolled networks; blind denoising; joint demosaicing and denoising; dictionary learning; sparse coding; K-SVD; IMAGE; ALGORITHM;
D O I
10.1109/OJSP.2022.3172842
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Deep learning based methods hold state-of-the-art results in low-level image processing tasks, but remain difficult to interpret due to their black-box construction. Unrolled optimization networks present an interpretable alternative to constructing deep neural networks by deriving their architecture from classical iterative optimization methods without use of tricks from the standard deep learning tool-box. So far, such methods have demonstrated performance close to that of state-of-the-art models while using their interpretable construction to achieve a comparably low learned parameter count. In this work, we propose an unrolled convolutional dictionary learning network (CDLNet) and demonstrate its competitive denoising and joint denoising and demosaicing (JDD) performance both in low and high parameter count regimes. Specifically, we show that the proposed model outperforms state-of-the-art fully convolutional denoising and JDD models when scaled to a similar parameter count. In addition, we leverage the model's interpretable construction to propose a noise-adaptive parameterization of thresholds in the network that enables state-of-the-art blind denoising performance, and near-perfect generalization on noise-levels unseen during training. Furthermore, we show that such performance extends to the JDD task and unsupervised learning.
引用
收藏
页码:196 / 211
页数:16
相关论文
共 49 条
[1]   Learned Primal-Dual Reconstruction [J].
Adler, Jonas ;
Oktem, Ozan .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2018, 37 (06) :1322-1332
[2]   K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation [J].
Aharon, Michal ;
Elad, Michael ;
Bruckstein, Alfred .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2006, 54 (11) :4311-4322
[3]   A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems [J].
Beck, Amir ;
Teboulle, Marc .
SIAM JOURNAL ON IMAGING SCIENCES, 2009, 2 (01) :183-202
[4]   Analysis of Explainers of Black Box Deep Neural Networks for Computer Vision: A Survey [J].
Buhrmester, Vanessa ;
Muench, David ;
Arens, Michael .
MACHINE LEARNING AND KNOWLEDGE EXTRACTION, 2021, 3 (04) :966-989
[5]   Adaptive wavelet thresholding for image denoising and compression [J].
Chang, SG ;
Yu, B ;
Vetterli, M .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2000, 9 (09) :1532-1546
[6]  
Chen XH, 2018, ADV NEUR IN, V31
[7]   Image denoising by sparse 3-D transform-domain collaborative filtering [J].
Dabov, Kostadin ;
Foi, Alessandro ;
Katkovnik, Vladimir ;
Egiazarian, Karen .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2007, 16 (08) :2080-2095
[8]  
Franzen Rich., 2010, Kodak Lossless True Color Image Suite
[9]   Deep Joint Demosaicking and Denoising [J].
Gharbi, Michael ;
Chaurasia, Gaurav ;
Paris, Sylvain ;
Durand, Fredo .
ACM TRANSACTIONS ON GRAPHICS, 2016, 35 (06)
[10]  
Gregor K., 2010, P 27 INT C INT C MAC, P399