WINNet: Wavelet-Inspired Invertible Network for Image Denoising

被引:86
作者
Huang, Jun-Jie [1 ]
Dragotti, Pier Luigi [2 ]
机构
[1] Natl Univ Def Technol, Coll Comp Sci, Changsha 410073, Peoples R China
[2] Imperial Coll London, Dept Elect & Elect Engn, London SW7 2AZ, England
基金
英国工程与自然科学研究理事会;
关键词
Image denoising; wavelet transform; invertible neural networks; TRANSFORM; ALGORITHM; SPARSE; DICTIONARIES; CNN;
D O I
10.1109/TIP.2022.3184845
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Image denoising aims to restore a clean image from an observed noisy one. Model-based image denoising approaches can achieve good generalization ability over different noise levels and are with high interpretability. Learning-based approaches are able to achieve better results, but usually with weaker generalization ability and interpretability. In this paper, we propose a wavelet-inspired invertible network (WINNet) to combine the merits of the wavelet-based approaches and learning-based approaches. The proposed WINNet consists of K-scale of lifting inspired invertible neural networks (LINNs) and sparsity-driven denoising networks together with a noise estimation network. The network architecture of LINNs is inspired by the lifting scheme in wavelets. LINNs are used to learn a non-linear redundant transform with perfect reconstruction property to facilitate noise removal. The denoising network implements a sparse coding process for denoising. The noise estimation network estimates the noise level from the input image which will be used to adaptively adjust the soft-thresholds in LINNs. The forward transform of LINNs produces a redundant multi-scale representation for denoising. The denoised image is reconstructed using the inverse transform of LINNs with the denoised detail channels and the original coarse channel. The simulation results show that the proposed WINNet method is highly interpretable and has strong generalization ability to unseen noise levels. It also achieves competitive results in the non-blind/blind image denoising and in image deblurring.
引用
收藏
页码:4377 / 4392
页数:16
相关论文
共 71 条
[41]   Single-Image Noise Level Estimation for Blind Denoising [J].
Liu, Xinhao ;
Tanaka, Masayuki ;
Okutomi, Masatoshi .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2013, 22 (12) :5226-5237
[42]   Invertible Denoising Network: A Light Solution for Real Noise Removal [J].
Liu, Yang ;
Qin, Zhenyue ;
Anwar, Saeed ;
Ji, Pan ;
Kim, Dongwoo ;
Caldwell, Sabrina ;
Gedeon, Tom .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :13360-13369
[43]   End-to-End Optimized Versatile Image Compression With Wavelet-Like Transform [J].
Ma, Haichuan ;
Liu, Dong ;
Yan, Ning ;
Li, Houqiang ;
Wu, Feng .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (03) :1247-1263
[44]   iWave: CNN-Based Wavelet-Like Transform for Image Compression [J].
Ma, Haichuan ;
Liu, Dong ;
Xiong, Ruiqin ;
Wu, Feng .
IEEE TRANSACTIONS ON MULTIMEDIA, 2020, 22 (07) :1667-1679
[45]   Fast image and video denoising via nonlocal means of similar neighborhoods [J].
Mahmoudi, M ;
Sapiro, G .
IEEE SIGNAL PROCESSING LETTERS, 2005, 12 (12) :839-842
[46]   Learning Proximal Operators: Using Denoising Networks for Regularizing Inverse Imaging Problems [J].
Meinhardt, Tim ;
Moeller, Michael ;
Hazirbas, Caner ;
Cremers, Daniel .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :1799-1808
[47]  
Metzler CA, 2015, IEEE IMAGE PROC, P3116, DOI 10.1109/ICIP.2015.7351377
[48]  
Mohan S., 2020, PROC INT C LEARN REP
[49]  
Plötz T, 2018, ADV NEUR IN, V31
[50]  
Pustelnik N., 2016, Wiley Encyclopedia of EEE, DOI [DOI 10.1002/047134608X.W8294, 10.1002/047134608X.W8294]