Boosting image denoising effect via low-level noise injection

被引:2
作者
Xiao, Jian [1 ]
Cheng, Xiaohui [1 ]
Xu, Shaoping [1 ]
Tao, Wuyong [1 ]
Xiao, Yanyang [1 ]
机构
[1] Nanchang Univ, Sch Math & Comp Sci, Nanchang 330031, Peoples R China
关键词
Boosting denoising effect; Supervised denoising models; Flexibility; Noise injection; Fine-tuned image; Fusion network;
D O I
10.1007/s11760-023-02785-8
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In the past decade, supervised denoising models trained on large datasets have demonstrated impressive performance in image denoising due to their superior denoising effect. However, these models lack flexibility and exhibit varying degrees of degradation in denoising performance in practical applications, particularly when the noise distribution of the given noisy images does not match the training images. Our preliminary experiments suggest that even under ideal conditions, the denoised images obtained using these supervised denoising models (also known as preprocessed images) are already very similar to the ground truth images in terms of pixel intensities. Adding low-level noise to a preprocessed image can approximate the intensities of some pixels to their original values, but not all pixels. Based on this observation, we propose a novel two-stage approach to enhance the denoising effect of existing supervised denoisers using a low-noise injection strategy. In the first stage, we use a state-of-the-art supervised denoiser to denoise the given noisy image and obtain a preprocessed image. Then, we repeatedly inject different random low-level Gaussian noises to further improve certain pixels of the preprocessed image. The generated images are used as target images, and we obtain corresponding fine-tuned images within the framework of the unsupervised deep image prior (DIP) method by fully utilizing its flexibility. As a result, we obtain several denoised fine-tuned images that, respectively, approximate the ground truth image at specific pixels and complement each other. In the second stage, these fine-tuned images are fed to an unsupervised fusion network, which fully leverages the complementarity among the sample images to generate a fused image as the final denoised result. Experimental results demonstrate that the proposed method significantly improves the denoising effectiveness of synthetic noisy images, especially far surpassed the state-of-the-art methods in dealing with real noisy images.
引用
收藏
页码:1053 / 1067
页数:15
相关论文
共 35 条
[11]   Neighbor2Neighbor: Self-Supervised Denoising from Single Noisy Images [J].
Huang, Tao ;
Li, Songjiang ;
Jia, Xu ;
Lu, Huchuan ;
Liu, Jianzhuang .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :14776-14785
[12]   Noise2Void-Learning Denoising from Single Noisy Images [J].
Krull, Alexander ;
Buchholz, Tim-Oliver ;
Jug, Florian .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :2124-2132
[13]  
Lehtinen J, 2018, PR MACH LEARN RES, V80
[14]   SwinIR: Image Restoration Using Swin Transformer [J].
Liang, Jingyun ;
Cao, Jiezhang ;
Sun, Guolei ;
Zhang, Kai ;
Van Gool, Luc ;
Timofte, Radu .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2021), 2021, :1833-1844
[15]  
Liu D., ADV NEURAL INFORM PR, V31
[16]   Multi-level Wavelet-CNN for Image Restoration [J].
Liu, Pengju ;
Zhang, Hongzhi ;
Zhang, Kai ;
Lin, Liang ;
Zuo, Wangmeng .
PROCEEDINGS 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2018, :886-895
[17]  
Martin D, 2001, EIGHTH IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION, VOL II, PROCEEDINGS, P416, DOI 10.1109/ICCV.2001.937655
[18]   Dynamic Attentive Graph Learning for Image Restoration [J].
Mou, Chong ;
Zhang, Jian ;
Wu, Zhuoyuan .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :4308-4317
[19]   CVF-SID: Cyclic multi-Variate Function for Self-Supervised Image Denoising by Disentangling Noise from Image [J].
Neshatavar, Reyhaneh ;
Yavartanoo, Mohsen ;
Son, Sanghyun ;
Lee, Kyoung Mu .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, :17562-17570
[20]   Recorrupted-to-Recorrupted: Unsupervised Deep Learning for Image Denoising [J].
Pang, Tongyao ;
Zheng, Huan ;
Quan, Yuhui ;
Ji, Hui .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :2043-2052